Knowledge Editing for LLMs Papers

Must-read papers on knowledge editing for large language models.

🔔 News

New Reports

| Report | Topic | PPT Resource | | :-----------------: | :---------: | :------------: | |NLPCC2024 tutorial | Knowledge Mechanism, Fusion, Editing for LLMs| Google Drive | |Invited Talk | Editing Large Language Models Advancing Machine Understanding and Control| Google Drive | | CCL2024 tutorial| 大语言模型知识机理、融合与编辑| Google Drive & BaiduPan | | IJCAI2024 tutorial| Knowledge Editing for Large Language Models | Google Drive | | COLING2024 tutorial| Knowledge Editing for Large Language Models| Google Drive | | 北京智源大会| 大语言模型知识机理与编辑问题| BaiduPan | | VALSE2024 tutorial| Knowledge Mechanism and Editing for Large Language Models| Google Drive | | AAAI2024 tutorial | Knowledge Editing for Large Language Models | Google Drive |

2024-09-26 Our paper: "WISE: Rethinking the Knowledge Memory for Lifelong Model Editing of Large Language Models" and "Knowledge Circuits in Pretrained Transformers" have been accepted by NeurIPS 2024. Our papers: "Knowledge Mechanisms in Large Language Models: A Survey and Perspective" and "Editing Conceptual Knowledge for Large Language Models" have been accepted by EMNLP 2024 Findings.
2024-07-22 We release a new paper: "Knowledge Mechanisms in Large Language Models: A Survey and Perspective", which reviews how knowledge is acquired, utilized, and evolves in large language models.
2024-05-16 Our paper "Detoxifying Large Language Models via Knowledge Editing" has been accepted by ACL 2024.
2024-01-03 We release a new paper:"A Comprehensive Study of Knowledge Editing for Large Language Models" with a new benchmark KnowEdit! We are looking forward to any comments or discussions on this topic
2024-12-09 Our paper "Editing Language Model-based Knowledge Graph Embeddings?" has been accepted by AAAI 2024.
2023-11-18 We will provide a tutorial on Knowledge Editing for Large Language Models at COLING 2024.
2023-10-25 We will provide a tutorial on Knowledge Editing for Large Language Models at AAAI 2024.
2023-10-22 Our paper "Can We Edit Multimodal Large Language Models?" has been accepted by EMNLP 2023.
2023-10-08 Our paper "Editing Large Language Models: Problems, Methods, and Opportunities" has been accepted by EMNLP 2023.
2023-8-15 We release the paper "EasyEdit: An Easy-to-use Knowledge Editing Framework for Large Language Models."
2023-07 We release EasyEdit, an easy-to-use knowledge editing framework for LLMs.
2023-06 We will provide a tutorial on Editing Large Language Models at AACL 2023.
2023-05 We release a new analysis paper:"Editing Large Language Models: Problems, Methods, and Opportunities" based on this repository! We are looking forward to any comments or discussions on this topic :)
2022-12 We create this repository to maintain a paper list on Knowledge Editing.

🔍 Contents

🌟 Why Knowledge Editing?
Keywords
Comparisons of the different technologies
📜 Papers
🧰 Resources
- Benchmarks and Tasks
- Tools
🎉 Contribution
🚩Citation

🌟 Why Knowledge Editing?

Knowledge Editing is a compelling field of research that focuses on facilitating efficient modifications to the behavior of models, particularly foundation models. The aim is to implement these changes within a specified scope of interest without negatively affecting the model's performance across a broader range of inputs.

Keywords

Knowledge Editing has strong connections with following topics.

Updating and fixing bugs for large language models
Language models as knowledge base, locating knowledge in large language models
Lifelong learning, unlearning and etc.
Security and privacy for large language models

Comparisons of different technologies

📜 Resources

This is a collection of research and review papers of Knowledge Editing. Any suggestions and pull requests are welcome for better sharing of latest research progress.

Tutorials

Knowledge Editing for Large Language Models, AAAI 2024 Tutorial <br /> Ningyu Zhang, Jia-Chen Gu, Yunzhi Yao, Zhen Bi, Shumin Deng. [Github] [Google Drive] [Baidu Pan]

Editing Large Language Models, AACL 2023 Tutorial <br /> Ningyu Zhang, Yunzhi Yao, Shumin Deng. [Github] [Google Drive] [Baidu Pan]

Surveys

Knowledge Mechanisms in Large Language Models: A Survey and Perspective (EMNLP 2024 Findings) <br /> Mengru Wang, Yunzhi Yao, Ziwen Xu, Shuofei Qiao, Shumin Deng, Peng Wang, Xiang Chen, Jia-Chen Gu, Yong Jiang, Pengjun Xie, Fei Huang, Huajun Chen, Ningyu Zhang. [paper]

A Comprehensive Study of Knowledge Editing for Large Language Models <br /> Ningyu Zhang, Yunzhi Yao, Bozhong Tian, Peng Wang, Shumin Deng, Mengru Wang, Zekun Xi, Shengyu Mao, Jintian Zhang, Yuansheng Ni, Siyuan Cheng, Ziwen Xu, Xin Xu, Jia-Chen Gu, Yong Jiang, Pengjun Xie, Fei Huang, Lei Liang, Zhiqiang Zhang, Xiaowei Zhu, Jun Zhou, Huajun Chen. [paper][benchmark][code]

Editing Large Language Models: Problems, Methods, and Opportunities, EMNLP 2023 Main Conference Paper <br /> Yunzhi Yao, Peng Wang, Bozhong Tian, Siyuan Cheng, Zhoubo Li, Shumin Deng, Huajun Chen, Ningyu Zhang. [paper][code]

Knowledge Editing for Large Language Models: A Survey <br /> Song Wang, Yaochen Zhu, Haochen Liu, Zaiyi Zheng, Chen Chen, Jundong Li. [paper]

A Survey on Knowledge Editing of Neural Networks <br /> Vittorio Mazzia, Alessandro Pedrani, Andrea Caciolai, Kay Rottmann, Davide Bernardi. [paper]

Knowledge Unlearning for LLMs: Tasks, Methods, and Challenges <br /> Nianwen Si, Hao Zhang, Heyu Chang, Wenlin Zhang, Dan Qu, Weiqiang Zhang. [paper]

Methods

Preserve Parameters

Memory-based

Memory-Based Model Editing at Scale (ICML 2022) <br /> Eric

KnowledgeEditingPapers

Install / Use

README