Resources on ChatGPT and Large Language Models

Collection of papers and related works for Large Language Models (ChatGPT, GPT-3, Codex etc.).

Contributors

This repository is contributed by the following contributors.

• Organizers: Guilin Qi (漆桂林), Xiaofang Qi (戚晓芳)
• Paper Collectors: Zafar Ali, Sheng Bi (毕胜), Yongrui Chen (陈永锐), Zizhuo Chen (陈孜卓), Xinbang Dai (戴鑫邦), Huan Gao (高桓), Nan Hu (胡楠), Shilong Hu (胡世龙), Jingqi Kang (康婧淇), Jiaqi Li (李嘉琦), Dehai Min (闵德海), Guilin Qi (漆桂林), Yiming Tan (谭亦鸣), Tongtong Wu (吴桐桐), Songlin Zhai (翟松林), Shenyu Zhang (张沈昱), Yuxin Zhang (张裕欣)
• Maintainers: Runzhe Wang (王润哲), Shenyu Zhang (张沈昱)

The automation script of this repo is powered by Auto-Bibfile. If you'd like to commit to this repo, please modify bibtex.bib or related_works.json and re-generate README.md using python scripts/run.py.

Papers

Outline

• <img src=https://img.shields.io/badge/Evaluation-31-blue style="zoom:100%; vertical-align: middle">
• <img src=https://img.shields.io/badge/Survey-48-blue style="zoom:100%; vertical-align: middle">
• <img src=https://img.shields.io/badge/In--Context_Learning-44-blue style="zoom:100%; vertical-align: middle">
• <img src=https://img.shields.io/badge/Instruction_Tuning-18-blue style="zoom:100%; vertical-align: middle">
• <img src=https://img.shields.io/badge/RLHF-20-blue style="zoom:100%; vertical-align: middle">
• <img src=https://img.shields.io/badge/Pre--Training_Techniques-19-blue style="zoom:100%; vertical-align: middle">
  • <img src=https://img.shields.io/badge/Mixtures_of_Experts-4-deepskyblue style="zoom:100%; vertical-align: middle">
• <img src=https://img.shields.io/badge/Knowledge_Enhanced-23-blue style="zoom:100%; vertical-align: middle">
• <img src=https://img.shields.io/badge/Knowledge_Distillation-24-blue style="zoom:100%; vertical-align: middle">
• <img src=https://img.shields.io/badge/Knowledge_Generation-11-blue style="zoom:100%; vertical-align: middle">
• <img src=https://img.shields.io/badge/Knowledge_Editing-16-blue style="zoom:100%; vertical-align: middle">
• <img src=https://img.shields.io/badge/Reasoning-165-blue style="zoom:100%; vertical-align: middle">
  • <img src=https://img.shields.io/badge/Chain_of_Thought-72-deepskyblue style="zoom:100%; vertical-align: middle">
  • <img src=https://img.shields.io/badge/Multi--Step_Reasoning-6-deepskyblue style="zoom:100%; vertical-align: middle">
  • <img src=https://img.shields.io/badge/Arithmetic_Reasoning-5-deepskyblue style="zoom:100%; vertical-align: middle">
  • <img src=https://img.shields.io/badge/Symbolic_Reasoning-23-deepskyblue style="zoom:100%; vertical-align: middle">
  • <img src=https://img.shields.io/badge/Chain_of_Verification-1-deepskyblue style="zoom:100%; vertical-align: middle">
  • <img src=https://img.shields.io/badge/Knowledge_Graph_Embedding-5-deepskyblue style="zoom:100%; vertical-align: middle">
  • <img src=https://img.shields.io/badge/Slow_Thinking-7-deepskyblue style="zoom:100%; vertical-align: middle">
• <img src=https://img.shields.io/badge/Federated_Learning-14-blue style="zoom:100%; vertical-align: middle">
• <img src=https://img.shields.io/badge/Distributed_AI-9-blue style="zoom:100%; vertical-align: middle">
• <img src=https://img.shields.io/badge/Selective_Annotation-2-blue style="zoom:100%; vertical-align: middle">
• <img src=https://img.shields.io/badge/Program_and_Code_Generation-45-blue style="zoom:100%; vertical-align: middle">
  • <img src=https://img.shields.io/badge/Code_Representation-5-deepskyblue style="zoom:100%; vertical-align: middle">
  • <img src=https://img.shields.io/badge/Code_Fixing-8-deepskyblue style="zoom:100%; vertical-align: middle">
  • <img src=https://img.shields.io/badge/Code_Review-5-deepskyblue style="zoom:100%; vertical-align: middle">
  • <img src=https://img.shields.io/badge/Program_Generation-3-deepskyblue style="zoom:100%; vertical-align: middle">
• <img src=https://img.shields.io/badge/Software_Engineering-5-blue style="zoom:100%; vertical-align: middle">
• <img src=https://img.shields.io/badge/AIGC-78-blue style="zoom:100%; vertical-align: middle">
  • <img src=https://img.shields.io/badge/Controllable_Text_Generation-9-deepskyblue style="zoom:100%; vertical-align: middle">
• <img src=https://img.shields.io/badge/Continual_Learning-46-blue style="zoom:100%; vertical-align: middle">
• <img src=https://img.shields.io/badge/Prompt_Engineering-35-blue style="zoom:100%; vertical-align: middle">
• <img src=https://img.shields.io/badge/Natural_Language_Understanding-8-blue style="zoom:100%; vertical-align: middle">
• <img src=https://img.shields.io/badge/Multimodal-26-blue style="zoom:100%; vertical-align: middle">
• <img src=https://img.shields.io/badge/Multilingual-1-blue style="zoom:100%; vertical-align: middle">
• <img src=https://img.shields.io/badge/Reliability-5-blue style="zoom:100%; vertical-align: middle">
• <img src=https://img.shields.io/badge/Robustness-2-blue style="zoom:100%; vertical-align: middle">
• <img src=https://img.shields.io/badge/Dialogue_System-16-blue style="zoom:100%; vertical-align: middle">
• <img src=https://img.shields.io/badge/Recommender_System-10-blue style="zoom:100%; vertical-align: middle">
• <img src=https://img.shields.io/badge/Event_Extraction-6-blue style="zoom:100%; vertical-align: middle">
• <img src=https://img.shields.io/badge/Event_Relation_Extraction-7-blue style="zoom:100%; vertical-align: middle">
• <img src=https://img.shields.io/badge/Data_Argumentation-4-blue style="zoom:100%; vertical-align: middle">
• <img src=https://img.shields.io/badge/Data_Annotation-2-blue style="zoom:100%; vertical-align: middle">
• [<img src=https://img.shields.io/badge/Information_Extraction-61-blue style