AwesomeLLM4SE

<h1 align = "center">Large Language Models for Software Engineering</h1> <p align="center"> <a href="https://arxiv.org/abs/2312.15223"><img src="https://img.shields.io/badge/arXiv-2312.15223-blue.svg"></a> <img src="https://img.shields.io/github/stars/iSEngLab/AwesomeLLM4SE?color=yellow&label=Stars"> </p>

Title: A Survey on Large Language Models for Software Engineering

Authors: Quanjun Zhang, Chunrong Fang, Yang Xie, Yaxin Zhang, Yun Yang, Weisong Sun, Shengcheng Yu, Zhenyu Chen

A collection of academic publications and methodologies on the classification of Code Large Language Models' pre-training tasks, downstream tasks, and the application of Large Language Models in the field of Software Engineering (LLM4SE).

We welcome all researchers to contribute to this repository and further contribute to the knowledge of the Large Language Models with Software Engineering field. Please feel free to contact us if you have any related references by Github issue or pull request.

👏 Citation

@article{zhang2023survey,
  title={A Survey on Large Language Models for Software Engineering},
  author={Zhang, Quanjun and Fang, Chunrong and Xie, Yang and Zhang, Yaxin and Yang, Yun and Sun, Weisong and Yu, Shengcheng and Chen, Zhenyu},
  journal={arXiv preprint arXiv:2312.15223},
  year={2023}
}

🔥🔥 New Papers

1. 🔥PyGen: A Collaborative Human-AI Approach to Python Package Creation ——Package Creation [2024-arXiv]
2. 🔥Code-mixed LLM: Improve Large Language Models' Capability to Handle Code-Mixing through Reinforcement Learning from AI Feedback [2024-arXiv]
3. 🔥Fuzzing Robotic Software Using HPC [2024-arXiv]
4. 🔥InfiBench: Evaluating the Question-Answering Capabilities of Code Large Language Models [2024-NeurIPS]
5. 🔥Transforming the field of Vulnerability Prediction: Are Large Language Models the key?
6. 🔥IaC-Eval: A Code Generation Benchmark for Cloud Infrastructure-as-Code Programs [2024-NeurIPS]
7. 🔥A Comprehensive Survey of AI-Driven Advancements and Techniques in Automated Program Repair and Code Generation [2024-arXiv]
8. 🔥Towards the Integration of Large Language Models and Automatic Assessment Tools: Enhancing Student Support in Programming Assignments [2024-Koli Calling]
9. 🔥Semantic Error Detection in Code Translation Using Knowledge-Driven Static Analysis with AI Chain
10. 🔥RUG: Turbo LLM for Rust Unit Test Generation
11. 🔥ROCODE: Integrating Backtracking Mechanism and Program Analysis in Large Language Models for Code Generation [2024-arXiv]
12. 🔥Automatically Write Code Checker: An LLM-based Approach with Logic-guided API Retrieval and Case by Case Iteration[2024-arXiv]
13. 🔥LeDex: Training LLMs to Better Self-Debug and Explain Code [2024-NeurIPS]
14. 🔥EffiLearner: Enhancing Efficiency of Generated Code via Self-Optimization [2024-NeurIPS]
15. 🔥SWT-Bench: Testing and Validating Real-World Bug-Fixes with Code Agents [2024-NeurIPS]
16. 🔥ACES: Generating a Diversity of Challenging Programming Puzzles with Autotelic Generative Models [2024-NeurIPS]
17. 🔥LProtector: An LLM-driven Vulnerability Detection System [2024-arXiv]
18. 🔥An Empirical Study on the Potential of LLMs in Automated Software Refactoring [2024-arXiv]
19. 🔥DSLXpert: LLM-driven Generic DSL Code Generation [2024-arXiv]
20. 🔥ProConSuL: Project Context for Code Summarization with LLMsAssessing the Answerability of Queries in Retrieval-Augmented Code Generation[2024-arXiv]
21. 🔥Smart-LLaMA: Two-Stage Post-Training of Large Language Models for Smart Contract Vulnerability Detection and Explanation [2024-arXiv]
22. 🔥Escalating LLM-based Code Translation Benchmarking into the Class-level Era [2024-arXiv]
23. 🔥CodeLutra: Boosting LLM Code Generation via Preference-Guided Refinement [2024-arXiv]
24. 🔥CoCoP: Enhancing Text Classification with LLM through Code Completion Prompt [2024-arXiv]
25. 🔥ProConSuL: Project Context for Code Summarization with LLMs [2024-arXiv]
26. 🔥CodeTree: Agent-guided Tree Search for Code Generation with Large Language Models [2024-arXiv]
27. 🔥CORE: Resolving Code Quality Issues using LLMs [2024-FSE]
28. 🔥A deep dive into large language models for automated bug localization and repair [2024-FSE]
29. 🔥Prompt Fix: Vulnerability Automatic Repair Technology Based on Prompt Engineering [2024-ICNC]
30. 🔥Evaluating Large Language Models for Real-World Vulnerability Repair in C/C++ Code[2024-IWSPA]
31. 🔥Investigating large language models capabilities for automatic code repair in Python[2024-Cluster Computing]
32. 🔥LPR: Large Language Models-Aided Program Reduction[2024-ISSTA]
33. 🔥A Case Study of LLM for Automated Vulnerability Repair: Assessing Impact of Reasoning and Patch Validation Feedback (2024年7月) AIware 2024
34. 🔥When Large Language Models Confront Repository-Level Automatic Program Repair: How Well They Done? [2024-ICSE]
35. 🔥Automated Validation of COBOL to Java Transformation[2024-ASE]
36. 🔥LLM4Workflow: An LLM-based Automated Workflow Model Generation Tool[2024-ASE]
37. 🔥LLM-Based Java Concurrent Program to ArkTS Converter[2024-ASE]
38. 🔥PACGBI: A Pipeline for Automated Code Generation from Backlog Items[2024-ASE]
39. 🔥Attacks and Defenses for Large Language Models on Coding Tasks[2024-ASE]
40. 🔥Unity Is Strength: Collaborative LLM-Based Agents for Code Reviewer Recommendation[2024-ASE]
41. 🔥Bridging Gaps in LLM Code Translation: Reducing Errors with Call Graphs and Bridged Debuggers[2024-ASE]
42. 🔥Using LLM for Mining and Testing Constraints in API Testing[2024-ASE]
43. 🔥AdvSCanner: Generating Adversarial Smart Contracts to Exploit Reentrancy Vulnerabilities Using LLM and Static Analysis[2024-ASE]
44. 🔥iSMELL: Assembling LLMs with Expert Toolsets for Code Smell Detection and Refactoring[2024-ASE]
45. 🔥Effective Vulnerable Function Identification based on CVE Description Empowered by Large Language Models[2024-ASE]
46. 🔥WaDec: Decompiling WebAssembly Using Large Language Model[2024-ASE]
47. 🔥Exploring Parameter-Efficient Fine-Tuning of Large Language Model on Automated Program Repair[2024-ASE]
48. 🔥Understanding Code Changes Practically with Small-Scale Language Models[2024-ASE]
49. 🔥Leveraging Large Language Model to Assist Detecting Rust Code Comment Inconsistency[2024-ASE]
50. 🔥Semantic Sleuth: Identifying Ponzi Contracts via Large Language Models[2024-ASE]
51. 🔥Test-Driven Development and LLM-based Code Generation[2024-ASE]
52. 🔥Enhancing Software Design and Developer Experience Via LLMs[2024-ASE]
53. 🔥Test smells in LLM-Generated Unit Tests [2024-arXiv]
54. 🔥Effi-Code: Unleashing Code Efficiency in Language Models[2024-arXiv]
55. 🔥Agent-as-a-Judge: Evaluate Agents with Agents[2024-arXiv]
56. 🔥Unraveling the Potential of Large Language Models in Code Translation: How Far Are We?[2024-arXiv]
57. 🔥Generalized Adversarial Code-Suggestions: Exploiting Contexts of LLM-based Code-Completion[2024-arXiv]
58. 🔥A Model Is Not Built By A Single Prompt: LLM-Based Domain Modeling With Question Decomposition[2024-arXiv]
59. 🔥Test smells in LLM-Generated Unit Tests[2024-arXiv]
60. 🔥Advancing Bug Detection in Fastjson2 with Large Language Models Driven Unit Test Generation[2024-arXiv]
61. 🔥Large Language Models for Energy-Efficient Code: Emerging Results and Future Directions[2024-arXiv]
62. 🔥Impeding LLM-assisted Cheating in Introductory Programming Assignments via Adversarial Perturbation[2024-arXiv]
63. 🔥Towards Trustworthy LLMs for Code: A Data-Centric Synergistic Auditing Framework[2024-arXiv]
64. 🔥COrAL: Order-Agnostic Language Modeling for Efficient Iterative Refinement[2024-arXiv]
65. 🔥Decoding Secret Memorization in Code LLMs Through Token-Level Characterization[2024-arXiv]
66. 🔥Don't Transform the Code, Code the Transforms: Towards Precise Code Rewriting using LLMs[2024-arXiv]
67. 🔥Test-driven Software Experimentation with LASSO: an LLM Benchmarking Example[2024-arXiv]
68. 🔥PEAR: A Robust and Flexible Automation Framework for Ptychography Enabled by Multiple Large Language Model Agents[2024-arXiv]
69. 🔥AutoComply: Automating Requirement Compliance in Automotive Integration Testing[2024-CSE]
70. 🔥TableAnalyst: an LLM-agent for tabular data analysis-Implementation and evaluation on tasks of varying complexity[2024-CSE]
71. 🔥Using Learning from Answer Sets for Robust Question Answering with LLM[2024-LPNMR]
72. 🔥Mitigating Gender Bias in Code Large Language Models via Model Editing[2024-arXiv]
73. 🔥RealVul: Can We Detect Vulnerabilities in Web Applications with LLM?[2024-arXiv]
74. 🔥VerMCTS: Synthesizing Multi-Step Programs using a Verifier, a Large Language Model, and Tree Search[MATH-AI]
75. 🔥Exploring and Lifting the Robustness of LLM-powered Automated Program Repair with Metamorphic Testing[2024-arXiv]
76. 🔥REDO: Execution-Free Runtime Error Detection for COding Agents[2024-arXiv]
77. 🔥Checker Bug Detection and Repair in Deep Learning Libraries[2024-arXiv]
78. 🔥Automating and Validating Agent and Environment Code Generation with Large Language Models[2024-NeurIPS]
79. 🔥Seeker: Enhancing Exception Handling in Code with LLM-based Multi-Agent Approach[2025-ICLR]
80. 🔥Assessing Code Clone Detection Capabilities of Large Language Models on Human and Ai-Generated Code: Zero-Shot and Fine-Tuning Approaches
81. 🔥Codepori: Large-Scale System for Autonomous Software Development Using Multi-Agent Tec