Agentless  by OpenAutoCoder

Agentless approach to automatically solve software development problems

created 1 year ago
1,844 stars

Top 24.0% on sourcepulse

GitHubView on GitHub
1 Expert Loves This Project
Project Summary

Agentless provides an agentless approach to automatically solve software development problems, targeting researchers and developers working with automated program repair. It aims to improve efficiency and reduce costs in bug fixing by leveraging large language models without requiring complex agent architectures.

How It Works

Agentless employs a three-phase process: localization, repair, and patch validation. It first localizes faults hierarchically to specific files, classes, functions, and edit locations. Then, it samples multiple candidate patches in diff format for each bug. Finally, it selects regression tests, generates reproduction tests, and re-ranks patches based on test results to submit a final fix. This approach simplifies LLM integration for software engineering tasks.

Quick Start & Requirements

  • Install: Clone the repository, create and activate a Conda environment (conda create -n agentless python=3.11, conda activate agentless), install requirements (pip install -r requirements.txt), and set PYTHONPATH.
  • Prerequisites: Python 3.11, Conda, OpenAI API key.
  • Setup: Requires exporting OPENAI_API_KEY. Full SWE-bench lite reproduction details are in a separate README.

Highlighted Details

  • Achieved 40.7% and 50.8% solve rates on SWE-bench lite with Claude 3.5 Sonnet.
  • Claims 82 fixes (27.3%) on SWE-bench lite at an average cost of $0.34 per issue.
  • Offers pre-processed artifacts for SWE-bench lite and verified datasets.

Maintenance & Community

  • Latest release is v1.5.0.
  • Includes citation information for academic use.
  • Mentions integration with Claude 3.5 Sonnet.

Licensing & Compatibility

  • The README does not explicitly state a license.

Limitations & Caveats

  • Requires an OpenAI API key, implying costs and potential vendor lock-in.
  • The specific LLM used (Claude 3.5 Sonnet) is not a default dependency and needs separate access.
Health Check
Last commit

7 months ago

Responsiveness

Inactive

Pull Requests (30d)
1
Issues (30d)
0
Star History
200 stars in the last 90 days

Explore Similar Projects

Feedback? Help us improve.