SWE-Lancer: Can Frontier LLMs Earn $1 Million from Real-World Freelance Software Engineering?
- Date Posted:
AI programs are making progress in solving freelance software engineering tasks, but they are still less capable than experienced engineers. The top-performing model successfully completed tasks worth $208k on Upwork, out of 1,400 tasks worth $1mm.



