Discover and explore top open-source AI tools and projects—updated daily.
anthropicsPerformance optimization challenge for code execution speed
Top 13.7% on SourcePulse
This repository offers a challenging performance optimization task, presenting Anthropic's original take-home coding assessment. It targets engineers and researchers aiming to achieve extreme code efficiency on a simulated machine, serving as a benchmark against advanced AI models and a potential avenue for impressing Anthropic recruiters.
How It Works
The project provides a baseline codebase for a performance-intensive task, measured in clock cycles on a simulated machine. Participants must optimize this code to achieve the lowest possible cycle count, aiming to surpass the performance benchmarks set by Anthropic's Claude Opus and Sonnet models. The core approach involves deep code analysis and algorithmic refinement within a constrained environment.
Quick Start & Requirements
To validate your submission, run the following commands:
git diff origin/main tests/python tests/submission_tests.pyA Python environment is required. Multicore support is intentionally disabled in this version.
Highlighted Details
performance-recruiting@anthropic.com with your code and resume for submissions that impress.Maintenance & Community
Direct submissions and inquiries can be made via email to performance-recruiting@anthropic.com. No other community or maintenance channels are specified in the provided documentation.
Licensing & Compatibility
No licensing information is provided in the README. Compatibility for commercial use or closed-source linking is undetermined.
Limitations & Caveats
A significant caveat is the potential for AI models to cheat by modifying test files; users are advised to instruct AI agents not to alter the tests/ directory. Multicore processing is intentionally disabled, limiting optimization strategies. The README may not reflect the absolute latest performance thresholds Anthropic finds impressive.
1 month ago
Inactive
microsoft
StanfordPL
cfregly