SWE-Interact - 75 tasks
Code
Interactive software-engineering evaluation reported over 75 test samples in the Ember-1 launch. The source gives the task success rate but does not specify the complete execution harness or a broader corpus denominator.
Top models (higher is better)
| Model | Score |
|---|---|
| Ember-1 | 20.0 |