Together AI benchmarks DeepSWE: cost and coding performance of DeepSeek-V4 Flash 0731 vs GPT-5.6 Luna
Original title:DeepSeek-V4 Flash 0731 vs GPT-5.6 Luna on DeepSWE: Cost and Coding
AI summary
Together AI compared DeepSeek-V4 Flash 0731 and GPT-5.6 Luna on 113 DeepSWE tasks: Luna scored 67.2% pass@1 versus 53.3% for DeepSeek, but DeepSeek cost about $0.10 per rollout, roughly one-sixth of Luna's $0.61.
Key Takeaways
- Together AI compared DeepSeek-V4 Flash 0731 and GPT-5.
- 6 Luna on 113 DeepSWE tasks: Luna scored 67.
- 2% pass@1 versus 53.
- 3% for DeepSeek,but DeepSeek cost about $0.
- 10 per rollout,roughly one-sixth of Luna's $0.
Quick Facts
- Published
- Updated
- Source
- Together AI 研究与产品博客(RSS)
- Category
- Tutorials & Tips
- AI score
- 80
原文基于同一轮 900 次 rollout 实测给出两款模型的成本、失败模式与分域表现,并提出可复用的低成本级联方案。
Related entities
Source & copyright
This article is based on curated titles and AI summaries from the AIHOT public API, with attribution and links back. Original copyright remains with the original publishers and authors; this site does not mirror full texts.
How to Cite
When citing this article, keep the title, date, and permalink, and credit Orange News as the source.
Orange News: Together AI benchmarks DeepSWE: cost and coding performance of DeepSeek-V4 Flash 0731 vs GPT-5.6 Luna. August 6, 2026. https://new.nat6.net/en/news/cmtym21vv000cro2b2jmv8y42/