Tutorials & Tips

Together AI benchmarks DeepSWE: cost and coding performance of DeepSeek-V4 Flash 0731 vs GPT-5.6 Luna

Original title:DeepSeek-V4 Flash 0731 vs GPT-5.6 Luna on DeepSWE: Cost and Coding

AI summary

Together AI compared DeepSeek-V4 Flash 0731 and GPT-5.6 Luna on 113 DeepSWE tasks: Luna scored 67.2% pass@1 versus 53.3% for DeepSeek, but DeepSeek cost about $0.10 per rollout, roughly one-sixth of Luna's $0.61.

Key Takeaways

  • Together AI compared DeepSeek-V4 Flash 0731 and GPT-5.
  • 6 Luna on 113 DeepSWE tasks: Luna scored 67.
  • 2% pass@1 versus 53.
  • 3% for DeepSeek,but DeepSeek cost about $0.
  • 10 per rollout,roughly one-sixth of Luna's $0.

Quick Facts

Published
Updated
Source
Together AI 研究与产品博客(RSS)
Category
Tutorials & Tips
AI score
80
Read the original Read the full article at the original source
Why it matters

原文基于同一轮 900 次 rollout 实测给出两款模型的成本、失败模式与分域表现,并提出可复用的低成本级联方案。

Related entities

Source & copyright

This article is based on curated titles and AI summaries from the AIHOT public API, with attribution and links back. Original copyright remains with the original publishers and authors; this site does not mirror full texts.

Original article · AIHOT entry

How to Cite

When citing this article, keep the title, date, and permalink, and credit Orange News as the source.

Orange News: Together AI benchmarks DeepSWE: cost and coding performance of DeepSeek-V4 Flash 0731 vs GPT-5.6 Luna. August 6, 2026. https://new.nat6.net/en/news/cmtym21vv000cro2b2jmv8y42/

View all →