Mistral releases Mamba-architecture code model Codestral Mamba
Original title:Research Codestral Mamba July 16, 2024 By Mistral team
AI summary
Mistral released Codestral Mamba, a Mamba-architecture code model that uses linear-time inference and can be used, modified, and distributed for free. The model has advanced code and reasoning capabilities, with performance comparable to SOTA Transformer models; it has been tested for context retrieval up to 256k tokens and has 7,285,403,648 parameters.
Key Takeaways
- Mistral released Codestral Mamba,a Mamba-architecture code model that uses linear-time inference…
- The model has advanced code and reasoning capabilities,with performance comparable to SOTA…
- it has been tested for context retrieval up to 256k tokens and has 7,285,403,648 parameters.
Quick Facts
- Published
- Updated
- Source
- Mistral AI:News(网页)
- Category
- Model Releases
- AI score
- 62
官方说明了 Mamba 架构在线性推理时长和长序列上的优势,以及 256k 测试、部署渠道和许可证差异,可据此判断适用场景。
Related entities
Source & copyright
This article is based on curated titles and AI summaries from the AIHOT public API, with attribution and links back. Original copyright remains with the original publishers and authors; this site does not mirror full texts.
How to Cite
When citing this article, keep the title, date, and permalink, and credit Orange News as the source.
Orange News: Mistral releases Mamba-architecture code model Codestral Mamba. July 16, 2024. https://new.nat6.net/en/news/cmppdcr7e0e4gslv4i5xwqv8j/