Model Releases

Mistral releases Mamba-architecture code model Codestral Mamba

Original title:Research Codestral Mamba July 16, 2024 By Mistral team

AI summary

Mistral released Codestral Mamba, a Mamba-architecture code model that uses linear-time inference and can be used, modified, and distributed for free. The model has advanced code and reasoning capabilities, with performance comparable to SOTA Transformer models; it has been tested for context retrieval up to 256k tokens and has 7,285,403,648 parameters.

Key Takeaways

  • Mistral released Codestral Mamba,a Mamba-architecture code model that uses linear-time inference…
  • The model has advanced code and reasoning capabilities,with performance comparable to SOTA…
  • it has been tested for context retrieval up to 256k tokens and has 7,285,403,648 parameters.

Quick Facts

Published
Updated
Source
Mistral AI:News(网页)
Category
Model Releases
AI score
62
Read the original Read the full article at the original source
Why it matters

官方说明了 Mamba 架构在线性推理时长和长序列上的优势,以及 256k 测试、部署渠道和许可证差异,可据此判断适用场景。

Related entities

Source & copyright

This article is based on curated titles and AI summaries from the AIHOT public API, with attribution and links back. Original copyright remains with the original publishers and authors; this site does not mirror full texts.

Original article · AIHOT entry

How to Cite

When citing this article, keep the title, date, and permalink, and credit Orange News as the source.

Orange News: Mistral releases Mamba-architecture code model Codestral Mamba. July 16, 2024. https://new.nat6.net/en/news/cmppdcr7e0e4gslv4i5xwqv8j/

View all →