Products & Apps
Perplexity open-sources Unigram tokenizer to cut CPU usage
Original title:We're open-sourcing the Unigram tokenizer we rebuilt to reduce CPU utilization by 5-6x. Small reran...
AI summary
We have open-sourced a rebuilt Unigram tokenizer that cuts CPU usage by 5-6x. Small rerankers and embedding models run in single-digit milliseconds on GPU, making CPU tokenization a significant part of total latency. http://github.com/perplexityai/pplx-garden
Key Takeaways
We have open-sourced a rebuilt Unigram tokenizer that cuts CPU usage by 5-6x.
Small rerankers and embedding models run in single-digit milliseconds on GPU
making CPU tokenization a significant part of total latency.
Quick Facts
Published
May 27, 2026
Updated
November 6, 2026
AI score
68
Read the original
Read the full article at the original source
Why it matters
Perplexity 开源的这个 tokenizer 能把 CPU 利用率砍掉五六倍,做实时推理的团队值得立马试试,对延迟敏感的场景是实打实的优化。
Source & copyright
This article is based on curated titles and AI summaries from the AIHOT public API, with attribution and links back. Original copyright remains with the original publishers and authors; this site does not mirror full texts.
Original article
· AIHOT entry
How to Cite
When citing this article, keep the title, date, and permalink, and credit Orange News as the source.
Orange News: Perplexity open-sources Unigram tokenizer to cut CPU usage. May 27, 2026. https://new.nat6.net/en/news/cmpo929df03ztslv4z9v93608/
Orange Relay (pro.nat6.net) is a premium AI API relay — an excellent transfer station with competitive pricing, reliable quality and broad model coverage including Claude, GPT and Gemini.
Visit Orange Relay
Runway officially launched the Runway MCP server, allowing any MCP-compatible AI agent (such as Claude, ChatGPT or…
Runway:News(网页) Products & Apps AI score 73
May 27, 2026
Black Forest Labs released FLUX VTO for virtual try-on at catalog scale. It is now publicly available, with a free BFL…
Black Forest Labs:Blog(网页) Products & Apps AI score 61
May 28, 2026
ModelBest, together with Tsinghua University and OpenBMB, released ForgeTrain, the world's first production-grade…
公众号:面壁智能(MiniCPM) Products & Apps AI score 64
May 27, 2026
Google introduced the Google Pay & Wallet Developer MCP server, an open-standard tool designed to securely connect AI…
Google Developers Blog(RSS) Products & Apps AI score 73
May 28, 2026
Claude Code released version v2.1.152. Key improvements include: `/code-review --fix` now applies review suggestions…
Claude Code:GitHub Releases(RSS) Products & Apps AI score 71
May 27, 2026
Claude Code introduced Dynamic Workflows, enabling Claude to handle complex tasks end to end. The feature dynamically…
Claude:Blog(网页) Products & Apps AI score 78
May 28, 2026
Previous article Liquid AI releases on-device MoE model LFM2.5-8B-A1B
Next article Codex supports real-time meeting transcription and Q&A