long-context
Posts tagged “long-context”.
-
AI Brief, 20 October 2026: two counts of the same stealth run
MiniMax revealed on 19 October that the anonymous Space Bunny was an early M3.1 Flash, and says it processed more than 200 trillion tokens. OpenRouter, which hosted the run, puts it at 56.7 trillion. The weights are not out. And MemTensor published a model whose conversation state stays the same size no matter how long the conversation gets.
-
AI Brief, 18 October 2026: a cheaper model at four times the output price
DeepSeek published V4.1-Flash-1017 on 17 October under MIT. Two hundred and three of its 510 GB are n-gram hash tables rather than transformer weights, and only four of forty layers keep a cache that grows, which puts a million-token KV cache at 1.3 GB. The card promises lower cost per task; the serving price per output token is 4.2 times the model it replaces. And OpenCode users spent the day rotating provider keys.
-
AI Brief, 15 October 2026: an order of magnitude, and the race condition review found
Linus Torvalds's first LLM-assisted patch series claims roughly a tenfold speedup on the kernel's page-cache read path, and review found a race condition, so it is not merged. The community decision-model board regenerated overnight and gave the vLLM router's self-claimed first place an independent number. And a Tsinghua group reports 96.7% on RULER at 32 times KV-cache compression with the model weights frozen.
-
AI Brief, 4 October 2026: a million tokens, by taking the positions out
Aleph Alpha released Kolibri on 3 October under Apache 2.0: 78B total parameters, 3.46B active, German and English only, and 40 of its 50 attention layers see just 513 tokens. The ten that see everything carry no positional encoding at all, which is how it extends to a million tokens with no position scaling. Its own RULER table shows the price.