tokenization
Posts tagged “tokenization”.
-
AI Brief, 14 September 2026: a science model with three extra tokenizers
Shanghai AI Laboratory released Intern-S2-397B under Apache-2.0, and its config file is identical to Qwen3.5-397B-A17B except for 3,072 vocabulary slots that turn out to be protein, molecule and nucleic-acid tokenizers. A byte-level distillation paper's headline win exists only at infinite compute. And DeepSeek reversed the V4-Pro retirement it had scheduled for today.