KnowledgizeMetal

DeepSeek R1 Distill Llama 3.3 70B

DeepSeek R1 Distill Llama 3.3 70B is a reasoning-oriented text language model from DeepSeek-AI. It is not the full DeepSeek-R1 model and not an architecture invented wholly by DeepSeek: the published checkpoint fine-tunes Meta’s Llama 3.3 70B Instruct model using samples generated by DeepSeek-R1. Distillation transfers useful behavior from a stronger teacher’s outputs into a student model. TT-Metal lists this checkpoint at TP=8 on a Wormhole QuietBox with batch 32. TP=8 means tensor-parallel work is divided across eight chips. QuietBox is a multi-chip system, but that matrix entry does not inherently mean a multi-host deployment; chip count and host count are different concerns.