How does Draft Model work?

The draft model must be from the same model family as the target (same tokenizer, similar architecture) so that the proposed tokens are evaluable by the target. Typical draft-target pairings include Llama 3.1 8B with Llama 3.1 70B, and Llama 3.2 1B with Llama 3.2 8B. The platform strengthens enterp