What is distillation?
A technique that trains a new model on another, usually larger model's outputs to transfer some of its capabilities. Done without permission, it becomes a data-theft controversy.
Terms seen alongside this one
- alignment 2× together
- Millennium Prize Problems 1× together
- recursive self-improvement 1× together
- mixture-of-experts 1× together
Get it in your inbox every day
Daily headlines and summaries, a weekly synthesis every Sunday, and a monthly report at the start of each month. Sent at 8AM KST, which is the evening before in the US.
Free · no ads · one-click unsubscribe