These are some one-liners that I want to expand into ~600-word focus posts to link to from other posts (or just find a good canonical reference that makes the point).
eval data is what you eval on...
there's always a model in prod...
scaling laws for evals...
pretraining detente and clearer public/private split
centrist take on distillation
we should freak out about Terms of Service from organizations trying to build "AGI"