live evaluation

How should we score live traffic for production drift?

Our CI evals missed a drop in output quality because production inputs shifted beyond what the test set covered. How should we sample and score live responses, and…