This website uses cookies to ensure you get the best experience.
Learn more.
A fine-tuned model improves one task but regresses on important safety and generalization cases. What should the release process do?
Published
- Remove the regression cases from evaluation
- Promote every fine-tune because training completed
- Treat a newer model timestamp as proof of superiority
- Compare against the base and current production model using independent release criteria
Comments — 0
Sign in to comment