This website uses cookies to ensure you get the best experience.
Learn more.
An application sends more input than a deployed model's supported context limit. What is the appropriate design response?
Published
- Disable authentication to allow a larger prompt
- Increase sampling randomness to enlarge the context window
- Rename the deployment to remove token limits
- Reduce or select relevant context, or choose a suitable supported model
Comments — 0
Sign in to comment