A nightly workload evaluates thousands of independent documents and does not require immediate responses. Which inference mode should be evaluated for supported models?

1. Run every document synchronously inside a browser request.
2. Batch inference with prepared inputs, output reconciliation, and item-level error handling.
3. Assume prompt caching is available in every batch API configuration.
4. One interactive streaming connection kept open for the entire night without checkpoints.