A model is too large for the target inference memory budget. Which optimization is reasonable to evaluate, with quality checks?

1. Store the same weights twice in GPU memory.
2. Remove all output validation and call the model smaller.
3. Increase all numerical tensors to a wider precision.
4. Quantization supported by the model and serving hardware.