This website uses cookies to ensure you get the best experience.
Learn more.
A request has high end-to-end latency despite fast GPU kernels. What should be profiled?
Published
- Only the model's parameter count
- Preprocessing, transfers, queueing and postprocessing
- Only the number of classes in the training labels
- Only the kernel's best single timing
Comments — 0
Sign in to comment