A team deploys an LLM endpoint used by untrusted clients. Where should the service credential for an internal retrieval API live?

Published
  1. In the system prompt returned to users for debugging.
  2. In a protected server-side secret store, accessed only by authorized backend code.
  3. In a public model card as plain text.
  4. Inside the public JavaScript bundle.

Comments — 0