Large Language Model API
- Typical providers
- Anthropic (Claude), OpenAI (GPT), Azure OpenAI, AWS Bedrock, Google Vertex, Ollama (self-hosted), vLLM (self-hosted), and others
- Purpose
- Generates LLM completions from masked prompts
- Customer action
- Customer signs DPA or BAA directly with chosen LLM provider. Anthropic, OpenAI, and the major cloud providers all offer BAAs for HIPAA.