Skip to content

Add standalone LLM provider and client configuration docs#208

Draft
artberger wants to merge 2 commits intomainfrom
docs/standalone-llm-providers-clients
Draft

Add standalone LLM provider and client configuration docs#208
artberger wants to merge 2 commits intomainfrom
docs/standalone-llm-providers-clients

Conversation

@artberger
Copy link
Collaborator

This commit enhances the standalone agentgateway documentation by adding comprehensive LLM provider setup guides and client configuration instructions.

Provider Documentation

New Provider Pages

  • Add dedicated Ollama provider page with installation, configuration, and production deployment guidance
  • Expand openai-compatible.md with 7 additional providers:
    • DeepSeek (reasoning and chat models)
    • Mistral La Plateforme
    • Perplexity (online search models)
    • Fireworks AI
    • vLLM (self-hosted inference engine)
    • LM Studio (local desktop deployment)

Enhanced Provider Navigation

  • Reorganize llm/about.md with categorized provider sections:
    • Native providers (OpenAI, Anthropic, Gemini, Vertex, Bedrock, Azure)
    • OpenAI-compatible providers (xAI, Cohere, Together AI, Groq, etc.)
    • Self-hosted solutions (Ollama, vLLM, LM Studio)
  • Update llm/providers/_index.md with categorized card layout

LLM Client Configuration Guides

Add comprehensive guides for configuring AI coding tools and SDKs to use agentgateway as their LLM backend:

  • Cursor: Settings UI and JSON configuration methods
  • VS Code Continue: Config file setup, multi-model support
  • OpenAI SDK: Python and Node.js implementation examples
  • curl: Command-line testing and debugging examples

Each guide includes:

  • Prerequisites and installation steps
  • Configuration options (UI, file, environment variables)
  • Example agentgateway YAML configurations
  • Verification steps
  • Troubleshooting section

Technical Details

  • All content created in assets/agw-docs/pages/ for reusability
  • Content shared between standalone/latest and standalone/main using Hugo reuse shortcode
  • All YAML configurations validated with agentgateway CLI
  • Fixed product name capitalization (Agent Gateway → agentgateway)
  • Hugo build passes with no errors
  • Spelling and syntax validated

Files Changed

  • 26 files total (6 assets, 20 content files)
  • 8 modified files (provider navigation and index pages)
  • 18 new files (Ollama provider, LLM client guides)

Addresses issues:

  • solo-io/docs#1944 (supported LLM providers page)
  • solo-io/docs#1919 (LLM client configuration guides)
  • Add Ollama to LLM providers doc #31 (Ollama provider docs)
  • solo-io/agentgateway-enterprise#76 (self-hosted examples)

🤖 Generated with Claude Code

This commit enhances the standalone agentgateway documentation by
adding comprehensive LLM provider setup guides and client configuration
instructions.

## Provider Documentation

### New Provider Pages
- Add dedicated Ollama provider page with installation, configuration,
  and production deployment guidance
- Expand openai-compatible.md with 7 additional providers:
  - DeepSeek (reasoning and chat models)
  - Mistral La Plateforme
  - Perplexity (online search models)
  - Fireworks AI
  - vLLM (self-hosted inference engine)
  - LM Studio (local desktop deployment)

### Enhanced Provider Navigation
- Reorganize llm/about.md with categorized provider sections:
  - Native providers (OpenAI, Anthropic, Gemini, Vertex, Bedrock, Azure)
  - OpenAI-compatible providers (xAI, Cohere, Together AI, Groq, etc.)
  - Self-hosted solutions (Ollama, vLLM, LM Studio)
- Update llm/providers/_index.md with categorized card layout

## LLM Client Configuration Guides

Add comprehensive guides for configuring AI coding tools and SDKs to
use agentgateway as their LLM backend:

- **Cursor**: Settings UI and JSON configuration methods
- **VS Code Continue**: Config file setup, multi-model support
- **OpenAI SDK**: Python and Node.js implementation examples
- **curl**: Command-line testing and debugging examples

Each guide includes:
- Prerequisites and installation steps
- Configuration options (UI, file, environment variables)
- Example agentgateway YAML configurations
- Verification steps
- Troubleshooting section

## Technical Details

- All content created in assets/agw-docs/pages/ for reusability
- Content shared between standalone/latest and standalone/main using
  Hugo reuse shortcode
- All YAML configurations validated with agentgateway CLI
- Fixed product name capitalization (Agent Gateway → agentgateway)
- Hugo build passes with no errors
- Spelling and syntax validated

## Files Changed
- 26 files total (6 assets, 20 content files)
- 8 modified files (provider navigation and index pages)
- 18 new files (Ollama provider, LLM client guides)

Addresses issues:
- solo-io/docs#1944 (supported LLM providers page)
- solo-io/docs#1919 (LLM client configuration guides)
- #31 (Ollama provider docs)
- solo-io/agentgateway-enterprise#76 (self-hosted examples)

🤖 Generated with [Claude Code](https://claude.com/claude-code)

Co-Authored-By: Claude <noreply@anthropic.com>
@artberger artberger self-assigned this Feb 24, 2026
@artberger artberger added documentation Improvements or additions to documentation agentgateway labels Feb 24, 2026
@cloudflare-workers-and-pages
Copy link

cloudflare-workers-and-pages bot commented Feb 24, 2026

Deploying agentproxy with  Cloudflare Pages  Cloudflare Pages

Latest commit: 641718a
Status: ✅  Deploy successful!
Preview URL: https://61d0ead9.agentproxy.pages.dev
Branch Preview URL: https://docs-standalone-llm-provider.agentproxy.pages.dev

View logs

Fix documentation to comply with STYLE_GUIDE.md:
- Change "Prerequisites" to "Before you begin"
- Add periods to all list items and numbered steps
- Reformat Troubleshooting sections with proper structure:
  - "What's happening" instead of "Problem"
  - "Why it's happening" section added
  - "How to fix it" instead of "Solutions"

Files updated:
- assets/agw-docs/pages/agentgateway/llm/providers/ollama.md
- assets/agw-docs/pages/agentgateway/integrations/llm-clients/*.md

🤖 Generated with [Claude Code](https://claude.com/claude-code)

Co-Authored-By: Claude <noreply@anthropic.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

agentgateway documentation Improvements or additions to documentation

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant