Repository navigation
docs(llms): add wally provider example - #8785
adityabatra072 wants to merge 1 commit into
Conversation
Preview approval requiredThis pull request comes from a fork, so Mintlify won't build a preview until someone with write access approves commit |
Strix Security ReviewWarning This pull request has 9 commits after the last Strix review ( ✅ No open security findings. PR summary: Adds a Wally provider example to the LLM provider accordion in the English, Arabic, Korean and Brazilian Portuguese editions of `concepts/llms.mdx`, showing how to reach Wally's OpenAI-compatible endpoint through the native OpenAI client with a custom `base_url` and an API key read from an environment variable. Review summaryThis PR is documentation-only: it adds a Wally provider example as a Mintlify accordion to Review 1 on this PR · Reviewed by Strix |
91516f2 to
b8efb82
Compare
b8efb82 to
a9aa533
Compare
Related issue
Fixes #8784
Summary
Add a Wally accordion to the provider examples in
concepts/llms.mdx. Wally serves open-weight models (GLM, DeepSeek, Kimi, MiniMax) behind an OpenAI-compatible API, so the example uses the existingopenai/prefix withbase_urland goes through the native OpenAI client. No code change, no LiteLLM.Docs accordion added in en, ar, ko and pt-BR - code blocks identical, only prose translated.
Verification
Tests added or updated for the changed behavior
Relevant tests and quality checks pass locally
the docs snippet run against the live API on current
main: plain call with every Wally model id; streaming, tool call through an Agent andresponse_formatstructured output withglm-5.3-flashanddeepseek-v4.1-flash- all passmint broken-links- no broken links in the changed pagesgit diff --check- cleanAdditional context
The change was written with AI assistance (Claude Code), so per CONTRIBUTING the
llm-generatedlabel applies - I can't set labels on this repo, please add it.Note
Low Risk
Documentation-only updates with no runtime or auth logic changes; risk is limited to doc accuracy and external link correctness.
Overview
Adds a Wally provider section to the LLM provider examples in
concepts/llms.mdx, addressing #8784. The new accordion sits after DeepInfra and documents Wally’s OpenAI-compatible endpoint: setWALLY_API_KEY, point the native OpenAI client athttps://inference.runanywhere.ai/v1viabase_url, and use models likeopenai/glm-5.3-flash(no LiteLLM extra). It also covers env setup, a sampleLLM(...)block, feature bullets (open-weight models, tools/streaming/structured output, up to 1M context), and links to pricing and API docs.The same accordion is added in en, ar, ko, and pt-BR under
docs/edge/; code samples match across locales with translated prose only. No application code changes.Reviewed by Cursor Bugbot for commit a9aa533. Bugbot is set up for automated code reviews on this repo. Configure here.