Skip to content

chore: add wally provider - #658

Open
adityabatra072 wants to merge 1 commit into
charmbracelet:mainfrom
RunanywhereAI:add-wally
Open

adityabatra072 wants to merge 1 commit into
charmbracelet:mainfrom
RunanywhereAI:add-wally

Conversation

@adityabatra072

@adityabatra072 adityabatra072 commented Oct 9, 2026 •

Copy link
Copy Markdown

What

Adds Wally as an inference provider: an OpenAI-compatible API from RunAnywhere serving open models with 1M context.

Models: MiMo V2.6 Flash (mimo-v2.6-flash), DeepSeek V4.1 Flash (deepseek-v4.1-flash, default large), GLM-5.3 Flash (glm-5.3-flash, default small). Endpoint https://inference.runanywhere.ai/v1, key $WALLY_API_KEY, type openai-compat.

Follows the existing pattern

  • internal/providers/configs/wally.json
  • //go:embed + wallyProvider() + providerRegistry entry in internal/providers/providers.go
  • KnownProviders() entry in pkg/catwalk/provider.go

Verified

  • go build ./... clean
  • go test ./... green
  • Ran Crush against a local catwalk with all three models, including tool calls and --reasoning-effort

Pricing source: https://www.runwally.com/pricing. Cache-read prices are in cost_per_1m_out_cached, per CRUSH.md.

@adityabatra072
adityabatra072 force-pushed the add-wally branch 2 times, most recently from 13bc870 to 3cfb37e Compare October 13, 2026 21:05
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant