You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
{{ message }}
Repository navigation
vLLM Chat Completions model Responses API - OpenRouter workflow #157
Use cases, pain points, and background
OpenRouter is a very popular inference endpoint provider and we should explicitly support this workflow
Description:
There shouldn't be any major changes necessary to use OpenRouter Chat Completions endpoints with VLLMModel. We need to test it out ourselves and write a tutorial on how to do it.
Design:
No code changes necessary, should just be able to point the config to an OpenRouter endpoint.
Out of scope:
Acceptance Criteria:
Create an OpenRouter API key
Find a model that is free to query on OpenRouter
Try using it by collecting rollouts using the MultiNeedle resources server. This will test tool calling and multi step interactions.
Tutorial on how to get an OpenRouter API key, how to find a model that is free to query, and steps to collect rollouts using the MultiNeedle resources server
Activity
cwing-nvidia commentedon May 25, 2026
closing in favor of #1285