feat(together-ai): update model YAMLs [bot]#1766
Conversation
|
/test-models |
Gateway test results
Failures (1)
ErrorCode snippetfrom openai import OpenAI
client = OpenAI(api_key="***", base_url="https://internal.devtest.truefoundry.tech/api/llm")
tools = [
{
"type": "function",
"function": {
"name": "get_weather",
"description": "Get the current weather for a location.",
"parameters": {
"type": "object",
"properties": {
"location": {
"type": "string",
"description": "The city name, e.g. London",
},
},
"required": ["location"],
"additionalProperties": False,
},
"strict": True,
},
},
]
response = client.chat.completions.create(
model="test-v2-together-ai/Qwen-Qwen3.7-Plus",
messages=[
{"role": "user", "content": "Use the get_weather tool to check the weather in London. You must call the tool, do not respond with plain text."},
],
tools=tools,
tool_choice="auto",
stream=True,
)
_tool_calls_made = False
for chunk in response:
if chunk.choices and len(chunk.choices) > 0:
delta = chunk.choices[0].delta
if delta.content is not None:
print(delta.content, end="", flush=True)
if delta.tool_calls:
_tool_calls_made = True
for _tc in delta.tool_calls:
if _tc.function:
print(_tc.function.arguments or "", end="", flush=True)
if not _tool_calls_made:
raise Exception("VALIDATION FAILED: tool-call stream - no tool calls received")
print("\nVALIDATION: tool-call stream SUCCESS")Successes (2)
Output
OutputSkipped (8)
Skip reason
Skip reason
Skip reason
Skip reason
Skip reason
Skip reason
Skip reason
Skip reason |
There was a problem hiding this comment.
Cursor Bugbot has reviewed your changes using default effort and found 1 potential issue.
❌ Bugbot Autofix is OFF. To automatically fix reported issues with cloud agents, enable autofix in the Cursor dashboard.
Reviewed by Cursor Bugbot for commit 723bddd. Configure here.

Auto-generated by poc-agent for provider
together-ai.Note
Low Risk
Metadata-only catalog changes with no application code; the main user impact is routing away from a newly retired model and updated cost/modality metadata.
Overview
Updates several Together AI model YAML entries to match current provider capabilities, pricing, and lifecycle.
Qwen/Qwen3.5-397B-A17B is marked retired (
status: retired,isDeprecated: true,retirementDate: 2026-06-29) with a normalized output token cost. Qwen3.7-Plus dropsstructured_output,tool_choice, andthinking: true, and addsremoveParams: reasoning_effort. Qwen3-8B-Lora and DeepSeek-OCR-2 also stripreasoning_effortfrom forwarded params.cartesia/sonic-3.5 pricing moves from zero per-token costs to
input_cost_per_character. google/imagen-4.0-fast and imagen-4.0-preview now list image as an input modality and refresh documentation links.Reviewed by Cursor Bugbot for commit 723bddd. Bugbot is set up for automated code reviews on this repo. Configure here.