Skip to content

Conversation

@aymeric-roucher
Copy link
Collaborator

No description provided.

ipython_config.py

# pyenv
# .python-version
Copy link
Collaborator Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

@albertvillanova is this still needed?

Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

If the lines are commented, tthenhey are currently ignored.

Apart form the one duplicated, why not just uncommenting the others?

openai_model_pattern = r"(o3[-\d]*|o4-mini[-\d]*|gpt-5(-mini|-nano)?[-\d]*|gpt-5.1[-\d]*)"
grok_model_pattern = r"([a-zA-Z]+\.)?(grok-3-mini|grok-4|grok-code-fast)(-[A-Za-z0-9]*)?"
# o3*, o4*, all grok-* models, and the gpt-5* family (including versioned variants) don't support stop parameter
openai_model_pattern = r"(o3(?:$|[-.].*)|o4(?:$|[-.].*)|gpt-5(?:$|[-.].*))"
Copy link
Collaborator Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Making this more future-proof to also support gpt-5.3 and next ones when they are released.
Same for grok.

Copy link
Member

@albertvillanova albertvillanova left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Thanks. Just a question below.

[
# Unsupported base models
("o3", False),
("o3-mini", False),
Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

"o3-mini" (as others, like "o4" and "o4-turbo") was before True, and now it is False. Why? Which value is the right one?

ipython_config.py

# pyenv
# .python-version
Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

If the lines are commented, tthenhey are currently ignored.

Apart form the one duplicated, why not just uncommenting the others?

@aymeric-roucher
Copy link
Collaborator Author

aymeric-roucher commented Dec 17, 2025

Ok I've manually retested Grok and OpenAI models: here is the answer to the question: does this model support a stop parameter?

  • grok-3: Yes
  • all other grok after 3: 3-mini, 4, 4-1, code-fast-1: No
  • gpt-4o: yes
  • o3: no
  • o3-mini: yes
  • o4: non existant model: 'The model o4 does not exist or you do not have access to it.',
  • o4-mini: no
  • gpt-5 and later: no
    Anthropic models do support stop sequences.
    Updating the tests to make sure this is exactly reflected.

Also one thing to note: claude models used to go claude-{number}-{version}, like claude-3-5-sonnet (example), now they put the number last (claude-sonnet-4-5): updating this in the test.

@aymeric-roucher aymeric-roucher merged commit 0e7c414 into main Dec 17, 2025
4 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

BUG: gpt-5.2 model on CodeAgent returns "Unsupported parameter: 'stop' is not supported with this model."

3 participants