Skip to content

feat: reasoning budget #468

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom
Merged
merged 14 commits into from
Jun 4, 2025
Merged

feat: reasoning budget #468

merged 14 commits into from
Jun 4, 2025

Conversation

giladgd
Copy link
Contributor

@giladgd giladgd commented Jun 1, 2025 •
edited
Loading

Description of change

  • feat: reasoning budget (documentation: Set Reasoning Budget)
  • feat: SWA (Sliding Window Attention) support - greatly reduced context memory consumption on supported models
  • feat(documentation): LLMs friendly llms.md and llms-full.md files
  • fix: prompt completion edge cases
  • fix: adapt to llama.cpp changes
  • fix: bugs

Pull-Request Checklist

  • Code is up-to-date with the master branch
  • npm run format to apply eslint formatting
  • npm run test passes with this change
  • This pull request links relevant issues as Fixes #0000
  • There are new or updated unit tests validating the change
  • Documentation has been updated to reflect this change
  • The new commits and pull request title follow conventions explained in pull request guidelines (PRs that do not follow this convention will not be merged)

@giladgd giladgd requested a review from ido-pluto June 1, 2025 00:31
@giladgd giladgd self-assigned this Jun 1, 2025
ido-pluto
ido-pluto approved these changes Jun 3, 2025
View reviewed changes
Copy link
Contributor

@ido-pluto ido-pluto left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM

@giladgd giladgd merged commit ea8d904 into master Jun 4, 2025
16 checks passed
@giladgd giladgd deleted the gilad/swaSupport branch June 4, 2025 22:07
@github-actions GitHub Actions
Copy link

github-actions bot commented Jun 4, 2025

🎉 This PR is included in version 3.9.0 🎉

The release is available on:

Your semantic-release bot 📦🚀

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers

@ido-pluto ido-pluto ido-pluto approved these changes

Assignees

@giladgd giladgd

Labels
released
Projects
None yet
Milestone
No milestone
Development

Successfully merging this pull request may close these issues.
2 participants
@giladgd @ido-pluto