build(deps): Update trl requirement from <0.18,>=0.13 to >=0.13,<0.20

[dependabot]

Updates the requirements on trl to permit the latest version.

Release notes

Sourced from trl's releases.

v0.19.0

Breaking and major changes

🧰 [SFT] Tool support

SFTTrainer now supports training with tools! You just have to add a column tools to your dataset, which contains a list of tool definitions as json schemas. The tools will be automatically registered and can be used in the training process.

from datasets import Dataset
from transformers.utils import get_json_schema
from trl import SFTTrainer
Fictitious functions to simulate tool calls
def start_timer(duration: int) -> int:
"""
Starts a timer for the specified duration in seconds.
Args:
    duration: Duration in seconds to set the timer for.
Returns:
The duration set for the timer.
"""
return duration

def create_reminder(time: str, note: str) -> str:
"""
Creates a reminder for the specified time and note.
Args:
    time: The time for the reminder.
    note: The note for the reminder.
Returns:
A confirmation message indicating that the reminder has been set.
"""
return "I'll remind you to call mom at 7 PM."

Define the JSON schemas for the tools
start_timer = get_json_schema(start_timer)
create_reminder = get_json_schema(create_reminder)
dataset = Dataset.from_dict({
"messages": [
[
{"role": "user", "content": "Set a timer for 10 minutes."},
{"role": "assistant", "tool_calls": [{"type": "function", "function": {"name": "start_timer", "arguments": {"duration": 600}}}]},
{"role": "tool", "name": "start_timer", "content": "600"},
{"role": "assistant", "content": "Timer set for 10 minutes."},
],
</tr></table>

... (truncated)

Commits

• 5b3ea9d Release: v0.19 (#3625)
• c262674 🧰 [SFT] Tool support (#3597)
• 5c3dd3a 🔍 Add test to verify chat template consistency (#3624)
• 4c92de0 ⚔️ Fix bf16 fp16 config conflict issue (#3598)
• 67f17f7 📜 Add chat_template_path parameter to SFTConfig (#3599)
• 37a71e8 🧬 Add generation_kwargs as a property of GRPOConfig to support additional...
• b0958c6 [GRPO] Fix prompt truncation (max_prompt_length) with vLLM. (#3601)
• 8bad863 ⭐ Add vllm_gpu_memory_utilization recommendation script (#3554)
• d004415 🎁 Put the reward computation in a separate function (#3620)
• 9554c2f 🤵‍♂️ SFT on assistant messages only (#3586)
• Additional commits viewable in compare view

Dependabot will resolve any conflicts with this PR as long as you don't alter it yourself. You can also trigger a rebase manually by commenting @dependabot rebase.

---

Dependabot commands and options

You can trigger Dependabot actions by commenting on this PR:

• @dependabot rebase will rebase this PR
• @dependabot recreate will recreate this PR, overwriting any edits that have been made to it
• @dependabot merge will merge this PR after your CI passes on it
• @dependabot squash and merge will squash and merge this PR after your CI passes on it
• @dependabot cancel merge will cancel a previously requested merge and block automerging
• @dependabot reopen will reopen this PR if it is closed
• @dependabot close will close this PR and stop Dependabot recreating it. You can achieve the same result by closing it manually
• @dependabot show <dependency name> ignore conditions will show all of the ignore conditions of the specified dependency
• @dependabot ignore this major version will close this PR and stop Dependabot creating any more for this major version (unless you reopen the PR or upgrade to it yourself)
• @dependabot ignore this minor version will close this PR and stop Dependabot creating any more for this minor version (unless you reopen the PR or upgrade to it yourself)
• @dependabot ignore this dependency will close this PR and stop Dependabot creating any more for this dependency (unless you reopen the PR or upgrade to it yourself)

[github-actions]

Thanks for making a pull request! 😃
One of the maintainers will review and advise on the next steps.