Repository navigation
Bump lm-eval version for Transformers v5 compatibility - #33994
Conversation
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
github-actions
Bot
added
the
ready
|
Documentation preview: https://vllm--33994.org.readthedocs.build/en/33994/ |
mergify
Bot
added
documentation
![gemini-code-assist[bot]](https://avatars.githubusercontent.com/in/956858?s=60&v=4){kind=small}
There was a problem hiding this comment.
Code Review
This pull request successfully updates the lm-eval package version to 0.4.10 across various build scripts, documentation, and dependency files. This change aligns with the stated goal of ensuring compatibility with Transformers v5. The modifications in requirements/test.txt reflect the updated dependency tree for lm-eval and are expected. Overall, the changes are straightforward and appear to achieve the intended purpose without introducing any high or critical issues.
|
Hmm, I'll look into it |
|
This pull request has merge conflicts that must be resolved before it can be |
|
Looks like a bug in |
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
…t#33994) Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
…t#33994) Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
…t#33994) Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
…t#33994) Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Update lm-eval pin to
0.4.10so that EleutherAI/lm-evaluation-harness@384118d is included (the previous version imported a class that no longer exists in Transformers v5)