Skip to content

Pull requests: huggingface/lighteval

New pull request New
25 Open 418 Closed
25 Open 418 Closed
Author
Filter by author
Loading
Label
Filter by label
Loading
Use alt + click/return to exclude labels
or ⇧ + click/return for logical OR
Projects
Filter by project
Loading
Milestones
Filter by milestone
Loading
Reviews
Filter by reviews
No reviews Review required Approved review Changes requested
Assignee
Filter by who’s assigned
Sort
Sort by
Newest Oldest Most commented Least commented Recently updated Least recently updated Best match
Most reactions
👍 👎 😄 🎉 😕 ❤️ 🚀 👀

Pull requests list

Making bootstrap_iters an arg feature/enhancement New feature/request
#697 opened May 1, 2025 by pratyushmaini Loading…
1
Adds More Generative tasks new-task task-update
#694 opened Apr 29, 2025 by hynky1999 Loading…
1
Async vllm feature/enhancement New feature/request
#693 opened Apr 28, 2025 by clefourrier Loading…
26
Added support for quantization in vLLM backend feature/enhancement New feature/request
#690 opened Apr 26, 2025 by SulRash Loading…
3
Add way to load local datafile feature/enhancement New feature/request
#687 opened Apr 24, 2025 by ScottHoang Loading…
2
Adds multimodal support feature/enhancement New feature/request
#675 opened Apr 15, 2025 by NathanHB Loading…
7
[WIP] Nanotron fix feature/enhancement New feature/request
#656 opened Apr 2, 2025 by Stillerman Loading…
2
Nanotron model updates feature/enhancement New feature/request
#652 opened Mar 31, 2025 by anton-l Loading…
1
Add CLI arg generate_until_token to support reasoning and CoT models
#617 opened Mar 17, 2025 by mapmeld Loading…
2
added vllm lora support. feature/enhancement New feature/request
#611 opened Mar 11, 2025 by haizhou-shi Loading…
4
Add draft functionality for a generic sandboxed code running
#580 opened Feb 21, 2025 by plaguss • Draft
1 of 2 tasks
2
Add CodeElo new-task
#575 opened Feb 19, 2025 by plaguss • Draft
1
new metrics and pr-fouras dataset add
#558 opened Feb 13, 2025 by BertrandCabotIDRIS Loading…
4
Adding verbal-reasoning-challenge as a Community Task
#551 opened Feb 11, 2025 by aryawu0513 Loading…
9
Improved stability of litellm models for reasoning models.
#538 opened Feb 5, 2025 by JoelNiklaus Loading…
8
Multi node vLLM
#530 opened Jan 31, 2025 by ncassereau Loading…
16
Fix TGI (Text Generation Inference) Endpoint Inference and TGI JSON Grammar Generation
#502 opened Jan 15, 2025 by cpcdoy Loading…
13
Initial proposal for model lazy loading
#497 opened Jan 11, 2025 by JoelNiklaus • Draft
Added diskcache to base model.
#480 opened Dec 30, 2024 by JoelNiklaus Loading…
8
Fix attribute and parameter names in loggers
#476 opened Dec 26, 2024 by albertvillanova Loading…
2
Config fixes for VLLMModel
#472 opened Dec 20, 2024 by anton-l Loading…
7
feat: add JGLUE tasks
#469 opened Dec 19, 2024 by ryan-minato Loading…
9
Use config dict in TaskConfigLogger for easier serialization
#454 opened Dec 18, 2024 by albertvillanova Loading…
8
Add swiss legal evals as new community tasks
#389 opened Nov 11, 2024 by JoelNiklaus Loading…
39
Adding chat completion task to endpoint models
#281 opened Aug 27, 2024 by sadra-barikbin Loading…
9
ProTip! What’s not been updated in a month: updated:<2025-04-06.