Skip to content

Pull requests: open-compass/VLMEvalKit

New pull request New
16 Open 687 Closed
16 Open 687 Closed
Author
Filter by author
Loading
Label
Filter by label
Loading
Use alt + click/return to exclude labels
or ⇧ + click/return for logical OR
Projects
Filter by project
Loading
Milestones
Filter by milestone
Loading
Reviews
Filter by reviews
No reviews Review required Approved review Changes requested
Assignee
Filter by who’s assigned
Assigned to nobody Loading
Sort
Sort by
Newest Oldest Most commented Least commented Recently updated Least recently updated Best match
Most reactions
👍 👎 😄 🎉 😕 ❤️ 🚀 👀

Pull requests list

[Benchmark] Support VSR [TACL'23]
#1164 opened Jul 15, 2025 by ignoreandfly Loading…
1
[Benchmark] Support M4Bench
#1163 opened Jul 15, 2025 by Thorin215 Loading…
[Fix] add support for multi process build prompt in video dataset
#1162 opened Jul 15, 2025 by FangXinyu-0913 Loading…
@FangXinyu-0913
Add generated VisFactor in three difficulties
#1160 opened Jul 15, 2025 by penguinnnnn Loading…
[Feature] Add verifier for VQA/MCQ evaluation
#1136 opened Jul 7, 2025 by TianhaoLiang2000 Loading…
[Benchmark] fix lint and support egoexobench WIP
#1115 opened Jun 28, 2025 by fleurs03 Loading…
@FangXinyu-0913
[Model] Add new model provider: AI/ML API
#1093 opened Jun 19, 2025 by D1m7asis Loading…
4 tasks done
1
Moondream refactor WIP
#1076 opened Jun 13, 2025 by snowclipsed • Draft
1
[Benchmark] Add GUI grounding: OSWorld-G WIP
#1020 opened May 27, 2025 by chenjix Loading…
1
add dataset OCRBenchV2 support BUG Something isn't working
#984 opened May 8, 2025 by OliverLeeXZ Loading…
2
WIP: Add Capture Dataset WIP
#974 opened May 2, 2025 by bodsul Loading…
2
fix(image_mcp.py): use consistant argument (#929)
#968 opened Apr 28, 2025 by MaoSong2022 Loading…
1
2
[Minor] Align MMMU evaluation method with official Pending
#966 opened Apr 28, 2025 by FangXinyu-0913 Loading…
[Model] Add new model: Prism
#622 opened Nov 22, 2024 by Myhs-phz Loading…
[Benchmark] Support Video MCQ with TaskMeAnything-v1-video-random as an example
#359 opened Aug 5, 2024 by weikaih04 Loading…
5
[Support] multiple process parallel inference large model on multi-gpu WIP
#298 opened Jul 19, 2024 by junming-yang Loading…
ProTip! Adding no:label will show everything without a label.