Skip to content

Adds More Generative tasks #694

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Open
wants to merge 2 commits into
base: main
Choose a base branch
from
Open

Adds More Generative tasks #694

wants to merge 2 commits into from

Conversation

hynky1999
Copy link
Collaborator

@hynky1999 hynky1999 commented Apr 29, 2025

This PR adds more generative tasks and fixes some old ones:

  1. COQA -> Is converted into template + we only use the first question unlike previously when all questions were used which doesn't make sense, because any but first question requires context of previous ones
  2. DROP -> The metric doesn't really make sense + got converted into tempalte
  3. Natural questions -> New task
  4. Squad v2 -> New task
  5. Jopardy -> New task
  6. SImpleQA -> Just added few-shot split

@HuggingFaceDocBuilderDev
Copy link
Collaborator

The docs for this PR live here. All of your documentation changes will be reflected on that endpoint. The docs are available until 30 days after the last update.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants