Skip to content

Add readme metadata specifying configs #30

@hombit

Description

@hombit

Until we specify splits explicitly, datasets.load_dataset would mix "main" and "margin" catalog data, which would cause a small data duplication. We should specify README metadata, something like:

---
configs:
- config_name: default
  data_dir: "mmu_vipers_w4/dataset/"
- config_name: margin_10arcs
  data_dir: "mmu_vipers_w4_10arcs/dataset/"
---

https://huggingface.co/docs/hub/datasets-manual-configuration

Metadata

Metadata

Assignees

No one assigned

    Labels

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions