Skip to content

Verbose argument for dataset loading #1148

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Open
knagrecha opened this issue Feb 10, 2021 · 2 comments
Open

Verbose argument for dataset loading #1148

knagrecha opened this issue Feb 10, 2021 · 2 comments

Comments

@knagrecha
Copy link

🚀 Feature

Adding a verbose argument for dataset loading to give progress updates while loading a dataset.

Sometimes these datasets can be huge and the user is waiting a LONG time. Having a progress bar of some sort would let the user debug failures due to OOM issues, or even just reassure them that something is happening!

This is a very simple feature, but it would help give users a better understanding of their processes and provide some peace of mind while running large experiments.

@parmeet
Copy link
Contributor

parmeet commented Jun 23, 2022

@ejguan , @kevinchn : I wonder if we add progress bar to download data pipes?

@ejguan
Copy link
Contributor

ejguan commented Jun 24, 2022

We do have a tracking issue here: pytorch/data#457

But, based on my understanding, we might not have the bandwidth for now to implement it.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

No branches or pull requests

4 participants