This repository was archived by the owner on Mar 20, 2026. It is now read-only.

This repository was archived by the owner on Mar 20, 2026. It is now read-only.

CPU OOM when pretraining hubert #5640

Open

Labels

needs triagequestion

opened

Hi, I encountered a CPU memory OOM issue while training Hubert. The problem is that load_label_offsetand load_audioin fairseq/data/audio/hubert_dataset.pyload all the data into a list at once. Are there any good solutions for this? I have roughly 200 million data entries.

Metadata

Assignees

No one assigned

Labels

needs triagequestion

Type

No type

Projects

No projects

Milestone

No milestone

Relationships

None yet

Development

No branches or pull requests