Skip to content

Improve disk space use for Windows jobs on GHA #2394

@mgorny

Description

@mgorny

Comment:

xref conda-forge/pytorch-cpu-feedstock#409

PyTorch started taking a lot more space to build recently. While trying to workaround it by increasing the CIrun runner size, two problems were noticed:

  1. Builds are performed in c:\bld rather than (unless I'm mistaken) the much larger d:\ partition. Effectively, choosing a larger builder had no effect, since it did only increase the d:\ partition which was used for miniforge but not the c:\ partition which was used for build.
  2. The partitions don't take up all the available space, so increasing the builder disk size doesn't immediately benefit the builds.

I've tried modifying the files in the feedstock to force d:\bld instead but to no avail. Instead, for now, we've used the snippet in conda-forge/pytorch-cpu-feedstock@a6b03c9 (as suggested by @aktech, thanks a lot!) to resize the c:\ partition to use the additional space available.

Could we:

  1. Include this (or a similar snippet) in the templates, to use all the space available in the runner?
  2. Look into using d:\ for build (and then resizing it instead), since it seems to be the larger partition?

Metadata

Metadata

Assignees

No one assigned

    Labels

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions