aarch64-apple-darwin package python311Packages.accelerate failed to build

[mudrii]

Describe the bug

A clear and concise description of what the bug is.
Unable to install python311Packages.accelerate on MacOs Nix aarch64-apple-darwin

Steps To Reproduce

Steps to reproduce the behavior:

1. Standard package installation

Expected behavior

Package python311Packages.accelerate to be installed

Screenshots

trace: warning: optionsDocBook is deprecated since 23.11 and will be removed in 24.05
error: builder for '/nix/store/4d17b0gx1154zmsffz4gsfgrzq3ny2m0-python3.11-accelerate-0.24.1.drv' failed with exit code 1;
       last 10 log lines:
       > -- Docs: https://docs.pytest.org/en/stable/how-to/capture-warnings.html
       > =========================== short test summary info ============================
       > FAILED tests/test_accelerator.py::AcceleratorTester::test_can_unwrap_model - ModuleNotFoundError: No module named 'torch._C._distributed_c10d'; 'torch._...
       > FAILED tests/test_accelerator.py::AcceleratorTester::test_save_model_pytorch - ModuleNotFoundError: No module named 'torch._C._distributed_c10d'; 'torch._...
       > FAILED tests/test_accelerator.py::AcceleratorTester::test_save_model_safetensors - ModuleNotFoundError: No module named 'torch._C._distributed_c10d'; 'torch._...
       > FAILED tests/test_cli.py::AccelerateLauncherTester::test_accelerate_test - RuntimeError: 'accelerate test' failed with returncode 1
       > FAILED tests/test_utils.py::UtilsTester::test_can_undo_convert_outputs - ModuleNotFoundError: No module named 'torch._C._distributed_c10d'; 'torch._...
       > FAILED tests/test_utils.py::UtilsTester::test_extract_model - ModuleNotFoundError: No module named 'torch._C._distributed_c10d'; 'torch._...
       > = 6 failed, 98 passed, 115 skipped, 22 deselected, 3 warnings in 67.10s (0:01:07) =
       > /nix/store/76bslal3s07bjixxrl8b20r25c0wwpay-stdenv-darwin/setup: line 1605: pop_var_context: head of shell_variables not a function context
       For full logs, run 'nix log /nix/store/4d17b0gx1154zmsffz4gsfgrzq3ny2m0-python3.11-accelerate-0.24.1.drv'.
error: 1 dependencies of derivation '/nix/store/090iysrgwr37wr8am5qbhd5238qg6dd5-python3-3.11.5-env.drv' failed to build
error: 1 dependencies of derivation '/nix/store/knjgynhpc8djpr7fq2mkg7a8mnx4b31w-home-manager-applications.drv' failed to build
error: 1 dependencies of derivation '/nix/store/v4gmf5c6xhn38zjx6l85pklhaxjpbxyh-home-manager-fonts.drv' failed to build
error: 1 dependencies of derivation '/nix/store/yangg0xbr4nvn0qz5fyq5q570wjcmk3y-home-manager-path.drv' failed to build
error: 1 dependencies of derivation '/nix/store/sadlrq8g4wv6rhh7grrd6mvxm64d6vny-man-paths.drv' failed to build
error: 1 dependencies of derivation '/nix/store/x6gah2kcs6jmb3p10bpk8zjqa0qs30wh-python3-3.11.5-env-fish-completions.drv' failed to build
error: 1 dependencies of derivation '/nix/store/v7xmlvks43c128a8cbwmrblmwf9m20vw-home-manager-generation.drv' failed to build
error: 1 dependencies of derivation '/nix/store/81l5sq39wndlkxm0c6ijclshajd2f8g2-user-environment.drv' failed to build
error: 1 dependencies of derivation '/nix/store/n4hq7gz1rkh3infsbxhqhqhfkm0zl60j-activation-mudrii.drv' failed to build
error: 1 dependencies of derivation '/nix/store/nmq7wd1lzzj0gfd49z09lgavf6y2llcb-darwin-system-23.11.20231105.a0b3b06+darwin4.afe83cb.drv' failed to build

Additional context

unable to install Langchain as it depends on accelerate

Notify maintainers

@bcdarwin

Metadata

Please run nix-shell -p nix-info --run "nix-info -m" and paste the result.

 - system: `"aarch64-darwin"`
 - host os: `Darwin 23.0.0, macOS 14.0`
 - multi-user?: `yes`
 - sandbox: `no`
 - version: `nix-env (Nix) 2.17.1`
 - channels(root): `"nixpkgs"`
 - nixpkgs: `/nix/var/nix/profiles/per-user/root/channels/nixpkgs`

[bcdarwin]

Was this solved by #265566?

[natsukium]

The reported error has been fixed, but we cannot build due to a larger problem. #263048

[natsukium]

This is no longer an accelerate issue, so I will close it.

[GaetanLepage]

Looks like it's back. A commit in transformers has made the error appear once again in accelerate:
huggingface/transformers#35129