[Tracking] ROCm packages

[Madouura]

Tracking issue for ROCm derivations.

Key

• Package
  • Dependencies

WIP

Ready

TODO

• Add CUDA options to all derivations that can use a CUDA backend
• Implement tests using a system like nixos/tests: add ROCm and amdvlk tests #200757
  • Use the solution from ginkgo-hpc: init at 1.6.0 #261155
• Implement building any missed documentation
• Implement ROCm into tensorflow
• Add hipBLASLt (required by ZLUDA: init at 3 #288644 (comment))
• Optimize closures
  • rocmPackages: drop symlinks & split outputs #276846
  • llvmPackages_rocm.llvm explore splitting the output #242401
• Build failure: rocblas times out on hydra #301937

Merged

• hip: fix cmake installation directories #197838
• rocm-related: 5.3.0 -> 5.3.1 & aggregate #198770
• rocmlir: init at 5.3.0 #199324
• rocfft: set hydraPlatforms due to large output #200705
• maintainers/team-list: add rocm team #199574
• rocm-related: 5.3.1 -> 5.3.3 & misc changes #202373
• rocrand: init at 2.10.15-5.3.3 #202649
• rocwmma: init at 0.8-5.3.3 #202685
• hipsparse: reuse rocsparce matrices #203235
• miopen: init at 2.18.0-5.3.3 #202476
• rocm-related: misc changes #203412
• rocm-related: 5.3.3 → 5.4.0 #204378
• rocm-related: 5.4.0 → 5.4.1 & various fixes/changes #206421
• rocm-related: implement more derivations #206995
• rocm-related: fix hydra workarounds #213208
• rocfft: actually fix hydra caching #214339
• rocfft: split base outputs for hydra #214606
• rocm-related: 5.4.X -> 5.7.0 #258328
• rocmPackages: rpp, mivisionx, meta package sets #260299
• rocmPackages.rocsolver: increase hydra timeout #261180
• rocmPackages: 5.7.0 -> 5.7.1 #261578
• rocmPackages.rocm-core: 5.7.0 -> 5.7.1 #262823
• rocmPackages.hsa-amd-aqlprofile-bin: 5.7.0 -> 5.7.1 #262750
• rocmPackages.rocprofiler: fix rocprof and rocprofv2 #262798
• rocmPackages_5: disallow further version upgrades, fixup links #274980

ROCm-related

• ginkgo-hpc: init at 1.6.0 #261155
• Make openai-triton/pytorch free again (and various fixes) #263048

Notes

• Update command: nix-shell maintainers/scripts/update.nix --argstr commit true --argstr keep-going true --arg predicate '(path: pkg: builtins.elem (pkg.pname or null) [ "rocm-llvm-llvm" "rocm-core" "rocm-cmake" "rocm-thunk" "rocm-smi" "rocm-device-libs" "rocm-runtime" "rocm-comgr" "rocminfo" "clang-ocl" "rdc" "rocm-docs-core" "hip-common" "hipcc" "clr" "hipify" "rocprofiler" "roctracer" "rocgdb" "rocdbgapi" "rocr-debug-agent" "rocprim" "rocsparse" "rocthrust" "rocrand" "rocfft" "rccl" "hipcub" "hipsparse" "hipfort" "hipfft" "tensile" "rocblas" "rocsolver" "rocwmma" "rocalution" "rocmlir" "hipsolver" "hipblas" "miopengemm" "composable_kernel" "half" "miopen" "migraphx" "rpp-hip" "mivisionx-hip" "hsa-amd-aqlprofile-bin" ])'

Won't implement

• ROCmValidationSuite
  • Too many assumptions, not going to rewrite half the cmake files
• rocm_bandwidth_test
  • Not really needed, will implement on request
• atmi
  • Out-of-date
• aomp
  • We basically already do this
• Implement strictDeps for all derivations
  • Seems pointless now and I don't see many other derivations doing this

[Madouura]

Updating to 5.3.1, marking all WIP until pushed to their respective PRs and verified.