Skip to content

Cutlass 3.9.2 #371

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merged
merged 41 commits into from
May 20, 2025
Merged

Conversation

aacostadiaz
Copy link
Collaborator

This PR adds the changes from Cutlass 3.9.2

yzhaiustc and others added 30 commits April 2, 2025 15:11
* v3.9 update

* voidD

---------

Co-authored-by: yuzhai <[email protected]>
Co-authored-by: wenju.li <[email protected]>
Co-authored-by: Haicheng Wu <[email protected]>
* add support for sm89 in cute and the unit tests

* rebase v3.9 and format code

* minor fix

---------

Co-authored-by: Haicheng Wu <[email protected]>
…2234)

* Fix broken links in cluster launch control docs

* Improve titles and alt text
…IA#2219)

With the usual register allocation (producer 40, consumer 232) compiling Gemm
with tile shape 256 x 208 (cooperative) or 128 x 208 (pingpong) show lots of
register spilling (e.g. ~3000 bytes spill). For this case we can change
the register allocation to producer 24, consumer 240, which avoids spills.
If TileN is not divisible by 32 (e.g, 208), by default EpiTile would be set
to 128 x 32, which does not compile as TileN is required to divide EpiTileN
* Update config.hpp

* 更新 config.hpp

* 更新 config.hpp
* cutlass 3.9 update

* rebase

* fixes out of shared memory for blockwise Blackwell

* doc format

* fix issue 2253

* disable host ref by default

* fix sm120 smem capacity

---------

Co-authored-by: yuzhai <[email protected]>
Co-authored-by: Haicheng Wu <[email protected]>
* Lazy cuda import

* More lazy cuda import

* More lazy cuda imports

* minor fixes

---------

Co-authored-by: Haicheng Wu <[email protected]>
Adds "Generalized Neighborhood Attention" to list of publications using
CUTLASS.

https://arxiv.org/abs/2504.16922

Co-authored-by: Ali Hassani <[email protected]>
* 3.9.2 doc/version

* whitespace
aacostadiaz and others added 11 commits May 13, 2025 16:59
# Conflicts:
#	examples/CMakeLists.txt
#	examples/README.md
#	include/cute/arch/tmem_allocator_sm100.hpp
#	include/cutlass/epilogue/dispatch_policy.hpp
#	include/cutlass/gemm/collective/sm90_mma_array_tma_gmma_ss_warpspecialized_fp8_blockwise_scaling.hpp
#	include/cutlass/gemm/collective/sm90_mma_tma_gmma_ss_warpspecialized_fp8_blockwise_scaling.hpp
#	include/cutlass/gemm/dispatch_policy.hpp
#	include/cutlass/gemm/kernel/sm90_gemm_array_tma_warpspecialized_cooperative.hpp
#	include/cutlass/gemm/kernel/sm90_tile_scheduler_group.hpp
#	include/cutlass/gemm/kernel/tile_scheduler.hpp
#	media/docs/cpp/build/building_with_sycl_support.md
#	python/cutlass/backend/operation.py
#	python/cutlass/backend/utils/device.py
#	python/cutlass/library_defaults.py
#	python/cutlass/op/gemm.py
#	test/unit/common/filter_architecture.cpp
#	tools/util/include/cutlass/util/reference/device/tensor_compare.h
@aacostadiaz aacostadiaz marked this pull request as ready for review May 20, 2025 17:27
@aacostadiaz aacostadiaz merged commit dee3370 into codeplaysoftware:sycl-develop May 20, 2025
12 of 14 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.