Skip to content

Commit f5bb5ce

Browse files
maleadtclaude
andcommitted
Add Mixture of Experts (MoE) example
Port of cuTile Python's MoE.py sample with two kernels: - fused_moe_kernel: tiled matmul with gather/scatter for expert routing - silu_and_mul_kernel: element-wise SiLU activation The Julia fused_moe_kernel uses opt_level=0 as a workaround for a tileiras optimizer crash caused by token loop-carries from gather ops. Co-Authored-By: Claude Opus 4.6 (1M context) <noreply@anthropic.com>
1 parent 7d3d638 commit f5bb5ce

File tree

3 files changed

+799
-0
lines changed

3 files changed

+799
-0
lines changed

examples/Project.toml

Lines changed: 1 addition & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -1,6 +1,7 @@
11
[deps]
22
CUDA = "052768ef-5323-5732-b1bb-66c8b64840ba"
33
FFTW = "7a1cc6ca-52ef-59f5-83cd-3a7055c09341"
4+
Random = "9a3f8284-a2c9-5f02-9a11-845980a1fd5c"
45
cuTile = "0dea8319-8c4a-4662-a73d-20234d115b9a"
56

67
[sources]

0 commit comments

Comments
 (0)