#

rmsnorm

Here is 1 public repository matching this topic...

DefTruth / CUDA-Learn-Notes

📚Modern CUDA Learn Notes with PyTorch: Tensor/CUDA Cores, 📖150+ CUDA Kernels, 📖HGEMM (achieve the performance of cuBLAS 🎉🎉), 📖100+ LLM/CUDA blogs.

cuda pytorch triton gemm softmax cuda-programming layernorm gemv elementwise rmsnorm flash-attention flash-attention-2 warp-reduce block-reduce flash-attention-3

Updated Nov 22, 2024
Cuda

Improve this page

Add a description, image, and links to the rmsnorm topic page so that developers can more easily learn about it.

Curate this topic

Add this topic to your repo

To associate your repository with the rmsnorm topic, visit your repo's landing page and select "manage topics."