Online Softmax Tiling FlashAttention kernel executing bounded SRAM query/key/value block updates with running max and sum rescaling for O(1) memory footprint.
-
Updated
Sep 9, 2026 - Python
#
deep-learning-systems
Here are 9 public repositories matching this topic...
Online Softmax Tiling FlashAttention kernel executing bounded SRAM query/key/value block updates with running max and sum rescaling for O(1) memory footprint.
-
Updated
Sep 9, 2026 - Python
Rigorous self-study roadmap to master algorithms, low-level systems, distributed systems, and deep learning infrastructure through CMU/MIT/Stanford/Berkeley courses.
computer-science distributed-systems roadmap algorithms parallel-computing compilers operating-systems self-study database-systems systems-programming computer-networking cs-curriculum deep-learning-systems low-level-programmig
-
Updated
Dec 20, 2025
The implementation of the CMU 10-414/714: Deep Learning Systems course assignment
-
Updated
Aug 1, 2024 - Python
A platform to learn to build systems at scale, from backend to LLMs.
distributed-systems parallel-computing system-design machine-learning-systems deep-learning-systems ai-applications backend-engineering
-
Updated
Aug 4, 2025
Building the needle deep-learning framework from scratch (CMU 10-414/714 Deep Learning Systems): reverse-mode autodiff, nn library, optimizers, CPU NDArray backend, CNN & RNN/LSTM — with the official tests
-
Updated
Jul 3, 2026 - Python
PyTorch inference acceleration engine: rejection-sampling speculative decoding (1.92x speedup), 5-way quantization bake-off & AirLLM 70B streaming on RTX 4060.
-
Updated
Sep 25, 2026 - TypeScript
Backprop versus the memory wall: an interactive roofline case that backprop was arithmetic-bound in 1986 and is memory-bound in 2026
-
Updated
Sep 13, 2026 - JavaScript
Add this topic to your repo
To associate your repository with the deep-learning-systems topic, visit your repo's landing page and select "manage topics."