Skip to content

Commit 2a84e74

Browse files
committed
update
Signed-off-by: jiqing-feng <jiqing.feng@intel.com>
1 parent 1fa4994 commit 2a84e74

1 file changed

Lines changed: 5 additions & 0 deletions

File tree

docs/source/cli-skills.md

Lines changed: 5 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -11,6 +11,11 @@ Skill files are downloaded from the `huggingface/kernels` directory in this [rep
1111

1212
Skills instruct agents how to deal with hardware-specific optimizations, integrate with libraries like diffusers and transformers, and benchmark kernel performance in consistent ways.
1313

14+
> [!TIP]
15+
> **When are CPU kernels actually helpful?** Two main cases:
16+
> - **Better performance on Intel Xeon** — custom AVX2/AVX512 kernels (and AMX via brgemm for quantized GEMM) outperform generic PyTorch ops for element-wise and quantized workloads, especially in CPU-only or latency-sensitive serving.
17+
> - **Enabling functionality that otherwise can't run** — some kernels are a hard requirement, e.g. `megablocks` MoE on CPU, where without the kernel you simply cannot run MXFP4.
18+
1419
Examples:
1520

1621
```bash

0 commit comments

Comments
 (0)