fw vram
Estimate llama.cpp VRAM, SWA KV cache and the -ngl layer split
fw vram [--vram-gb 12] [--model-gb 5.5] [--layers 32] [--ctx 16384] [--swa-layers 0] [--kv-type q8_0]| Flag | Argument |
|---|---|
--vram-gb |
12 |
--model-gb |
5.5 |
--layers |
32 |
--ctx |
16384 |
--swa-layers |
0 |
--kv-type |
Global options
Section titled “Global options”Every command also accepts -C, --directory, --offline, --json, -q and -v. See the overview.
Same group: ML, Inference & Heretic
Section titled “Same group: ML, Inference & Heretic”fw infer, fw train, fw hf, fw abliterate, fw heretic, fw align
Source
Section titled “Source”Read from fw vram --help of fw 2026.11.0.