全部分类

Why MTP doesn't speed up your llama.cpp inference (and how to actually fix it)

Last week, I spent two days banging my head against a wall. I had just spun up a fresh llama.cpp build with multi-token …