I patched llama.cpp to gain 20% prompt processing TPS. Help me make a PR
I've been running Qwen3.6-35B-A3B locally on llama.cpp and noticed that prompt processing throughput gets too low with MTP. I got nerd-sniped. What started as curiosity turned into a two-week rabbit hole of experiments and ended with a PoC that fully recovers the MTP PP overhead on GPU, above any expectation I had. TL;DR: instead of processing the last layer MoE FFN for the entire ubatch tokens (usually 512-2048 tokens), this PoC processes only the output row (usually 1 token during prefill). Th




![Hiding messages in the least significant mantissa bits of fine-tuned ONNX model weights [P]](https://external-preview.redd.it/xL20TWLoDXtutsGuMHS1qdEyNEn6zkliHGGNaYV1H4A.png?width=640&crop=smart&auto=webp&s=2b035893689551e28412391b858ab5c0323b052d)



