Multi-model build?

[yajo]

The readme includes these build instructions:

BitNet/README.md

Lines 193 to 199 in 404980e

	3. Build the project
	```bash
	# Manually download the model and run with local path
	huggingface-cli download microsoft/BitNet-b1.58-2B-4T-gguf --local-dir models/BitNet-b1.58-2B-4T
	python setup_env.py -md models/BitNet-b1.58-2B-4T -q i2_s
	```

Does that mean that we have to recompile BitNet for each model?

Is there no way to get a single binary that can run all 1.58 bit models?

Thanks!

[azmatsiddique]

bitnet.cpp is based on the llama.cpp framework and is optimized specifically for text-only inference with specialized kernels for 1-bit matrix operations

[yajo]

OK yes, but do we have to recompile it for each model?