Tag: 1-bit quantized Large Language Models

On October 17, 2024, Microsoft introduced BitNet.cpp, an inference framework designed to run 1-bit quantized Massive Language Fashions (LLMs). BitNet.cpp ...