math
Can Quantization Reduce Separability?
Originally published: November 29, 2025 Yes. I was recently experimenting with the linear separability of quantized embedding vectors, and produced a graph which indicated the embeddings were substantially more linearly separable than the quantized embeddings. A commenter indicated that this didn't make sense, as they thought the quantized