PyTorch implementation of TRIAD-PTQ (Trace-Router-Interaction-Aware Decomposition) — weight-only INT3/INT4 PTQ for compact LLMs and edge CNNs/ViTs, with real benchmarks on SmolLM/TinyLlama/MobileNetV2/EfficientNet-B0/MobileViT-S.
pytorch mps quantization model-compression mobilenet efficient-inference edge-ai post-training-quantization apple-silicon vision-transformer int4 ptq llm gptq weight-only-quantization
-
Updated
May 5, 2026 - Python