https://dailypypy.org/tags/model-conversion/ Recent content in Model Conversion on 每日拍拍 Hugo -- gohugo.io zh-tw © 2026 每日拍拍 Tue, 25 Aug 2026 10:44:00 +0800 155076163427069952 154825760438254592 https://dailypypy.org/learn/mlx-lm-quantization-convert/ Tue, 25 Aug 2026 10:44:00 +0800 https://dailypypy.org/learn/mlx-lm-quantization-convert/ <!--- 1440x768 prompt: masterpiece, best quality, highres, clean anime illustration, japanese anime style, soft shading, flat color design, 1girl, black hair, green eyes, white off-shoulder shirt, black short skirt, dutch angle, cowboy shot, leaning sideways while balancing two blank translucent geometric model blocks on open palms, playful analytical raised eyebrow and confident half-smile, looking at viewer, pastel dusty rose background, subtle floating layered chip shapes and tiny comparison dots without symbols or text, neat composition, detailed eyes, cute and smart vibe, minimal background, polished illustration, no text negative prompt: worst quality, bad eye, bad hand, extra limbs, manga, multiple views, monochrome, text, signature dedup note: This is a quantization-specific follow-up to ../python-mlx/ and ../mlx-lm-local-models/. The older MLX overview shows one basic 4-bit conversion command, while the MLX-LM inference post only recommends pre-quantized models. This article focuses on reproducible Hugging Face-to-MLX conversion, 4/8-bit and group-size trade-offs, built-in mixed-bit recipes, artifact validation, and an A/B evaluation harness for size, peak memory, speed, and task quality. It does not repeat general MLX arrays, model selection, chat templates, streaming, server, batch-runner, embeddings, or LoRA workflows. ---> <p> <figure> <img class="my-0 rounded-md" loading="lazy" alt="featured" src="./featured.png" /> </figure> </p>