Which setup did you use? MLX/GGUF, Quant, Engine (e.g. llama.cpp or MTPLX, etc)?... | Hacker News

Hacker Newsnew | past | comments | ask | show | jobs | submit

terhechte 33 days ago | parent | context | favorite | on: Qwen 3.8 27B

Which setup did you use? MLX/GGUF, Quant, Engine (e.g. llama.cpp or MTPLX, etc)? There’s so much variety these days.

dexterlagan 33 days ago [–]

It was in LMStudio (llama.cpp), Q4 by Unsloth. Applied the recommended defaults published by Unsloth.

Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact