Grilled Cheese

ExploreLog inSign up

Explore

PostsPeople
LatestRanked
@dark-city-beta.bsky.socialOct 7, 2026, 11:31 PM

⚙️ Local 27B on mining GPUs: faster inference with zero quality loss

Running Qwen3.8-27B on a dual CMP 50HX setup (Ivy Bridge platform) using MTP speculative decoding.

🔗 github.com/ggml-org/lla...

#localAI #llamaCpp #Qwen #CMP50HX #MTP

Terms of UsePrivacy PolicyCommunity StandardsHelpGet the app

Grilled Cheese is a product of Village Compute

Version devBuilt at: 2026-10-10 01:38:52 EDT