Local AI is getting better. The past few weeks saw the release of several compact but powerful LLMs that make a great fit for foreign language content authoring (think worksheets and reading texts, with an even lower overhead!).
I’m using LM Studio to run these for content projects – you’ll find them all as easy downloads in the models tab. Make sure you have a bit of disk space and a fast connection – they range from 8 to nearly 20GB in size – then download and start prompting!
- Qwen3.8-27B — Alibaba / Qwen
Released 13–14 August 2026 · Apache 2.0 · ~27.8B parameters The freshest of the bunch, and arguably the pick of the litter for MFL content work. It’s the direct successor to the community-favourite Qwen3.6-27B, but now natively multimodal (text, images and video), with a 262K-token context window that stretches to 1M — plenty of headroom for feeding it whole set texts or past papers and asking it to generate comprehension exercises around them. Qwen also ships adjustable “reasoning effort,” handy for dialling compute up for tricky grammar explanations and down for quick vocab drills. - Muse Glimmer — Meta
Released 10 August 2026 · Apache 2.0 · 30B parameters Meta’s return to genuinely open weights, distilled down from their closed flagship Muse Spark 1.2. It’s pitched squarely at agentic, on-device workflows — think batch-generating worksheet sets, checking your own answer keys, or wiring up a local pipeline that self-corrects its output — and runs comfortably on a single consumer GPU or a beefy Mac. Covers 100+ languages, which is more than most of us need, but never hurts! - Bonsai 27B — PrismML
Released 14 July 2026 · Apache 2.0 · 27.8B parameters (1-bit / ternary) Now this is at the extreme end of “small”, and it’s attempting something quite novel. It’s an ultra-low-bit compression of Qwen3.6-27B — down to 3.9GB in its 1-bit form — small enough to run on a many portable devices (although I’ve not tried it on PocketPal yet), and comfortably on a laptop with room to spare. Quality takes a modest hit versus full-precision Qwen3.6-27B (PrismML’s own figures put it around 90% retention at 1-bit, better at the ~7GB ternary setting), so it’s more “worksheets on the train” than “your main authoring model,” but as a proof that 27B-class output now fits in your pocket, it’s a fun one to have installed.
A slightly older model that’s worth a mention alongside these is Qwen3.6-35B-A3B, a very efficient mixture-of-experts model that nominally has 35B parameters but only about 3B are active at any one time via a clever routing trick. It’s noticeably faster than Qwen3.8-27B for similar output quality in my own testing, and it’s been my workhorse for some time. It’s worth keeping an eye out for a future MoE version of 3.8 built the same way — that could be genuinely excellent.
Why Small Models?
Using smaller models locally addresses many of the environmental and privacy concerns around AI use. All the prompt compute happens privately on your local machine — no student data, no draft worksheets, no half-finished reading texts ever leave your laptop. And despite the tiny footprint, they’re still excellent at producing native-quality text across dozens of languages, which was frankly unthinkable on consumer hardware even a year ago.
None of these is going to replace a careful human eye on the final worksheet — but as first drafts, distractor generation, or a quick “give me five more sentences at this CEFR level,” they’re genuinely useful additions to the toolkit. Worth an afternoon of poking around, at the very least.
