Tools Archives - Jordi Driesen

Question 1

What hardware do I need to run Bonsai 2 27B?

Accepted Answer

An 8GB dedicated GPU is enough, I tested it on an HP ZBook with exactly that and it ran without issue. Running it in RAM without a GPU works but is far too slow for real use, so the GPU isn't optional if you want this to be a practical tool.

Question 2

Is Bonsai 2 27B as good as the full-precision Qwen3.8-27B?

Accepted Answer

On PrismML's own benchmark suite it retains 98.2% on average, but that figure hides a real split: instruction-following and coding stay close to full precision, while long-horizon agentic tasks like Terminal-Bench and SWE-bench drop to roughly three-quarters of the original score.

Question 3

What is Bonsai 2 27B not good at?

Accepted Answer

Long, multi-step agentic tasks that need to hold context and reasoning across many turns. Independent benchmarks show a real gap there. For short, well-scoped jobs like image description or simple copywriting, it holds up well.

Question 4

Can I use Bonsai 2 27B commercially?

Accepted Answer

Yes. It ships under an Apache-2.0 licence, so commercial use, modification, and redistribution are all permitted without asking PrismML's permission. Note that running it does require PrismML's own llama.cpp fork, since stock llama.cpp doesn't support the ternary file formats.

Tool Log

Bonsai 2 27B: a 6GB model that runs on a laptop GPU

Connector.wtf, the easiest way into MCPs for marketers who aren’t developers

Why speech-to-text is the most overlooked AI unlock

OpenSEO, the $10 SEO tool I actually use

Want to talk work, coffee or anything else?