Yeah, a higher quant would be nice, I actually try not to go below Q5, but you can domino’s so much with 16GB of VRAM and the ddr4 system RAM.

But I must say I‘m pretty impressed by Qwen3.6-35b, not only from its capabilities but also from hardware requirements. MoE for the win I guess.

RWKV sounds interesting, have to look into it, thanks!

Yeah, I wouldn’t use it for coding. It’s a bit dumb unfortunately.

Looping was a problem after reaching a certain context window size. The llama.cpp flags - -flash-attn on and looping penalties helped.

I‘m not a coder, so I don’t know exactly. It is able to code, but I would say somebody with experience should guide it and have an eye on the results.

Have you tried qwen3.5-9b? It’s pretty solid for its size.

I don’t host it exactly, just use it when I don’t use my graphics card for gaming. I run Qwen3.6-35b on my 16gb vram RX 9700 xt with 34t/s. I use it as an IT advisor, admin and Linux teacher for my cachyOS gaming PC.

Was listening to some computer podcast a while ago and the co-host and ex- hacker was saying that more and more VPNs are getting targeted and it’s just a matter of time we see quite a bit of them owned. (I think he was talking about implementation of VPNs for remote workers, rather than actual VPN providers. Sorry, it was some time ago)

Anyway, the host asked „What about wireguard?“

And the co-host: „Oh yeah, wireguard is solid! But all the services building up on wireguard? … They’ll get popped.“

Doesn’t have to be true, but something to keep in mind.