Skip to main content
NJannasch.Dev

Blog

AIHomelabProxmoxllama.cppBenchmarking

RTX 5090 AI Box on a GMKtec Proxmox Host: LXC, 160K Context, and 150 t/s Local Qwen

What it took to run an AORUS RTX 5090 AI Box over USB4 on a GMKtec Proxmox mini PC without giving up an existing OCuLink GPU: host driver quirks, an NVIDIA-enabled LXC, a source-built llama.cpp, and measured Qwen 3.8 results.

· 10 min read Fast AI, Real Risks · Part 19
AIHomelabllama.cppBenchmarking

Qwen 3.8 27B on a 5060 Ti: 64 t/s Local Coding and a Car Configurator That Actually Works

Qwen 3.8 27B Dense, IQ3_XXS, MTP, and 96K active context on a 16 GB RTX 5060 Ti. Benchmarks, a finished interactive car configurator, and the exact llama.cpp configuration.

· 5 min read Fast AI, Real Risks · Part 18
OpenWrtNetworkingMobile WorkHomelabAntigravity CLI

Beryl AX OpenWrt Mobile Office Router with Antigravity CLI

Pixel 8 USB tethering, Mobile_Net Wi-Fi, SQM, encrypted DNS and adblock on a GL.iNet Beryl AX, set up with Antigravity CLI.

· 7 min read
AISecurityAgentsHomelab

Sandboxing AI Agents: Kernel-Level Isolation with nono and Landlock

AI agents have terminal access, network calls, and file operations. Here's how I lock them down with OS user isolation, Landlock kernel sandboxing, and nono. and where the gaps still are.

· 11 min read Beyond the Chat Window · Part 5
AIHomelabAgentsLocal-FirstMCP

From Vibe Coding to AI Agent: My Local Qwen 3.6 Now Runs 24/7

Built a local AI agent with Hermes on Qwen 3.6 MTP at 125 t/s. From benchmarking to vibe coding to a 24/7 autonomous agent. no API costs.

· 9 min read Beyond the Chat Window · Part 4
AIHomelabllama.cppBenchmarking

Gemma 4 MTP vs Qwen 3.6: Same GPU, Different Speedups

Gemma 4 MTP hits 133 t/s (1.32x) vs Qwen's 144 t/s (1.47x) on an RTX 5060 Ti. The 441 MB drafter looks light but compute buffers eat the savings.

· 4 min read Fast AI, Real Risks · Part 11