Approaching the Memory-Bandwidth Ceiling: Three As-Deployed LLM Inference Stacks on a 128 GB Unified-Memory APU
Single-node measurement note. Two-day campaign measuring three as-deployed LLM inference stacks (model + runtime + quantization: Qwen3.8-Flash-Next on halogen, GLM-5.3 on ExLlamaV3, DeepSeek-V4-Flash on ember) on one 128 GB unified-memory AMD Ryzen AI Max+ 395 node, under one measurement contract and one frozen corpus....