Author

Hyungkyu Ham

h-index 4 View on Semantic Scholar

We have 2 of 8 papers

We haven’t gathered this author’s papers yet. Follow them and we’ll fetch their work.

Not the right person? Other researchers publish under this name.

Preprint Aug 2026

Heterogeneous LLM Serving with General-Purpose Processing-Near-Memory for Retrieval-Based Sparse Attention

A heterogeneous decode-phase serving system that relocates the KV cache out of GPU memory, motivated by the retrieval-based sparse attention that recent frontier LLMs adopt to serve million-token contexts and proposes KARAT, a general-purpose PNM design that is the design point meeting all four requirements.

Hyungkyu Ham, Junhyeong Bae, Seungheon Lee et al. · 1 citation

Open access Jul 2026

Exploring High-Bandwidth Flash for Modern LLM Inference: Opportunities and Challenges

Analysis of HBF-based LLM-serving systems under diverse system configurations and operating scenarios shows that HBF can significantly improve the batch size, throughput, and flexibility of LLM-serving systems while reducing the minimum GPU requirements, but realizing these benefits critically depends on sustaining HBM...

D. Son, Yonggon Park, Hyunuk Cho et al. · IEEE computer architecture l... · 2 citations