We propose GraceSSD, a per-file storage abstraction that exposes the inherent error resilience of modern machine learning (ML) applications to the underlying flash device. GraceSSD lets an application attach a lightweight resilience hint to each file through the standard extended-attribute (xattr) interface, declaring...
Seung-Kwan Kang, Hyungseok Ko, Hyun Dong Lee et al.· Proceedings of the 18th ACM...· 0 citations
Designing expressive sequence layers with efficient inference remains a central challenge in modern machine learning. Standard softmax attention achieves excellent sequence modeling performance through rich nonlinear token interactions, but it requires a key-value cache that grows linearly with sequence length, limitin...
Hyun Dong Lee, X. Gonzalez, Nicolas Zucchet et al.· 0 citations
This work identifies a curse of ambiguity: in large language models, and more broadly in all neural networks that produce discrete probability distributions, the more ambiguous a next-token distribution is, the harder it is to learn accurately.
Nicolas Zucchet, Hyun Dong Lee, Scott W. Linderman· 2 citations
We use cookies to run the site and, with your consent, for analytics and to show ads.
See our Cookie Policy.