Skip to content

Author

Xi-Ming Dong

1 paper indexed here

We haven’t gathered this author’s papers yet. Follow them and we’ll fetch their work.

Not the right person? Other researchers publish under this name.

Beyond Tokens: Semantic-Aware Speculative Decoding for Efficient Inference by Probing Internal States

SemanticSpec introduces a semantic probability estimation mechanism that probes the model's internal hidden states to assess the likelihood of generating sequences with specific meanings, and proposes SemanticSpec, a semantic-aware speculative decoding framework that verifies entire semantic sequences instead of tokens...

Xi-Ming Dong, Shao-Wei Wang, Dayi Lin et al. · 3 citations

We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.