It is shown that a misaligned model can perform inference engine fingerprinting to determine the specific engine (e.g., vLLM, SGLang) which executes the model, and several ways that inference engines could be changed to make fingerprinting attacks more difficult are discussed.
Sarah Radway, Andrew Cheng, V. Reddi et al.· 0 citations
SQD (SubQuadratic Disaggregation), a fine-grained heterogeneous disaggregation scheme that splits decode by quadratic and subquadratic attention rather than by operator type, and that applies across subquadratic attention variants is introduced.
This work presents Affective Agent, a three-layer reference architecture for personalized intervention reasoning under uncertainty on wearable-class hardware that combines a compact sub-billion-parameter language model with physiological evidence, context, and user history to decide whether to intervene, without cloud...
R. Mun, Zi-Shen Wan, V. Reddi· IEEE Internet Computing· 0 citations
We use cookies to run the site and, with your consent, for analytics and to show ads.
See our Cookie Policy.