I. Bessmertny

Real-time NLP moderation on XMPP with GPU-accelerated inference and adaptive batching

Real-time communication platforms generate continuous streams of short, latency-sensitive messages, creating a demanding environment for automated toxicity detection. Transformer-based language models offer strong contextual accuracy, but their inference cost makes them difficult to deploy efficiently in decentralized...