Neurosymbolics for Data Engineering: Achieving Long Context Token Reduction Without Finetuning
This paper introduces a novel drop-in neurosymbolic layer designed to seamlessly integrate into existing LLM backbones enhancing logical reasoning and mitigating long-context resource consumption, and repurposes this approach to address the severe computational strain of long context inference.