This work presents a framework for accelerating transformer-based language models (LMs) on resource-constrained IoT devices. The framework targets compact LMs: BERT-Tiny (B-Ty), MobileBERT (M-Bt), MiniLM (M-Lm), Electra (E-Lt) and DeBERTa (D-Bt) -- selected for their architectural diversity and use in edge inference sc...
M. AjayKumar, PS Vishnu, Yi-Ke Li et al.· 0 citations
Sparse attention mechanisms have become increasingly important for transformer models processing long input sequences due to their lower computational and memory complexity compared to full self-attention. Longformer achieves this through a sliding-window attention mechanism that produces a structured banded sparse att...
Phillip Pramberger, Athanasios Tziouvaras, Shreejith Shanker et al.· 0 citations
The combination of increasing connectivity to the outside world and the lack of inbuilt security mechanisms has made legacy intra-vehicular networks extremely vulnerable to cyberattacks. Consequently, significant research has been devoted to analysing the impact of potential attacks, yielding datasets crucial for devel...
Shashwat Khandelwal, Shreejith Shanker· ACM Transactions on Embedded...· 0 citations
FINNAS is presented, a FINN-guided hardware-aware evolutionary neural architecture search framework that jointly searches quantised MLP depth, width, and global precision settings, and ranks candidates using proxy validation accuracy together with FINN-estimated LUT usage and latency under a fully parallel mapping.
Eva Chauffour, Chang-Hong Li, G. Floros et al.· 0 citations
Power Delivery Networks (PDNs) are critical components of modern VLSI chips, providing stable voltage levels while satisfying electromigration (EM) and IR-drop constraints. Conventional PDN design methodologies typically rely on worst-case assumptions, often resulting in over-provisioned networks and inefficient use of...
Oran Hayes, Maria Pantazi-Kypraiou, Athanasios Tziouvaras et al.· 0 citations
Graph Convolutional Networks (GCNs) have emerged as a powerful framework for learning from graph-structured data, yet their deployment on resource-constrained edge platforms remains challenging due to the computational and memory demands of sparse graph aggregation. This work presents an FPGA-based GCN accelerator that...
Nathaniel Kaye Mellor, Shreejith Shanker, G. Floros· 0 citations
This work presents a machine learning-based IDS implemented within an FPGA-based SmartNIC pipeline, integrating P4-based packet parsing with a LogicNets IDS model implemented in RTL, enabling deterministic, low-latency inference.
Nise O'Cuill, Chang-Hong Li, Georgios Floros et al.· 0 citations
This paper proposes an Efficient Broad Learning (EBL) framework for distributed adaptive harmonic estimation, a quantised FPGA acceleration framework for BLS-style harmonic estimation that offers high-accuracy estimation with half-cycle input, reconfigurable flexibility enabled by the FPGA implementation, and ultra-low...
Chang-Hong Li, Georgios Floros, B. Basu et al.· 0 citations
We use cookies to run the site and, with your consent, for analytics and to show ads.
See our Cookie Policy.