Parameters Efficient Language Model with Latent Cross-Attention for IoT Intrusion Detection

Language models have shown strong potential for intrusion detection, but their high memory and computational demands make them difficult to deploy in resource-constrained IoT environments. In this work, we propose a compact Transformer-based architecture that compresses the input into a small...