Prompt Injection Attacks in LLM Systems
Large language models are increasingly integrated into systems that can retrieve information, call APIs, search databases, send messages, summarize documents, and take actions on behalf of users. These capabilities make LLMs useful, but they also increase the potential impact of LLM-related attacks. The post Prompt Injection Attacks in LLM Systems appeared first on GPT-Lab.
More from the blog
New AI “copilot” helps engineers design better structures
The system asks humans for feedback to increase trust in machine-generated designs for buildings and bridges.
Three Lincoln Laboratory technologies receive 2026 R&D 100 Awards
A secure operating system, a quantum microsystem platform, and a 5G interference-canceling algorithm are named among the year's most significant innovations.
LLMON: An LLM-Native Markup Language, now in Granite 4.1 3B and 8B
A Blog post by IBM Granite on Hugging Face
Lazare, veni foras: Reprogramming Dormant Neurons to Backdoor AI Agents
Microsoft researchers have discovered “Lazarus,” a backdoor technique that can reprogram dormant neurons in an AI model, causing an otherwise normal AI agent to execute malicious commands when a hidden trigger appears. The threat is especially serious for AI agents with tool or terminal access. A triggered model could quietly download and run attacker code, […] The post Lazare, veni foras: Reprogramming Dormant Neurons to Backdoor AI Agents appeared first on Microsoft Research.
Related papers
“Failures” to be celebrated: an analysis of major pivots of software startups
This study conducts a case survey study based on the secondary data of the major pivots happened in 49 software startups, and demonstrates that customer need pivot is the most common among all pivot types.
Lean Internal Startups for Software Product Innovation in Large Companies: Enablers and Inhibitors
This study investigates how Lean internal startup facilitates software product innovation in large companies and identifies its enablers and inhibitors, and shows the potential of the method-in-action framework to investigate the Lean startup approach in non-startup context.
AI-powered Code Review with LLMs: Early Results
The goal is to not only refine the accuracy of the LLM-based tool but also to underscore its potential in streamlining the software development lifecycle through proactive code improvement and education.
Are Happy Developers more Productive? The Correlation of Affective States of Software Developers and their self-assessed Productivity
An empirical study on the impact of affective states on software developers’ performance while programming and the value of applying psychometrics in Software Engineering studies is demonstrated and a call to valorize the human, individualized aspects of software developers is echoed.