Preliminary results indicate performance differences across LLMs, suggesting that model choice influences coverage, consistency, and hallucination rates.
Malik Abdul Sami, Gessé Evangelista, Kai-Kristian Kemell et al.· AGENT@ICSE· 0 citations
LLM-based multi-agent systems can support strategic AI planning by enabling iterative refinement with human experts by supporting structured and collaborative Requirements Engineering processes for AI adoption planning.
Malik Abdul Sami, Zheying Zhang, Muhammad Waseem et al.· e-Informatica Software Engin...· 6 citations
This work introduces REFINE (Refactoring with Evidence-aware Flow for Integrated ageNtic Execution), a tool-agnostic, evidence-aware multi-agent approach for generating Java file-level refactoring candidates that achieves a higher median code-smell reduction with smaller edits and fewer public-method removals.
Muhammad Waseem, Aakash Ahmad, Pekka Abrahamsson· 0 citations
An Evaluation Agent, middleware that combines Natural Language Inference factual verification, a five-signal poison detector with relevance-weighted aggregation, and a Trust Index is proposed, which reliably blocks instruction injection of unsafe advice while contradiction and subtle semantic weakening remain hard.
Balkrishna Giri, M. Hasan, Jussi Rasku et al.· 0 citations
Reach audiences
Advertise in front of researchers, engineers, and readers.
These findings show that reliable evaluation of LLM-generated code requires validated ground truth, protected tests, and multiple explicitly interpreted measures, and that CodeAssay provides a reproducible basis for evidence-based model evaluation in AI-augmented software development.
Shahbaz Siddeeq, Muhammad Waseem, Umar Subhan Malhi et al.· 0 citations
Post-training alignment is often shallow, eroding under fine-tuning. It remains untested as to whether constitutional midtraining interventions can produce durable alignment when cleanly isolated from post-training. We build a 394M-token constitutional corpus from Anthropic's Constitution and apply constitutional midtr...
D. Cho, Cameron Tice, Bernie Hogan et al.· arXiv.org· 3 citations