Skip to content
#explainable ai Open access

RESEARCH ARCHITECTURE AND REPRODUCIBILITY GUIDE

Oct 2026 · Zenodo (CERN European Organization for Nuclear Research)
Ethics and Social Impacts of AI

Abstract

Abstract This guide presents a practical framework for navigating, evaluating, and extending the Citizen Auditing — Open Methodology, Evidence & Digital Systems Research collection. The collection brings together methodological protocols, datasets, technical specifications, presentations, institutional communication records, and research frameworks addressing citizen auditing, institutional observation, digital evidence, research provenance, forensic log translation, and AI accountability. Rather than treating these outputs as isolated publications, this guide explains how their distinct functions and documented relationships can be understood within an evolving research architecture. The guide distinguishes nine methodological functions: OBSERVE, RECORD, PUBLISH, NOTIFY, ACKNOWLEDGE, RESPOND, VERIFY, COMPARE, and LEARN. It emphasizes source attribution, chronology, version awareness, transparent documentation, reproducibility, and the separation of direct observations from interpretations and causal claims. Particular attention is given to the complementary intended roles of the OBSERVE Protocol, the Algorithmic Accountability and Audit Protocol (AAAP), IIIO, Citizen Auditing, Algorithmic Ballistics, the 0-Reach Paradox methodology, and research provenance documentation. The guide also proposes criteria for incorporating future publications while preserving methodological coherence and making relationships between research outputs traceable. This publication is a methodological and navigational reference, not a claim that all components have been independently validated, successfully replicated, or adopted by institutions. It identifies practical evaluation questions, acknowledges limitations, and encourages independent scrutiny, replication where feasible, and further methodological development. Purpose and scope The guide is intended for researchers, research groups, archivists, auditors, and other practitioners interested in transparent observation, research provenance, digital evidence, institutional accountability, and responsible AI research. It provides a common framework for identifying relevant research components, tracing their supporting records, examining their methods, documenting adaptations, and evaluating results independently. It also describes principles for recording version changes and incorporating future publications without obscuring the collection's methodological development. The framework remains open to critical examination and revision. Its proposed evaluation criteria should not be interpreted as evidence that every component already meets those criteria in every research context. Relationship to the research collection This publication serves as a navigation and methodological reference for the Citizen Auditing — Open Methodology, Evidence & Digital Systems Research collection. It complements individual protocols, technical specifications, datasets, presentations, and case-oriented materials by describing their intended functions and the principles through which their relationships may be documented. Readers should consult the relevant underlying publications and supporting records when evaluating specific methods or claims. Limitations The guide does not independently validate every publication, dataset, institutional interaction, or technical claim referenced in the collection. The availability of a DOI does not establish the correctness of a claim, and institutional acknowledgement or subsequent events do not by themselves demonstrate causation or research impact. The feasibility of replication and independent verification depends on the availability of source materials, documented procedures, applicable access restrictions, and appropriate safeguards for privacy, confidentiality, and data protection. Suggested citation Yazargan, E. (2026). Research Architecture and Reproducibility Guide: A Practical Framework for Citizen Auditing, Institutional Observation, Digital Evidence, and AI Accountability (Version 1.0). Zenodo. DOI: to be assigned upon publication.

View source

Similar papers

#artificial intelligence Conference Open access Apr 2020

ECCOLA - a Method for Implementing Ethically Aligned AI Systems

The method, ECCOLA, is presented, which aims at making the high-level AI ethics principles more practical, making it possible for developers to more easily implement them in practice.

Ville Vakkuri, Kai-Kristian Kemell, P. Abrahamsson · 64 citations · ⚡6
#computer vision Review Apr 2024

AI-powered Code Review with LLMs: Early Results

The goal is to not only refine the accuracy of the LLM-based tool but also to underscore its potential in streamlining the software development lifecycle through proactive code improvement and education.

Z. Rasheed, Malik Abdul Sami, Muhammad Waseem et al. · 62 citations · ⚡3
#computer vision Open access Mar 2024

LLM-based agents for automating the enhancement of user story quality: An early report

The use of large language models to automatically improve the user story quality in Austrian Post Group IT agile teams is explored, with a reference model for an Autonomous LLM-based Agent System developed and implemented at the company.

Zheying Zhang, M. Rayhan, Tomas Herda et al. · 48 citations · ⚡4
#computer vision Review Mar 2024

System for systematic literature review using multiple AI agents: Concept and an empirical evaluation

This paper introduces a novel multi-AI-agent system designed to fully automate SLRs, and demonstrates how it substantially reduces the time and effort traditionally required for SLRs while maintaining comprehensiveness and precision.

Abdul Malik Sami, Z. Rasheed, Kai-Kristian Kemell et al. · 44 citations · ⚡2
#computer vision Feb 2024

Can Large Language Models Serve as Data Analysts? A Multi-Agent Assisted Approach for Qualitative Data Analysis

The proposed LLM-based multi-agent system automates qualitative data analysis process, creating opportunities for researchers and practitioners, and future improvements focus on enhancing multilingual performance and integrating continuous expert feedback.

Z. Rasheed, Muhammad Waseem, Aakash Ahmad et al. · 41 citations
#artificial intelligence Conference Open access Jun 2018

The Key Concepts of Ethics of Artificial Intelligence

It is suggested that the focus on finding keywords is the first step in guiding and providing direction for future research in the AI ethics field.

Ville Vakkuri, P. Abrahamsson · 39 citations · ⚡2

Related blog posts

MIT News · Artificial Intelligence Oct 15, 2026

AI model decodes the language cells use to communicate

A new computational approach reveals how cells communicate to assemble into tissues. This could accelerate stem cell engineering, improve disease models, and inform therapies.

We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.