Skip to content

"A Second Set of Eyes": The Process and Challenges of Software Documentation Review

Aug 2026 · 1 citation · ⚡ 1 influential · 131 references
Computer Science

TL;DR

The work identifies five distinct stages of the documentation review process: self review, technical review, editorial review, play testing, and post-publication feedback, and draws on practitioners with distinct expertise to address quality across content, presentation, and user experience.

Abstract

Organizations assign documentation work to technical writers, yet the knowledge required to produce it is distributed across developers, managers, and other practitioners. Prior work has established quality criteria for judging"good"documentation, but it has not examined how practitioners bring that expertise to improve documentation quality or the challenges they face in doing so. Through semi-structured interviews with experienced technical writers ($n=31$) from different organizations, our work reveals the individual and collaborative effort required to maintain documentation quality. We identify five distinct stages of the documentation review process: self review, technical review, editorial review, play testing, and post-publication feedback. Each stage draws on practitioners with distinct expertise to address quality across content, presentation, and user experience. Our findings surface organizational and technical challenges writers face in recruiting expert reviewers, navigating development timelines, and contending with tools not specifically designed for documentation workflows. Our work positions documentation review as a crucial yet understudied site of collaborative work and opens new research and design directions for process improvement and tool support.

View source

Similar papers

Book Open access Jul 2026

Malleable Interfaces for Reviewing Software Documentation

This thesis proposes malleable interfaces for documentation review, where practitioners reshape interfaces to fit their work rather than adapting to fixed tool interfaces, and proposes to build a review environment where practitioners describe interface needs in natural language, and the system generates views to accom...

Avinash Bhat · 0 citations
Aug 2026

Documentor mindsets: Considerations when contributing learning resources for software development technologies

A framework for describing documentor mindsets, and their associated considerations across the three dimensions is contributed, surface the need to reconsider existing perspectives of the documentation creation process, including the role of the documentor and metrics to measure documentation quality.

Deeksha M. Arya, Jin L. C. Guo, Martin P. Robillard · 1 citation
Book Open access Jul 2026

Peer Code Review in Research Software: Practices, Improvements, and Implementation Challenges from Interviews of RSEs

The results show that RSEs most often improved code review by using pull requests, defining review expectations, adding lightweight process steps, and using tools and automation to reduce effort and increase consistency.

Md. Ariful Islam Malik, Jeffrey C. Carver, Nasir U. Eisty · 0 citations
Review Open access Jul 2026

Supporting FAIR Practices In Scholarly Publishing with the Editorial Reference Handbook

The Editorial Reference Handbook assists scholarly publishers in supporting the sharing of digital research objects and in operationalising FAIR research practices by addressing gaps in editorial workflows, policy implementation and stakeholder alignment. Comprising a checklist, detailed guidance, and a flowchart...

Allyson L. Lister, Rebecca Taylor-Grant, M. Cannon et al. · 0 citations
Open access Mar 2025

LLMs’ reshaping of people, processes, products, and society in software development: a qualitative exploration with early adopters

Interviews with sixteen early-adopter software professionals who integrated LLM-based tools into their day-to-day work in early to mid-2023 offer actionable implications for developers, organizations, educators, and tool designers seeking to integrate LLMs responsibly into professional software practice.

Benyamin T. Tabarsi, Heidi Reichert, Sam Gilson et al. · 22 citations · ⚡1
Review Jul 2026

A Preliminary Search for Evidence on Government Software Engineering Practices: Results from Three Rapid Reviews

These findings are consistent with practitioners' perceptions that academic evidence on government SE practices has low visibility in mainstream SE venues and discuss implications including the need for dedicated publication venues, incentives for government academia collaboration, and improved methods for evaluating g...

Sebastián Pizard, Matías Porro, Andrea Muñoz et al. · 0 citations

Related blog posts

Microsoft Research Blog Oct 12, 2026

Simulating student learning for better AI tutoring

StudentSim is a research system for evaluating and improving AI tutoring tools before they are tested with learners. It models how individuals may engage with tutors, giving feedback to improve tutor performance across subjects like chess, writing, and mathematics. The post Simulating student learning for better AI tutoring appeared first on Microsoft Research.

MIT News · Artificial Intelligence Oct 2, 2026

Documenting the tech worker movement

Writing as a participant and researcher, PhD student JS Tan SM ’22 has co-authored a new book about the rise of tech worker protests and the employer backlash that followed.

MIT News · Artificial Intelligence Oct 2, 2026

Documenting the tech worker movement

Writing as a participant and researcher, PhD student JS Tan SM ’22 has co-authored a new book about the rise of tech worker protests and the employer backlash that followed.

We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.