Skip to content
#generative ai Open access

Structured Work Samples and Interviews as Alternatives to Degree Screens Under AI-Contaminated Assessment

Oct 2026 · Zenodo (CERN European Organization for Nuclear Research)
Names, Identity, and Discrimination Research

Abstract

Generative AI complicates the inference that assessed academic work provides evidence of individual competence, but removing degree requirements may shift selection toward discretionary interviews, referrals, or network advantage. We develop a stylized simulation of screening for non-licensed occupations in which employers choose among degree-only, interview-only, degree-plus-interview, degree-plus-work-sample, work-sample-only, direct-hybrid, all-signal augmented-hybrid, and network-fallback regimes. Across 600 design scenarios with 5,000 synthetic applicants each, signal validity, AI contamination, degree costs, direct-assessment bias, direct-signal dependence, referral inequality, and hire rates vary over literature-informed ranges. The direct-hybrid regime combining work samples and structured interviews maximized a performance-equity objective in 40.5 percent of scenarios, followed by the all-signal augmented hybrid in 26.7 percent and work-sample-only screening in 21.2 percent. The direct hybrid exceeded degree-plus-interview screening on the objective in 92.7 percent of scenarios and degree-plus-work-sample screening in 83.3 percent, but exceeded the all-signal augmented hybrid in only 60.2 percent. Sensitivity checks show that the direct-hybrid advantage largely disappears when direct and degree signals have matched validity, high dependence, and no modeled group penalties. The model supports a conditional claim: degree-free reform depends on structured, job-relevant, accessible evidence rather than informal networks or costly, biased, duplicative assessments.

View source

Similar papers

#artificial intelligence Conference Open access Apr 2020

ECCOLA - a Method for Implementing Ethically Aligned AI Systems

The method, ECCOLA, is presented, which aims at making the high-level AI ethics principles more practical, making it possible for developers to more easily implement them in practice.

Ville Vakkuri, Kai-Kristian Kemell, P. Abrahamsson · 64 citations · ⚡6
#computer vision Review Apr 2024

AI-powered Code Review with LLMs: Early Results

The goal is to not only refine the accuracy of the LLM-based tool but also to underscore its potential in streamlining the software development lifecycle through proactive code improvement and education.

Z. Rasheed, Malik Abdul Sami, Muhammad Waseem et al. · 62 citations · ⚡3
#computer vision Open access Mar 2024

LLM-based agents for automating the enhancement of user story quality: An early report

The use of large language models to automatically improve the user story quality in Austrian Post Group IT agile teams is explored, with a reference model for an Autonomous LLM-based Agent System developed and implemented at the company.

Zheying Zhang, M. Rayhan, Tomas Herda et al. · 48 citations · ⚡4
#computer vision Review Mar 2024

System for systematic literature review using multiple AI agents: Concept and an empirical evaluation

This paper introduces a novel multi-AI-agent system designed to fully automate SLRs, and demonstrates how it substantially reduces the time and effort traditionally required for SLRs while maintaining comprehensiveness and precision.

Abdul Malik Sami, Z. Rasheed, Kai-Kristian Kemell et al. · 44 citations · ⚡2
#computer vision Feb 2024

Can Large Language Models Serve as Data Analysts? A Multi-Agent Assisted Approach for Qualitative Data Analysis

The proposed LLM-based multi-agent system automates qualitative data analysis process, creating opportunities for researchers and practitioners, and future improvements focus on enhancing multilingual performance and integrating continuous expert feedback.

Z. Rasheed, Muhammad Waseem, Aakash Ahmad et al. · 41 citations

Related blog posts

Microsoft Research Blog Nov 5, 2026

Formally verifying agent-written full-stack web apps with PDD Kit

AI agents can generate code at a scale that’s hard for humans to review line-by-line. PDD Kit helps ensure the code is doing what the developer intended by creating formal specifications and testing against them. It converts developer intent into a Verus specification, proves AI-generated code meets it for every input, and uses tests where proofs aren't practical. Developers review intent, not every line. The post Formally verifying agent-written full-stack web apps with PDD Kit appeared first o…

Microsoft Research Blog Nov 3, 2026

Learn the rules: The hacker mindset

Research Manager Mike Walker reflects on a career spanning hacker culture, cybersecurity, and AI, sharing lessons about trust, teamwork, leadership, and why solving difficult problems requires curiosity, judgment, agility—and an understanding of the rules. The post Learn the rules: The hacker mindset appeared first on Microsoft Research.

We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.