Skip to content
#large language models Dataset Open access

Dataset and experimental materials for evaluating LLM reliability in transport planning

Oct 2026 · Zenodo (CERN European Organization for Nuclear Research)

Abstract

This dataset contains the experimental materials for a study on whether publicly accessible conversational large language models (ChatGPT, Claude, Gemini and Microsoft Copilot) can generate road freight driver schedules that comply with EU driving-time and rest-period rules (Regulation (EC) No 561/2006 and Regulation (EU) No 165/2014). A single international freight transport scenario was tested at four levels of prompt structuring, from an open-ended instruction to a highly controlled prompt with explicit rules, fixed assumptions and a prescribed output format. The dataset includes: the shared transport scenario used in all experimental conditions; the exact system-level and user-level prompts for each of the four prompt levels; execution metadata for each test, including platform, model version and run details; the complete, unedited responses generated by the evaluated models (64 responses in total). The tests were run between February and June 2026 in private or history-disabled chat modes. The materials are provided to support transparency, independent verification and replication of the reported findings.

View source

Similar papers

#computer vision Open access Jun 2016

Software Development in Startup Companies: The Greenfield Startup Model

The results are packaged in the Greenfield Startup Model (GSM), which explains the priority of startups to release the product as quickly as possible, and the need to shorten time-to-market, by speeding up the development through low-precision engineering activities.

Carmine Giardino, Nicolò Paternoster, M. Unterkalmsteiner et al. · 178 citations · ⚡14
#computer vision Open access Oct 2016

Software Startups - A Research Agenda

Software startup companies develop innovative, software-intensive products within limited timeframes and with few resources, searching for sustainable and scalable business models.

M. Unterkalmsteiner, P. Abrahamsson, Xiaofeng Wang et al. · 157 citations · ⚡17
#machine learning Review Open access Oct 2016

“Failures” to be celebrated: an analysis of major pivots of software startups

This study conducts a case survey study based on the secondary data of the major pivots happened in 49 software startups, and demonstrates that customer need pivot is the most common among all pivot types.

Sohaib Shahid Bajwa, Xiaofeng Wang, Anh Nguyen-Duc et al. · 127 citations · ⚡15
#computer vision Review Open access May 2015

A survey study on major technical barriers affecting the decision to adopt cloud services

The comparison of adopter and non-adopter sample reveals three potential adoption inhibitor, security, data privacy, and portability, which underlines the importance of the technical and security perspectives for research investigating the adoption of technology.

Nattakarn Phaphoom, Xiaofeng Wang, S. Samuel et al. · 111 citations · ⚡8
#computer vision Conference Open access Dec 2013

Affordable and Energy-Efficient Cloud Computing Clusters: The Bolzano Raspberry Pi Cloud Cluster Experiment

The ongoing work building a Raspberry Pi cluster consisting of 300 nodes is presented, with potential use cases being an inexpensive and green test bed for cloud computing research and a robust and mobile data center for operating in adverse environments.

P. Abrahamsson, S. Helmer, Nattakarn Phaphoom et al. · 110 citations · ⚡7
#computer vision Review Open access May 2017

Are Software Startups Applying Agile Practices? The State of the Practice from a Large Survey

The findings show that speed related agile practices are used to a greater extent in comparison to quality practices, and that software startups who adopt the Lean Startup approach do not sacrifice quality for speed more than other startups do.

Jevgenija Pantiuchina, Marco Mondini, Dron Khanna et al. · 84 citations · ⚡4

Related blog posts

MIT News · Artificial Intelligence Oct 15, 2026

AI model decodes the language cells use to communicate

A new computational approach reveals how cells communicate to assemble into tissues. This could accelerate stem cell engineering, improve disease models, and inform therapies.

Microsoft Research Blog Oct 15, 2026

Proof-based general-purpose computing with Magnetar

Zero-knowledge proofs can verify computing results without rerunning workloads or exposing sensitive data. Magnetar helps bring them into the mainstream with support for standard programming languages, major speed gains, and quantum-resistant security. The post Proof-based general-purpose computing with Magnetar appeared first on Microsoft Research.

We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.