Skip to content
#software testing Book Open access

When Delivery Meets Error: Exploring Email Delivery Retry Strategies and Defects

Oct 2026 · Proceedings of the 2026 ACM Internet Measurement Conference · 0 citations · 14 references

TL;DR

This work deploys a platform (RetryWatch) that simulates various types of bounce errors returned by email receiving servers, covering the DNS, TCP, and SMTP communication stages and finds that many providers and software exhibit defects in their email retry implementations.

Abstract

Reliable delivery is a basic expectation of email services. The increasingly complex ecosystem has led to more frequent email bounces. When encountering various errors, properly handling failures and retrying are crucial to ensuring email deliverability. Currently, the community lacks a comprehensive understanding of email retry strategies, and bridging this gap can enhance the reliability of email services. In this paper, we measure the email delivery retry strategies of 11 email service providers and 8 open-source email software. We deploy a platform (RetryWatch) that simulates various types of bounce errors returned by email receiving servers, covering the DNS, TCP, and SMTP communication stages. We find that many providers and software exhibit defects in their email retry implementations. For example, we find that six email systems exhibit poor load balancing across MX record entries in dual-stack environments. In addition, when encountering blocklist- and greylist-related SMTP error messages, most email providers fail to handle retries appropriately. We release RetryWatch to support further testing by the email community. We hope this work helps improve email reliability and inspires efforts to refine email retry strategies.

Read PDF

Similar papers

#artificial intelligence Preprint Sep 2026

EmailBench: A Benchmark for Evaluating LLM Agents on Enterprise Email and Productivity Tasks

EmailBench is introduced, a benchmark of 206 email and productivity scenarios across 16 task categories that couples a typed email API specification with provider-neutral naming, a deterministic synthetic Enron-inspired corpus, and a scenario suite whose topic selection was informed by aggregate task-intent telemetry f...

Mukul Singh, Mansi Uniyal, Devin Devlin et al. · 0 citations
Open access Aug 2026

Retry Amplification in Distributed Systems: A Systematic Analysis of Retry Policies and Their Role in Cascading Failures

The retry amplification factor (RAF) is introduced, a metric quantifying the additional request volume that retry policies generate during partial failures, and it is shown that budget-constrained retries maintain success rates close to the no-retry baseline while still recovering from transient faults.

Rishabh Mehan, Jasmit Saluja · 1 citation
Preprint Aug 2026

Outcome Monitors: Recovery Affordances for Silent Tool Failures

Outcome Monitors, which detect violations of outcome contracts mined from task-disjoint traces or derived from public schemas, are introduced, which detect violations of outcome contracts mined from task-disjoint traces or derived from public schemas.

Sugam Panthi, Rabab Abdelfattah · 2 citations
Conference Open access Sep 2026

83% Faster, 10x Fewer Errors: Engineering a Self-Healing Payment Saga Tracker

This paper describes the re-architecture of a distributed payment system around an event-driven saga pattern, tracking transactions from initiation through settlement and automatically triggering compensations when a step fails. The results are given directly: transaction processing time fell by 83 per cent, payment er...

Tarun Kumar Chatterjee · 0 citations

Related blog posts

Microsoft Research Blog Nov 12, 2026

Microsoft Research Focus – Edition #98

What's new in research at Microsoft? Host Anson Ho explores the latest, including AI-powered universal translation, a breakthrough in a 31-year-old mathematics challenge, and advances making AI coding agents faster and more efficient.  The post Microsoft Research Focus – Edition #98 appeared first on Microsoft Research.

Microsoft Research Blog Nov 5, 2026

Formally verifying agent-written full-stack web apps with PDD Kit

AI agents can generate code at a scale that’s hard for humans to review line-by-line. PDD Kit helps ensure the code is doing what the developer intended by creating formal specifications and testing against them. It converts developer intent into a Verus specification, proves AI-generated code meets it for every input, and uses tests where proofs aren't practical. Developers review intent, not every line. The post Formally verifying agent-written full-stack web apps with PDD Kit appeared first o…

We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.