Skip to content

Author

Bruce A. MacDonald

We have 2 of 10 papers

We haven’t gathered this author’s papers yet. Follow them and we’ll fetch their work.

Not the right person? Other researchers publish under this name.

#artificial intelligence Preprint Aug 2026

Integrating Novelty and Surprise for Experience Prioritization and Exploration in Image-Based Reinforcement Learning

Novelty and Surprise Prioritized Experience Replay (NSPER) is introduced, which uses novelty to capture underrepresented states and surprise to expose gaps in the agent's understanding of the environment and is extended with NSPER+R, integrating these signals as intrinsic rewards to jointly improve replay quality and exploration.

Hoda Yamani, Henry Williams, Bruce A. MacDonald · 0 citations
#machine learning Preprint Aug 2026

Repetition as Reinforcement: Enhancing Sample Efficiency via Instant Episode Repetition in Reinforcement Learning

Instant Episode Repetition (IER) is introduced, a simple and novel mechanism that improves sample efficiency by immediately repeating action sequences from successful episodes during environment interaction by directly influences the data collection process.

Hoda Yamani, Yuning Xing, Koen van Rijnsoever et al. · 0 citations