Post-training Large Language Models (LLMs) with Reinforcement Learning (RL) has become an important tool for improving model capabilities, but the LLM action-space structure introduces challenges distinct from classical RL, with implications for inducing exploration. New methods are required that leverage the broad knowledge and flexibility of pre-trained LLMs to deliberately generate diverse experience at training time. We propose Instruction-Conditioned Exploration (ICE), which appends one of a small fixed set of instructions to task prompts during training, using the same set for every problem, increasing the coverage of behaviours attempted. To facilitate ICE, we combine RL on the instruction-conditioned policy with self-distillation of its correct rollouts into the unconditioned test-time policy. ICE with this objective improves Qwen3-1.7B held-out pass@1 performance at 4K response length on mathematical reasoning tasks by $5.0\%$ relative to training with DAPO, with improvement persisting at a longer 8K context. The improvement does not appear for Qwen3-4B at 4K, where the instructions do not expand base-model coverage.
Jim Dilkes, V. Yazdanpanah, Sebastian Stein· 0 citations
Reliable photovoltaic (PV) forecasts are needed for low-carbon energy systems, but newly deployed sites often have short, imperfect records. This makes standard day-ahead forecasting difficult: persistence and physical baselines can be sensitive to calibration and timestamp alignment, while single machine-learning models may capture only one structure in the data and overstate skill under non-temporal validation. We study this problem at a United Kingdom charging-station site, where PV forecast errors affect charging availability, storage scheduling, and downstream control. Using measured inverter output and publicly available meteorological inputs, we develop a deployment-oriented environmental-AI pipeline for day-ahead hourly PV forecasting. The pipeline corrects timestamp conventions, constructs leakage-safe solar-geometry and clearness-index features, adds short-term atmospheric context, and combines complementary predictors through validation-learned stacking. Against smart persistence, a clear-sky baseline that adjusts recent PV output using expected clear-sky irradiance, the best ensemble reduces daylight normalised RMSE by about 32% under random day-blocked evaluation and 9% under the stricter rolling-origin protocol. It also reduces daylight RMSE relative to the strongest individual machine-learning baseline by 6.6% and 6.4%, respectively. The results show that physics-aware stacking can support PV forecasts from limited site data, but its value depends on model class, evaluation protocol, and deployment context.
Fariba Dehghan, Sebastian Stein, V. Yazdanpanah et al.· 0 citations