Muhammad Saad Qadir

Where Did the Update Go? Certifying Declared Change Envelopes for Model Updates

Deployed language models are updated continually, and regulators increasingly accept changes that were declared in advance. Showing that an update changed behavior only where it was declared to is a different statistical problem from bounding how much it changed: a useful update is meant to change some decisions, so gl...