From Normative Frameworks to Alignment Data: Constructing and Evaluating SFT and Preference Data
Aligning language models with a specified normative framework requires translating abstract principles into concrete examples and preference signals from which models can learn. We present an expert-driven methodology for constructing such alignment data and apply it to a normative framework grounded in Islamic ethical...