Safety Filter

Systematic differences in model outcomes across groups; arises from data, labels, and deployment context.

Techniques to understand model decisions (global or local), important in high-stakes and regulated settings.

Studying internal mechanisms or input influence on outputs (e.g., saliency maps, SHAP, attention analysis).

Feature attribution method grounded in cooperative game theory for explaining predictions in tabular settings.

Constraining outputs to retrieved or provided sources, often with citation, to improve factual reliability.

Fine-tuning on (prompt, response) pairs to align a model with instruction-following behaviors.

Model trained to predict human preferences (or utility) for candidate outputs; used in RLHF-style pipelines.

Ensuring model behavior matches human goals, norms, and constraints, including reducing harmful or deceptive outputs.