AppliedMath for LLMs3 hours

Implement Alignment And Safety

Implement a portfolio-ready notebook experiment that proves you can use Alignment And Safety, not just read about it.

Checklist progress0%

0 of 6 steps complete

Build brief

You are turning the Alignment And Safety module into a concrete artifact. Keep the scope small, make the behavior visible, and leave enough notes that another learner can understand the result.

Requirements

  • Use at least two ideas from Alignment And Safety.
  • Keep the implementation small enough to explain in five minutes.
  • Add three test cases or examples that show normal and edge behavior.
  • Write a short reflection that explains what broke and how you fixed it.

Deliverables

  • A runnable notebook cell sequence for Alignment And Safety.
  • A short explanation of the math idea in plain language.
  • At least one visualization, table, or numerical sanity check.

Project checklist

Source lessons

Notes18-Alignment-and-Safety/01-Instruction-Tuning-and-SFT/notes.mdOpenNotes18-Alignment-and-Safety/02-Preference-Optimization-RLHF-and-DPO/notes.mdOpenNotes18-Alignment-and-Safety/03-Red-Teaming-and-Safety-Evaluations/notes.mdOpenNotes18-Alignment-and-Safety/04-Policy-and-Guardrails/notes.mdOpenNotes18-Alignment-and-Safety/05-Human-in-the-Loop-and-Monitoring/notes.mdOpenTheory Notebook18-Alignment-and-Safety/01-Instruction-Tuning-and-SFT/theory.ipynbOpen
Run notebook

Milestones and skills

  1. 01Read the linked source lessons and note the key APIs or formulas.
  2. 02Sketch the smallest useful version of the notebook experiment.
  3. 03Build the core behavior before adding polish.
  4. 04Run the examples, notebook cells, or manual tests.
  5. 05Write the final explanation and mark the checklist complete.
Alignment And SafetyNumerical reasoningNotebook workflowPlanningTestingDebuggingExplanation