Training notes for LLM pretraining, alignment, post-training, and forgetting.
Notes
| Area | Note | Status |
|---|---|---|
| Alignment | Pretraining and Alignment for LLMs | draft |
| Post-training | Post-Training and Forgetting | draft |
Learning Use
- Separate pretraining, supervised fine-tuning, preference optimization, and alignment.
- Track how post-training changes capabilities and can induce forgetting.
- Prepare for inference-time reasoning and context engineering.