add llm

PhilipMay · Dec 29, 2023 · 9be3869 · 9be3869
1 parent ab5450c
commit 9be3869
Showing 1 changed file with 7 additions and 0 deletions.
diff --git a/source/machine-learning/llm.md b/source/machine-learning/llm.md
@@ -0,0 +1,7 @@
+# LLM
+
+## Base Knowledge
+- Direct Preference Optimization (DPO)
+  - Paper: <https://arxiv.org/abs/2305.18290>
+  - <https://plainenglish.io/community/direct-preference-optimization-dpo-a-simplified-approach-to-fine-tuning-large-language-models>
+  - <https://huggingface.co/blog/dpo-trl>