👋 Welcome to my Blog
Hi, this is Chengshuo. I'm documenting my learning notes in this blog. Feel free to email me if there is any mistakes in the notes. 😉
Modern Text Embeddings: Contrastive Learning and Matryoshka Representations
Embedding & Vector DatabaseLLM Fundamentals
Hitting the Data Wall: Scaling Laws and Rise of Synthetic Data
LLM FundamentalsSupervised Fine-tuning
The Critical Role of Data Quality in Instruction Tuning: Insights from LIMA
Supervised Fine-tuningLLM Fundamentals
Teaching Machines Morals: The Promise of Constitutional AI
AlignmentAI Safety
The Alignment Problem: From RLHF and PPO to DPO and KTO
AlignmentSupervised Fine-tuning
Bypassing the Reward Model: Direct Preference Optimization (DPO)
LLM FundamentalsAlignment
放弃RLHF，拥抱DPO？
Alignment
The Alchemy of Weights: A Guide to Model Merging Techniques
Model ArchitectureFine-Tuning
Categories
- All (48)
- AI Safety (1)
- AI Search (3)
- Agent (6)
- Agentic RAG (1)
- Alignment (6)
- DNS (1)
- Embedding & Vector Database (3)
- Fine-Tuning (2)
- GraphRAG (1)
- Inference Optimization (4)
- LLM Evaluation (3)
- LLM Fundamentals (11)
- LLM Inference (1)
- Model Architecture (4)
- Performance Optimization (3)
- Personal Reflextion (1)
- Post-Training (1)
- Prompt Engineering (6)
- RAG (4)
- Scaling Laws (1)
- Search (1)
- Supervised Fine-tuning (5)
- System Design (3)
- Vibe Coding (1)
- Web Deployment (1)