Simple Preference Optimization for LLM alignment. Reference-free alternative to DPO with better performance (+6.4 points on AlpacaEval 2.0). No reference model needed, more efficient than DPO. Use for preference alignment when want simpler, faster training than DPO/PPO.
$npx -y skills add mustafakemal0146/fetih --skill simpoInstalls into the current project.
Run `npx skills use "https://github.com/mustafakemal0146/fetih" --skill "mustafakemal0146/fetih/simpo"` and follow the generated skill instructions now. Read its complete output, redirecting it to a temporary file first if necessary. Resolve relative paths from the supporting-files directory it provides.
Use the skills in "https://github.com/mustafakemal0146/fetih" that are relevant to the current task. Run `npx skills add "https://github.com/mustafakemal0146/fetih"` and select the relevant skills, then follow their instructions.