evaluating-llms-harness
bymoltis-org· 59 skills
Evaluates LLMs across 60+ academic benchmarks (MMLU, HumanEval, GSM8K, TruthfulQA, HellaSwag). Use when benchmarking model quality, comparing models, reporting academic results, or tracking training progress. Industry standard used by EleutherAI, HuggingFace, and major labs. Supports HuggingFace, vLLM, APIs.
How to install evaluating-llms-harness?
moltis-org/moltis/evaluating-llms-harness
$npx -y skills add moltis-org/moltis --skill evaluating-llms-harnessInstalls into the current project.
›Prefer a prompt? Paste this to your agent
Run `npx skills use "https://github.com/moltis-org/moltis" --skill "moltis-org/moltis/evaluating-llms-harness"` and follow the generated skill instructions now. Read its complete output, redirecting it to a temporary file first if necessary. Resolve relative paths from the supporting-files directory it provides.
Use the skills in "https://github.com/moltis-org/moltis" that are relevant to the current task. Run `npx skills add "https://github.com/moltis-org/moltis"` and select the relevant skills, then follow their instructions.
Related
6 picksType
- azure-aiUse for Azure AI: Search, Speech, OpenAI, Document Intelligence. Helps with search, vector/hybrid search, speech-to-text, text-to-speech, transcription, OCR.Jul 2026
- ai-research-exploreRigor Explore compatible skill slug for meaningful and potentially novel deep learning research candidates.Jul 2026
- ai-research-reproductionRigor Reproduce compatible skill slug for README-first deep learning repository reproduction.Jul 2026
- explore-codeRigor Improve implementation leaf skill for auditable candidate implementation in deep learning research repositories.Jul 2026
- run-trainRigor Train skill for deep learning research repositories. Use when a documented or selected training command should be run conservatively for startup…Jul 2026
- explore-runRigor Improve / Rigor Explore run leaf skill for bounded exploratory evidence in deep learning research repositories.Jul 2026
