Agent skill · writing content · sickn33
hugging-face-evaluation
Add and manage evaluation results in Hugging Face model cards. Supports extracting eval tables from README content, importing scores from Artificial Analysis API, and running custom model evaluations with vLLM/lighteval. Works with the model-index metadata format.
Why this skill is useful
Adds specific commands and workflows for managing evaluation results in Hugging Face model cards that the AI wouldn't reliably generate on its own.
What it needs
Requires accelerate, huggingface_hub, inspect-ai, lighteval[accelerate,vllm], markdown-it-py, python-dotenv, pyyaml, requests, torch, transformers, vllm installed locally. Requires openai account access. About 1k tokens when loaded. Last updated 2026-08-07. 44,571 stars on the source repository.
What this skill does
Overview This skill provides tools to add structured evaluation results to Hugging Face model cards. It supports multiple methods for adding evaluation data: Extracting existing evaluation tables from README content Importing benchmark scores from Artificial Analysis Running custom model evaluations with vLLM or accelerate backends (lighteval/inspect-ai) Detailed Guide Read the detailed guide before executing this skill. It retains the complete procedure and reference material. Treat its safety, prerequisites, and validation requirements as mandatory. For focused work, load the relevant sections; for end-to-end work, read the guide completely. When to Use You need to add structured evaluation results to a Hugging Face model card. You want to import benchmark data or run custom evaluations with vLLM, lighteval, or inspect-ai. You are preparing leaderboard-compatible model-index metadata for a model release. Limitations Use this skill only when the task clearly matches the scope described above. Do not treat the output as a substitute for environment-specific validation, testing, or expert review. Stop and ask for clarification if required inputs, permissions, safety boundaries, or success criteria are missing.
How to use it
Reference it in AdaL, Claude Code, Cursor or any coding agent — nothing to install:
@skills sickn33/hugging-face-evaluation--5abbe3