Agent skill · software engineering · jeremylongshore
setting-up-experiment-tracking
Implement machine learning experiment tracking using MLflow or Weights
Why this skill is useful
Adds specific code snippets and environment setup for MLflow and Weights & Biases that the AI wouldn't reliably generate on its own.
What it needs
Requires mlflow, wandb installed locally. About 2k tokens when loaded. Last updated 2026-08-07. 2,604 stars on the source repository.
What this skill does
Experiment Tracking Setup Configure ML experiment tracking with MLflow or Weights & Biases, including environment setup and code for logging parameters, metrics, and artifacts. Overview This skill streamlines the process of setting up experiment tracking for machine learning projects. It automates environment configuration, tool initialization, and provides code examples to get you started quickly. How It Works 1. Analyze Context: The skill analyzes the current project context to determine the appropriate experiment tracking tool (MLflow or W&B) based on user preference or existing project configuration. 2. Configure Environment: It configures the environment by installing necessary Python packages and setting environment variables. 3. Initialize Tracking: The skill initializes the chosen tracking tool, potentially starting a local MLflow server or connecting to a W&B project. 4. Provide Code Snippets: It provides code snippets demonstrating how to log experiment parameters, metrics, and artifacts within your ML code. When to Use This Skill This skill activates when you need to: Start tracking machine learning experiments in a new project. Integrate experiment tracking into an existing ML project. Quickly set up MLflow or Weights & Biases for experiment management. Automate the process of logging parameters, metrics, and artifacts. Examples Example 1: Starting a New Project with MLflow User request: "track experiments using mlflow" The skill will: 1. Install the mlflow Python package. 2. Generate example code for logging parameters, metrics, and artifacts to an MLflow server. Example 2: Integrating W&B into an Existing Project User request: "setup experiment tracking with wandb" The skill will: 1. Install the wandb Python package. 2. Generate example code for initializing W&B and logging experiment data. Best Practices Tool Selection: Consider the scale and complexity of your project when choosing between MLflow and W&B. …
How to use it
Reference it in AdaL, Claude Code, Cursor or any coding agent — nothing to install:
@skills jeremylongshore/setting-up-experiment-tracking--4d1877