LangSmith MCP Server

List LangSmith experiment projects (reference projects) with mandatory dataset filtering.

Fetches experiment projects from LangSmith that are associated with a specific dataset. These are projects used for model evaluation and comparison. Requires either a dataset ID or dataset name to filter experiments.

🧩 PURPOSE

This function provides a convenient way to list and explore LangSmith experiment projects. It supports:

• Filtering experiments by reference dataset (mandatory)

• Filtering projects by name (partial match)

• Limiting the number of results

• Automatically extracting deployment IDs from nested project data

• Returns simplified project information with key metrics (latency, cost, feedback stats)

⚙️ PARAMETERS

reference_dataset_id : str, optional The ID of the reference dataset to filter experiments by. Either this OR reference_dataset_name must be provided (but not both).

reference_dataset_name : str, optional The name of the reference dataset to filter experiments by. Either this OR reference_dataset_id must be provided (but not both).

limit : int, default 5 Maximum number of experiments to return. This can be adjusted by agents or users based on their needs.

project_name : str, optional Filter projects by name using partial matching. If provided, only projects whose names contain this string will be returned. Example: project_name="Chat" will match "Chat-LangChain", "ChatBot", etc.

📤 RETURNS

Dict[str, Any] A dictionary containing an "experiments" key with a list of simplified experiment project dictionaries:

🧪 EXAMPLES

1️⃣ List experiments for a dataset by ID

2️⃣ List experiments for a dataset by name

3️⃣ Find experiments with specific name pattern

🧠 NOTES FOR AGENTS

• Returns simplified experiment information with key metrics (latency, cost, feedback stats)

• The agent_deployment_id field is automatically extracted from nested project data when available, making it easy to identify agent deployments

• Experiments are filtered to include only reference projects (associated with datasets)

• The function uses name_contains for filtering, so partial matches work

• You must provide either reference_dataset_id OR reference_dataset_name, but not both

• Experiment projects are used for model evaluation and comparison across different runs