Skip to main content
Glama

Server Configuration

Describes the environment variables required to run the server.

NameRequiredDescriptionDefault

No arguments

Capabilities

Features and capabilities supported by this server

CapabilityDetails
tools
{
  "listChanged": true
}

Tools

Functions exposed to the LLM to take actions

NameDescription
fetch_robots

Fetch and analyze a robots.txt file from a URL. Returns which AI bots are blocked or allowed.

analyze_robots

Analyze pasted robots.txt content. Returns which AI bots are blocked or allowed based on the rules.

generate_robots

Generate a robots.txt file with specified blocked bots, sitemap URLs, and custom rules.

list_ai_bots

List all known AI bots with their user-agents, companies, and descriptions. Useful for deciding which bots to block.

check_bot_status

Check if a specific bot is blocked or allowed on a given website by fetching and analyzing its robots.txt.

Prompts

Interactive templates invoked by user choice

NameDescription

No prompts

Resources

Contextual data attached and managed by the client

NameDescription

No resources

Latest Blog Posts

MCP directory API

We provide all the information about MCP servers via our MCP API.

curl -X GET 'https://glama.ai/api/mcp/v1/servers/sharozdawa/robotstxt-ai'

If you have feedback or need assistance with the MCP directory API, please join our Discord server