mlserve
by prjha-ds
Server Configuration
Describes the environment variables required to run the server.
| Name | Required | Description | Default |
|---|---|---|---|
| MLSERVE_HOST | No | Bind address | 127.0.0.1 |
| MLSERVE_PORT | No | Bind port | 8000 |
| MLSERVE_API_KEYS | Yes | Comma-separated accepted API keys (required) | |
| LANGFUSE_PUBLIC_KEY | No | Langfuse public key (optional) | |
| LANGFUSE_SECRET_KEY | No | Langfuse secret key (optional) | |
| MLSERVE_CORS_ORIGINS | No | Browser origins allowed to call the API (off if empty) | |
| MLSERVE_LOG_PAYLOADS | No | Log truncated input/output previews | true |
| MLSERVE_MAX_BATCH_SIZE | No | Embedding batch cap | 64 |
| MLSERVE_KEEPALIVE_INTERVAL_SECONDS | No | Idle-model warm-ping cadence | 240 |
Instructions
Guidance the server publishes about itself, which clients place ahead of the tool catalog so the model reads it before choosing anything.
This server publishes no instructions, or was last inspected before Glama recorded them.
Capabilities
Server capabilities have not been inspected yet.
Tools
Functions exposed to the LLM to take actions
| Name | Description |
|---|---|
No tools | |
Prompts
Interactive templates invoked by user choice
| Name | Description |
|---|---|
No prompts | |
Resources
Contextual data attached and managed by the client
| Name | Description |
|---|---|
No resources | |