The `test-all-tools-ultrathink.js` script is a **comprehensive automated testing framework** for the ClickUp MCP Server. Here's what it does:
## Main Purpose
It dynamically discovers and tests **all 72 MCP tools** in the server with intelligent parameter generation and comprehensive validation.
## Key Features
### 1. **Dynamic Tool Discovery**
- Automatically discovers all available MCP tools using the `tools/list` method
- Can also perform static analysis by parsing source files directly
- Categories tools by type (workspace, task, list, folder, etc.)
### 2. **Intelligent Test Parameter Generation**
Generates **5 different test scenarios** for each tool:
- **Basic test** - Normal usage with typical parameters
- **Edge cases** - Empty strings, zero values, empty arrays
- **Invalid inputs** - Wrong data types to test error handling
- **Minimal parameters** - Only required fields
- **Maximal parameters** - All possible parameters
The parameter generation is smart - it analyzes parameter names to generate realistic test data:
```javascript
- "task_id" → "test_task_123"
- "name" → "Test Item"
- "email" → "test@example.com"
- "priority" → 1
```
### 3. **Comprehensive Testing**
For each tool, it:
- **Validates schema** - Checks for name, description, input schema
- **Tests functionality** - Calls the tool with generated parameters
- **Measures performance** - Tracks response times
- **Handles expected errors** - Recognizes auth errors with mock credentials as acceptable
### 4. **Advanced Testing Modes**
- **Performance testing** - Runs 10 iterations on first 5 tools to measure average/min/max response times
- **Stress testing** - Concurrent requests to test server stability
- **Schema validation** - Verifies tool definitions are complete
### 5. **Detailed Reporting**
Generates comprehensive JSON reports with:
- Test summary (total, passed, failed, pass rate)
- Performance metrics per tool
- Error details
- Category breakdown
- Actionable recommendations
### 6. **Graceful Degradation**
The script has multiple fallback strategies:
1. Try direct tool analysis from source
2. If that fails, start MCP server and query via JSON-RPC
3. If that fails, perform static analysis of source files
4. Always generates a report regardless of method used
## Usage
```bash
# Run the ultra-think testing suite
node test-all-tools-ultrathink.js
# It will:
# 1. Build the server if needed (npm run build)
# 2. Discover/analyze all 72 tools
# 3. Test each with 5 parameter variations
# 4. Generate timestamped JSON reports:
# - tool-analysis-[timestamp].json
# - test-results-[timestamp].json
```
## Output Example
The script provides colored console output showing:
- 🚀 Server startup status
- 🔍 Tool discovery progress
- 🧪 Individual tool test results
- ✅ Successful tests (with timing)
- 🔒 Expected API auth errors
- ⚠️ Warnings for unexpected errors
- 📊 Final summary with statistics
This is an **ultra-comprehensive testing tool** that validates the entire MCP server implementation can handle normal usage, edge cases, and error scenarios - all without needing real ClickUp API credentials.
