Skip to main content
Glama
SamWongML

API Testing Platform

by SamWongML
README.md
# API Testing Platform

An LLM-driven API testing platform exposed over MCP. Tests are authored as typed,
declarative `defineTest`/`defineSuite` values, compiled to a normalized JSON manifest,
and executed by a pure in-house DAG engine.

- **Architecture:** [docs/research.md](./docs/research.md)
- **Deployment runbook:** [docs/deploy.md](./docs/deploy.md)
- **Production readiness:** [plan](./docs/production-readiness.md) ·
  [status](./docs/production-readiness-status.md)
- **Agent guide:** [CLAUDE.md](./CLAUDE.md)

## Package map

| Package | Name | Responsibility |
|---|---|---|
| `packages/schema` | `@atp/schema` | Zod schemas + inferred types — the single source of truth |
| `packages/engine` | `@atp/engine` | Pure execution engine (HTTP, assertions, DAG); no MCP/AWS deps |
| `packages/reporting` | `@atp/reporting` | `ExecutionResult` → Markdown / HTML / JUnit / `llm_summary` |
| `packages/store` | `@atp/store` | Persistence: Postgres record + queue, DynamoDB task state, S3/local artifacts |
| `packages/mcp-server` | `@atp/mcp-server` | Stateless MCP server + async worker |
| `packages/cli` | `@atp/cli` | Local DX: `atp compile` / `list` / `run` / `validate` / `import` / `golden` |
| `tools/compile` | `@atp/compile` | Discovery: `*.test.ts`/`*.suite.ts` → `dist/manifest.json` |
| `infra/` | `@atp/infra` | AWS CDK stacks: network / data / ecs / observability ([runbook](docs/deploy.md)) |
| `tests/` | — | The test corpus (grows to thousands) |

## Development

```bash
pnpm install
pnpm typecheck   # tsc --noEmit across the workspace
pnpm lint        # eslint
pnpm test        # vitest run
pnpm compile     # build dist/manifest.json
```

Requires Node 22+ and pnpm (`corepack enable`).