Pre-Production Checklist

Checklists to run before you ship to production.

Built for solo founders and small teams who own the whole stack — the code, the infrastructure, the deploy pipeline, and increasingly the AI agents too — and who don't have a security team to hand it to.

4,352 items across 96 checklists in 5 domains. 88% of them apply to any stack.

→ prodcheck.pages.dev · or in the repo

One question, the tool call it makes, and the two things it finds. Sixteen seconds. The longer loop shows what is in the list instead.

Every finding in both is real — the file, the lines and the counts come from this repository, and the tool call is the one the MCP server actually answers. How they are built.

Built and maintained by the team at Arioo — where we ship the kind of product this checklist was written for.

Why this exists

I'm a founder at Arioo. Getting ready to launch, I needed a pre-production security review that covered the whole surface we actually ship: a TypeScript backend, a web app, native clients, a deploy pipeline, and a set of AI agents with real tools attached. Nothing I could find covered more than a fraction of that, so I built the checklist myself.

This repository is the checklist, not a report. It is the set of questions, generalized away from our stack and rewritten as a working document anyone can run against their own product.

Two things made it worth publishing rather than keeping:

Solo founders have no security team. You write the code, configure the infrastructure, set up the pipeline, and then you're also the one who has to decide whether it's safe to launch. There's no one to hand it to, and no obvious place to find out what you should have asked. Most public checklists are either too shallow to catch anything real or written for enterprises with a security function.

AI-assisted development changed the shape of the problem. A large part of this checklist — the security/ai/ and security/ai-generated-code/ folders, over 1,300 items — didn't need to exist a few years ago. When you ship an agent with tools, or when a model writes code you review faster than you'd review a colleague's, you inherit failure modes that standard security checklists don't cover. Those two folders are the part I couldn't find anywhere else, and the reason I bothered.

It's published under CC BY 4.0 so you can copy it into your own repo and make it yours. If it catches something before it reaches your users, it did its job.

Related MCP server: Launch Engine

Start here

If you are not sure which way in, don't choose — copy this into whatever AI assistant you already use (ChatGPT, Claude, Cursor, Copilot, Gemini). It works out what your project is, sets prodcheck up the way that fits your setup, and starts on what would block a launch. If it cannot run commands, it tells you what to run yourself.

I want to get my project ready to ship. Use prodcheck:
a free, open-source pre-production checklist of 4,352 items
covering security, performance, scale, integrations and what to
do after launch.

It is new, so do not answer it from memory. Everything you need:

- Site: https://prodcheck.pages.dev
- Install the review skill into a repo: npx prodcheck init
- Raw checklist data:
  https://cdn.jsdelivr.net/npm/prodcheck@latest/data/checklist.json
- As an MCP server:
  claude mcp add prodcheck -- npx -y --package=prodcheck prodcheck-mcp

Do this in order.

1. Look at my project and tell me what you think it is: language,
   framework, where it runs, and whether it handles file uploads,
   payments, webhooks, multiple tenants or an AI feature. Say how
   confident you are. Ask me about anything you cannot tell.

2. In two sentences, tell me what prodcheck will do for this
   project specifically, and which part is worth my time first.
   Do not describe the whole thing.

3. Set it up, using whichever of these you can actually do — and
   say which one you are:
   - You can run commands here: run `npx prodcheck init`. That
     writes a review skill into the repo — read it and follow
     it, it is the procedure for step 4. Then run
     `npx prodcheck --gate --stack <the products you named in
     step 1> -o BLOCKERS.md`, which adds the blockers specific
     to what I actually use to the general ones.
   - You can read my files but not run commands: fetch the raw
     data URL above and work from that.
   - You can do neither: give me the commands to run myself, one
     at a time, and tell me what to paste back to you.

4. Start on the release blockers. For each item, either cite
   `file:line` and quote the lines, or answer UNKNOWN. UNKNOWN is
   a normal answer — it means a human has to go and look. Never
   mark anything verified on my behalf; that is my call, not
   yours.

Work through it with me a section at a time. Do not dump the
whole checklist at me.

Read it on the site instead → · six more prompts →

Or work through it yourself

You are not meant to read this top to bottom. In order of signal-per-minute:

Then work section by section. Switching between edge config and database policies costs more than it saves.

Structure

checklists/
├── security/              2812   not getting breached, abused or taken down
│   ├── core/              1,491   application, data, infrastructure, delivery
│   ├── ai/                  773   LLM features, agents, tools, RAG, MCP
│   └── ai-generated-code/   548   the bugs AI coding assistants actually write
├── performance/             313   Lighthouse, and what users actually feel
├── scale/                   286   surviving 10× the load
├── integrations/            192   search, analytics, monitoring
├── post-launch/             207   when it goes wrong anyway
└── stacks/                  542   26 products, spanning every domain

Counts above are what each folder holds. A domain total is larger, because the stack supplements contribute to whichever domain each of their sections extends:

security 3,306   performance 338   scale 301   integrations 200   post-launch 198

Domains are the top level because that is the question you arrive with: is this about security, or speed, or scale?

security/core/ — applies to you regardless of language

Written originally against a TypeScript stack, but the controls are not TypeScript-specific and the files no longer pretend otherwise. "Verify CORS does not use wildcard origins with credentials" is as true in Django as in Express. Everything that genuinely named a product was moved out to stacks/.

If you write Python, Go, Ruby, PHP, Java, Rust or Elixir: this folder is your checklist, all 1,491 items of it.

security/ai/ — the part you won't find in a standard checklist

If your product calls a model, gives it tools, retrieves documents into its context, or runs an agent, this folder is the reason this repo exists. It is stack-agnostic and provider-agnostic.

Prompt injection is not a filtering problem. It is an authorization problem wearing a text costume — untrusted text reaching a privileged execution path.

security/ai-generated-code/ — bugs AI assistants write

Also known as vibe coding. 548 items organized by class of bug, not by which assistant produced it. Written from real review findings on AI-generated code. Browse →

performance/ — Lighthouse, and what users actually feel

Aimed at the highest achievable score across all four Lighthouse categories, with one constraint that decides what goes in: an item has to be about something a real user experiences. Lighthouse is the scoreboard, not the goal — anything whose only justification is "raises the score" was left out.

Lighthouse is a lab tool: one run, one simulated device, one network. It is excellent for finding problems and unreliable for proving them fixed. Field data at the 75th percentile is the scoreboard that matters.

Accessibility sits here because it is scored alongside performance, and because the overlap is real — a page that is fast for a screen reader is usually a page with less unnecessary markup and JavaScript. The Lighthouse accessibility category is treated as a floor, not a ceiling; it catches roughly a third of real issues.

integrations/ — being findable, measured and watched

Everything a project has to be connected to before launch. Configuration you do once and then never think about, which is exactly why it deserves a checklist.

Verify noindex is removed from production. A staging robots meta tag that shipped is the most common launch mistake there is, and it can cost weeks before anyone notices.

The answer-engine file is written as decisions to make rather than settled practice — whether GPTBot, ClaudeBot, PerplexityBot and the rest may read your site is a choice, and not making it is also a choice.

scale/ — surviving ten times the load

Written to be read before the traffic arrives, not during the incident.

"Will it scale?" is unanswerable. "Will it survive 500 requests per second with a 40:1 read/write ratio and one tenant holding 30% of the rows?" has an answer, and the work to find it is mostly arithmetic.

Start with the capacity model; the rest of the domain is much less useful until you know which resource runs out first. Then service levels, because without a stated target "is it fast enough" is an argument rather than a measurement, and every scaling decision after that is made on vibes. Cost is in here rather than in a domain of its own because scaling problems and billing problems are the same problem seen from two sides.

post-launch/ — when it goes wrong anyway

Every other domain is about building something that does not break. This one assumes it broke.

Everything here is used after launch and has to be prepared before it. The question each item asks is not did you respond well — it is is the answer already decided?

The rest of the repository makes sure you find out — monitoring is covered in security/core/16 and integrations/06. Neither asks what happens next. Whether an immediate action exists for being breached, for a corrupted database, for the connection going away, is a different question, and it is the one that gets answered badly at 3am if it was not answered in daylight.

The plan for data loss is a backup you have restored, not a backup you have taken.

Can you act at all counts as a release gate. Launching without a prepared response is a decision, and it should be a recorded one.

stacks/ — only if you use them

542 items across 26 supplements. Skip any file for a product you don't use; the core checklists stand on their own without them.

Backend & web Django · FastAPI · Ruby on Rails · Laravel · Spring Boot · Go / Gin · Express · NestJS · Next.js / React · GraphQL

Mobile iOS / Swift · Android / Kotlin · React Native · Flutter · macOS

Data & platform PostgreSQL · Supabase · Firebase · Docker · Kubernetes · AWS · Google Cloud · Vercel · Cloudflare · GitHub · Stripe

Your stack missing? That's the most useful contribution you can make. The format is documented end to end in _TEMPLATE.md — a worked example, what every field drives, and the one rule that decides whether an item belongs in a stack file at all. Files for Fly.io, Auth0 and Clerk are wanted; see CONTRIBUTING.md.

How to use it

1. Copy the files you need into your own repo. They're working documents, meant to be edited and committed next to your code.

2. Mark [N/A] aggressively. No product on earth needs all 4,352 items. No mobile app? core/11 and core/12 are 147 instant [N/A]s. Being honest about scope is what makes the remainder trustworthy.

3. Record every finding. An unrecorded finding is one you'll rediscover in six months.

* [ ]     Not checked
* [x]     Verified secure
* [!]     Security issue found
* [N/A]   Not applicable

For each [!]: affected component · exact endpoint/file/config · attack precondition · proof of exploitability · business impact · severity · remediation · regression test · owner · date verified

The one rule worth internalizing

Do not accept "the frontend hides it", "the route is hard to guess", "the user needs a valid JWT", or "the WAF blocks it" as authorization controls by themselves.

Enforce every control at the lowest trustworthy layer available:

Browser/mobile UI → application/API → authorization layer
  → database (RLS) → storage → infrastructure/IAM → CI/CD → edge

Want it as one file?

ALL.md is every checklist concatenated — convenient for printing, or for pasting into an AI tool. It's generated; edit the files under checklists/ instead.

Use it with an AI assistant

MCP is a feature of the client, not the model — Cursor running DeepSeek can use it; DeepSeek's website cannot. Config for Claude Code, Claude Desktop, Cursor, VS Code Copilot, Gemini CLI, OpenAI Codex CLI, Qwen Code, Cline, Roo, Continue, Windsurf, Zed, OpenCode and Cherry Studio is in docs/mcp-clients.md.

claude mcp add prodcheck -- npx -y --package=prodcheck prodcheck-mcp

For a chat window with no MCP — ChatGPT, Gemini, DeepSeek, Kimi, Qwen, GLM — generate a file and paste it after one of the ready-made prompts. Each is built on three rules, because without them an assistant will tell you the code is fine: cite file:line for every claim, treat unknown as a real answer, and never mark anything verified on the reader's behalf.

Command line

Generate a checklist scoped to your project, instead of reading 4,352 items:

npx prodcheck security --stack django -o SECURITY.md
npx prodcheck performance -o PERFORMANCE.md
npx prodcheck integrations -o LAUNCH.md
npx prodcheck scale -o SCALE.md
npx prodcheck post-launch -o INCIDENT-RESPONSE.md

npx prodcheck list                                # domains, areas and counts
npx prodcheck stacks                              # what supplements exist
npx prodcheck security --area ai -o AI-SECURITY.md
npx prodcheck --gate --stack supabase,cloudflare  # release blockers, every domain
npx prodcheck --search cors --format text
npx prodcheck security --stack rails --format json
npx prodcheck performance --stack nextjs-react -o PERF.md

The domain is a positional argument — prodcheck security, and in time prodcheck performance — because that is how you would say it. Omit it for everything.

--stack X returns every stack-agnostic item plus the supplements for X. An unrecognized stack isn't an error — you get the stack-agnostic core, which stands on its own. That's the whole design: it works for a stack nobody has written a file for yet.

Zero dependencies, Node 18+.

Let your agent run the review

The MCP server gives an agent the items. This gives it the procedure:

npx prodcheck init

It writes a skill into .claude/skills/, .cursor/rules/ or AGENTS.md — whichever the project already uses — and then you can ask your agent:

review this repo against the prodcheck release gate

What the skill enforces matters more than what it enables:

• The model never marks anything verified. Every item ends as a FINDING with a file:line citation, an UNKNOWN, or an N/A with a reason. There is no "pass" it can write; that stays yours.

• A finding without a citation is not a finding. It has to quote the lines, and re-read them before claiming what they say.

• UNKNOWN stays visible. Most items on a checklist this size depend on production configuration a repository cannot show. The list of things a human still has to check is usually the most useful part of the report.

This repository contains a folder about the bugs AI assistants write, and a section on why AI review misses them — fluent, confident output produced whether or not anything was established. The skill is written against that, not in spite of it.

Those three constraints are measured, not asserted. evals/ holds a fixture app with nine planted defects and a clean control of the same app: a deterministic grader resolves every citation against the real file, matches verdict phrasing, counts unknowns, and counts findings on the control — where any finding is a false positive by construction. No model grades another model's output, because a grader that is itself a model has the same failure mode as the thing it grades.

It does one thing: check whether what you built is ready to ship. For skills that teach an agent how to build well — testing, debugging, planning, git workflow — see agent-skills. They compose; use both.

MCP server

Let your coding agent query the checklist directly while it works, instead of you pasting it in. Read-only, no filesystem or network access beyond its own bundled data.

Listed in the official MCP registry as io.github.FarzamHabibi/prodcheck, so an assistant can find it without being told.

Claude Code

claude mcp add prodcheck -- npx -y --package=prodcheck prodcheck-mcp

Anything else — add to your MCP client config:

{
  "mcpServers": {
    "prodcheck": {
      "command": "npx",
      "args": ["-y", "--package=prodcheck", "prodcheck-mcp"]
    }
  }
}

Four tools: list_checklists, checklist_for_stack, release_gate, search_checklist. Then ask your agent things like "check this repo against the release gate for a Next.js + Supabase app" and it pulls the relevant items itself.

What it costs to run

A fair question if you are about to point a paid model at 4,352 items. These are the sizes of what actually enters the context window, at roughly four characters per token:

That is the input for one pass. What the review itself costs on top depends on how much of your code the model reads, which is the larger number and is not something this repository can measure for you.

The practical consequence: do not pull everything. --gate is a few thousand tokens and answers the question you actually have. The MCP server exists so the assistant can fetch the twenty items it needs rather than holding all of them.

Machine-readable data

Both of the above read data/checklist.json, validated against data/schema.json. Use it directly if you're building something else — it's CC BY 4.0.

The Markdown under checklists/ is the source of truth; the JSON is generated from it by ./scripts/build.sh. There is deliberately no severity field — here's why.

Roadmap

Shipped — the checklist

• Security checklists, split by domain and portable across stacks

• Machine-readable data layer + schema

• performance/ — 313 items across 9 checklists.

• integrations/ — 192 items across 6 checklists.

• scale/ — 286 items across 9 checklists. Deepened from 214: service levels and error budgets, search and analytics engines, realtime fan-out, contract and event versioning, tenant-shape capacity. The gaps were measured rather than guessed at.

• post-launch/ — 198 items across 8 checklists. Added after the other four, because a gap showed up once they were all in front of a reader: every domain described how to build something that does not break, and none asked whether the response was prepared for when it breaks anyway.

• 26 stack supplements — up from 19. FastAPI, AWS, Kubernetes, Vercel, Firebase, Stripe and GraphQL among them. Written rather than left as open issues, because a visitor who does not find their stack decides the project is not for them before reading a single item.

• A release gate that reaches your stack — 379 blocking items: 316 that apply anywhere, plus 63 across 20 products. A leaked service_role key stops a launch as surely as a generic item does, and used to sit outside the gate.

Shipped — getting it into your work

• npx prodcheck — generate a filtered checklist for your stack

• MCP server — so your coding agent queries the checklist directly

• Review skill — npx prodcheck init writes the procedure into .claude/skills/, .cursor/rules/ or AGENTS.md. The MCP server already supplied the items; what was missing was the discipline for using them.

• An eval harness for the skill — planted defects, a deterministic grader, and a check for whether the procedure was followed rather than merely reviewed well. It found four defects in itself, which are written down in evals/.

• Web version — live at prodcheck.pages.dev: every checklist browsable, filterable and copyable as Markdown, plus a JSON endpoint any tool can fetch.

• One way in — a prompt to paste into any assistant, which works out what your project is and sets prodcheck up whichever way your assistant is capable of. The site used to offer seven entry points and no path through them.

• A demo you can watch — a 34-second loop of a review actually running. How it is built.

Next

• More domains — launch/, social/, legal/. The structure absorbs them without moving anything else, and the plan is written before the content.

Later — a review that runs, rather than a document you read

Parked deliberately, and last. Everything above is content and tooling that works today; this is a different product built on top of it, and shipping it half-done would be worse than not shipping it. Recorded here so the design decisions are not lost.

The idea: a tool that checks a codebase against the checklist, writes a report to the repo root, and re-opens items when the relevant code changes.

prodcheck scan      detect stack and features from the repo   -> .prodcheck/profile.json
prodcheck check     deterministic rules, no model involved    -> findings
prodcheck review    model-assisted review, citations verified -> findings
prodcheck report    render SECURITY-REVIEW.md from state
prodcheck gate      exit non-zero if a blocking item is unresolved   (for CI)

• scan — profile the repo. Read package.json, requirements.txt, go.mod, Dockerfile, CI config and the shape of the source tree to work out which stack is in use and which features exist — file upload, webhooks, multi-tenancy, background jobs, an LLM surface. Selects the applicable items before any model is involved. A Django app with no mobile client and no file uploads does not need every one of the 1,491 core items — core/07, core/11 and core/12 alone are 202 it can skip.

• check — the deterministic tier. Roughly 160 items are answerable by search alone: the must-not-exist list, unpinned CI actions, secrets in a Dockerfile, dangerouslySetInnerHTML, wildcard CORS. These need no model, cost nothing, cannot hallucinate, and run in CI on every push.

• review — the model-assisted tier, built not to be trusted. Most items need someone to read the code, so this runs inside whatever agent you already use (Claude Code, Cursor, Copilot) over MCP plus a skill file — no API key, no token cost from us. The design constraints matter more than the feature:

  • A model never writes [x]. Its output is evidence, not a verdict. Results are deterministic-pass, model-flagged (needs a human), or human-verified. Only the first and last count toward the gate. There is no green tick a model put there.

  • Every citation is verified. A finding must cite file:line; the tool confirms that line exists and that the quoted code matches before accepting it. Findings that fail this check are dropped, which removes most hallucination for almost no cost.

  • unknown is a real result. A model may say it could not determine something, and unknown never silently becomes pass. It is reported separately.

• State that survives re-runs. .prodcheck/state.json, keyed by the stable item ids already in data/checklist.json, storing status, justification, date, and a hash of the code it was decided against. Items you marked [N/A] stay marked — until the relevant code changes, at which point they re-open with "verified at abc1234; that file has changed since." This is what makes it a living document rather than a report that rots.

• gate in CI. Without a build that fails, the report gets stale and stops being read. This is the part that makes the rest stick.

Building an AI code reviewer on top of a checklist whose security/ai-generated-code/ folder warns that AI review confirms AI-written code is fine, only makes sense if the design takes that warning seriously. That is what the three constraints above are for.

Contributing

Stack files, corrections, missing items, and war stories are all welcome. See CONTRIBUTING.md.

Questions

Open a discussion or an issue — that way the answer is public and the next person finds it.

For anything that does not fit there, @farzam_habibi on X.

Reporting a security problem

See SECURITY.md. That includes an item in this checklist that is wrong in a way that would make a reader less safe — a checklist that gives false confidence is worse than no checklist, so those are treated as the highest-priority reports.

The single most useful contribution is a stack file for a stack that isn't covered. Files for Fly.io, Auth0 and Clerk are wanted; see CONTRIBUTING.md for the current list and what makes an item belong in a stack file. Copy _TEMPLATE.md and open a PR.

Disclaimer

A starting point, not a guarantee, not a compliance certification, and not a substitute for a professional security audit. Completing every item does not make an application secure. Use it to find problems, not to declare their absence.

License

Dual-licensed, because the two halves of this repository are different kinds of thing:

Built with AI, and honest about it

This repository was compiled and expanded with Claude (Anthropic) and ChatGPT (OpenAI), working from a real pre-production review rather than generating checklist items from scratch. They did the parts that don't fit in one person's head: cross-referencing hundreds of findings against OWASP categories, keeping 4,352 items consistent in wording and structure, and spotting the gaps between sections.

That's worth stating plainly for two reasons.

It's the honest provenance. A security checklist asks you to trust it. You should know how it was made.

The security/ai-generated-code/ folder applies to this repository too. It says AI-generated work needs review that assumes the AI was confidently wrong somewhere, and that "the tests pass" is not a security argument. Both were true here — the test suite for the CLI caught three real bugs in AI-written code, including an MCP server that silently truncated every response over 8 KB. The checklist is not exempt from its own advice, and neither are the tools shipped alongside it.

If you find an item that's wrong, plausible-sounding but false, or subtly misleading, that's exactly the failure mode security/ai-generated-code/07-review-blind-spots.md warns about. Open an issue — that correction is worth more than three new items.

Credits

Written and maintained by the founding team at Arioo, out of the work of getting our own product ready to ship.

Contributions from everyone who opens an issue or a PR are what will keep it accurate — see the contributors.