7-Frame trust gap · 2026 edition · early findings
The Production Gap · Open-Source AI Tools · 2026
Early findings — small sample, growing. Reported descriptively, not as a "State of" claim.
We ran Legit.Show’s 7-Frame production-readiness benchmark across 215 open-source AI, MCP and developer tools — straight from their repositories. AI coding ships a flawless demo; this is what quietly never makes it to production.
Read from public repositories only — declared dependencies and committed platform config. Integrations enabled in a hosting dashboard, or configured in a private ops repo, are not visible to this method and are not counted either way.
The findings
- No error tracking declared — 90%No error-tracking dependency or platform config declared in the public repo.
- No rate limiting declared — 80%No rate-limiting library or gateway config declared in the public repo — a limit set at a CDN or load balancer is invisible here.
- No row-level security — 67%Database tables with no access rules — one user can read another’s data.
- Unindexed foreign keys — 0%Fast with little data, slow or down once it grows.
- Committed .env — 0%Credentials checked into the repo — leaked to anyone who clones it.
- Secrets in the browser — 0%Secret keys shipped to the client — anyone can steal them.
How many controls are missing
- Clean — 0 gaps — 9%
- 1–2 gaps — 81%
- 3 or more gaps — 10%
By category
- Developer Tools — 95% no error tracking
- MCP & Integrations — 93% no error tracking
- AI & Agents — 80% no error tracking
- Other — 95% no error tracking
- Infrastructure & DevOps — 55% no error tracking
- Frameworks & Starter Kits — 100% no error tracking
Why these seven
The demo always works — that’s what AI coding is *great* at. The gap is everything a demo never forces you to add: monitoring for when it breaks, limits for when it’s abused, access rules for when there’s more than one user. 20 of 215 (9%) had none of these gaps. The rest are one incident away from finding out.
The basics most get right
It isn’t carelessness with the obvious stuff: 0% shipped a hard-coded secret key in client code, and only 0% committed a `.env`. The misses are the *invisible* controls a human senior adds by reflex and a model rarely does.
What this is not
A health check, not a verdict. A missing rate limit correlates with “shipped fast, hardened never” — it doesn’t prove the product is bad. Every number is a count over a stated sample, measured from the public repository, fully reproducible. These are floors, not rates. We only see what a project declares on its public surface. Error tracking wired through an environment variable, a rate limit set at a gateway or CDN, an integration enabled in a hosting dashboard — all of it reads as absence here. The real figure is higher than the one we publish, never lower. See [the methodology](https://legit.show/methodology) for the full rule.
Sample composition
Not a random sample — this is what we measured. The mix below is the caveat; judge it for yourself.
- Developer Tools: 75
- AI & Agents: 46
- MCP & Integrations: 44
- Other: 25
- Infrastructure & DevOps: 11
- Frameworks & Starter Kits: 5
- Largest single maker: 1% (open, 2)
What we measured (215)
The full list, so anyone can spot-check. Every item links to its public benchmark.
- squint-mcp
- soft-ue-cli
- @expo/mcp-tunnel
- workers-ai-provider
- ratel
- @azure-devops/mcp
- @inngest/ai
- @shortcut/mcp
- autoresearch
- mcp-handler
- Codex-X
- ai-video-generator-claude
- SaaS-Bench
- @mobilenext/mobile-mcp
- @sap-ux/fiori-mcp-server
- django-boilerplate
- webpack-dashboard
- RCLI
- anything-analyzer
- @react-native-community/cli
- mcptoon
- @mcp-use/inspector
- chromedp
- @langchain/mcp-adapters
- @penpot/mcp
- @supabase/mcp-utils
- @egjs/agent
- homebutler
- deploy-your-own-saas
- agency-agents
- @nestjs/cli
- mcp-searxng
- mcpscore
- sequelize-cli
- glance
- n8n-nodes-mcp
- cli-sprintf-format
- react-native-debugger
- cc-connect
- meow
- DataNexus MCP
- Conformiti
- @expo/cli
- turbo-fieldfare
- llm-task-orchestrator
- maverik
- Langchain-Chatchat
- @convex-dev/agent
- omk
- agents-best-practices
- cli-table3
- tradingview-mcp
- vue-element-admin
- mcpsnoop
- ndb
- memory-os
- agentic-inbox
- codex-keysmith
- cli-columns
- openclaw-saas
- discord-reward-claimer
- CrewAI
- product-architect
- burhan-platform
- oh-story-claudecode
- @storybook/mcp
- bat
- @allurereport/plugin-agent
- Agent-Reach
- obscura
- agent_java_offer
- @pm2/agent
- kotro-proxy-engine
- pi-extensions
- @agentclientprotocol/claude-agent-acp
- @azure/mcp
- @swc/cli
- handoff
- @scalar/agent-chat
- ostack-saas
- graphiql
- @sentry/cli-linux-x64
- open-codex-computer-use
- default-user-agent
- SearchCLI
- openless
- gini-agent
- arkon
- miniapp-cdp-mcp
- TencentDB-Agent-Memory
- wienerdog
- Hermes One
- @posthog/ai
- agent-config
- MasterHttpRelayVPN-RUST
- @clerk/mcp-tools
- vphone-cli
- k8s-unix-system
- agent-cli-detector
- mcp-framework
- open-claude-in-chrome
- @formatjs/cli
- cli-table
- dive
- @agentmemory/mcp
- glazepkg
- cli-tableau
- healthy-diet-ai-agent
- @angular/cli
- hyperframes
- WorkShadow
- OpenSpace
- react-devtools
- claudetop
- bug-hunter
- gsd-browser
- @rekog/mcp-nest
- claude-code-production-grade-plugin
- cli
- clicky
- prompt-master
- prime-agent
- simvyn
- bb-browser
- ripgrep
- GEOFlow
- superpowers-zh
- llmfit
- @aws-sdk/util-user-agent-browser
- redux-devtools-extension
- agent-watch-approve
- add-mcp
- universal-user-agent
- @google/generative-ai
- @modelcontextprotocol/ext-apps
- ultraship
- @notionhq/notion-mcp-server
- deepseek-saas-starter-vue
- @genkit-ai/ai
- spec-kit
- iosm-cli
- infinity-agent
- hotel
- OB1
- claude-code
- ponytail
- octanet-landing-page-starter
- agent-toolkit-for-aws
- SkillSpector
- Windows-MCP
- canivibecodeit
- lazygit
- @firebase/ai
- CDP-Enable-BOF
- dispatchseo
- wrapper
- synthadoc
- aws-blocks
- openwiki
- @types/cli-progress
- nextjs-subscription-payments
- @sanity/cli-core
- Supabase
- @reportportal/agent-js-playwright
- llm_wiki
- @postman/tunnel-agent
- coc.nvim
- butterbase
- forever-agent
- free-stockdb
- Vane
- next-devtools-mcp
- react-native-grab
- LiveAgent
- free-claude-code
- Sentry
- pi
- webpack-cli
- Shadowbroker
- engram
- a-stock-data
- @newrelic/security-agent
- gpt-engineer
- chrome-devtools-axi
- @ui5/cli
- @traceloop/instrumentation-mcp
- hostinger-api-mcp
- Mindwalk
- @vercel/mcp-adapter
- stack-on-a-budget
- gpt-pilot
- @google/gemini-cli
- Tradingview-MCP
- @payloadcms/plugin-mcp
- @salesforce/mcp
- cli-printing-press
- aurora
- @ui5/mcp-server
- FinSight-AI
- psique-workflow-clinic
- @eslint/mcp
- tavily-mcp
- @npmcli/agent
- Mem0
- cli
- telecom-mas-agent
- inkos
- agentacct
- OpenMontage
- tunnel-agent
- postcss-cli
- stainful
- tradingview-mcp
- n8n-mcp
- cli-cursor