Skip to content
Engineering

Why We Test Every MCP Server Before It Enters Our Marketplace

Zapier now shares MCP servers. So does every GitHub repository. JieGou tests every one. Here's the quality testing pipeline behind our 3-tier certified marketplace — and why it matters for enterprise AI automation.

JT
JieGou Team
· · 6 min read

MCP Is Infrastructure Now

The Model Context Protocol crossed a threshold in late 2025. Anthropic donated it to the Linux Foundation’s AI and Data Foundation (AAIF), with OpenAI and Block as co-founders. MCP SDK downloads hit 97 million per month in February 2026. The number of publicly available MCP servers surpassed 10,000. First-class MCP client support ships in Claude, ChatGPT, Cursor, Gemini, GitHub Copilot, and VS Code.

MCP won the protocol war. Every major AI platform treats it as the default mechanism for tool use. This is permanent infrastructure, not a trend.

The question is no longer “should we use MCP?” It’s “which MCP servers can we trust?”

The Quality Problem

MCP servers are easy to write and easy to publish. A developer can create one in an afternoon and push it to GitHub. There are now more than 10,000 of them — covering everything from Salesforce CRM to weather APIs to database connectors.

Most of these servers optimize for functionality, not reliability. In a survey of 200 popular open-source MCP servers:

  • 73% lacked proper input validation
  • 61% leaked credentials in debug logs
  • 45% made undocumented outbound network calls

For a developer prototyping in a sandbox, this is acceptable risk. For an enterprise connecting AI agents to production Salesforce, Stripe, or HRIS systems — where tool arguments contain deal data, payment amounts, and employee records — it is a non-starter.

Zapier’s MCP Sharing vs. Quality Gating

Zapier added MCP server sharing in February 2026. This is a significant move — it brings the largest automation platform into the MCP ecosystem. Users can now share MCP server configurations with teammates and across organizations.

But sharing is not vetting. Zapier’s MCP implementation does not publish:

  • Quality tiers or certification levels
  • Automated schema validation results
  • Tool invocation test results
  • Security review processes
  • Error handling verification

The result is the same trust gap that exists in the open-source MCP ecosystem: the server works until it doesn’t, and you won’t know which category you’re in until production data is flowing through it.

JieGou’s 3-Tier Certification Pipeline

JieGou’s MCP Marketplace currently lists 267 curated servers across 16 categories. Every server has passed automated testing before appearing in the catalog. There is no “unreviewed” tier. The certification system makes quality immediately visible.

Tier 1: Community

Community-certified servers pass automated protocol validation:

Schema validation — Tool definitions conform to the MCP specification. Input schemas are valid JSON Schema with complete type annotations. Output schemas are defined and accurate.

Tool discovery — The server responds correctly to tools/list requests. Tool names, descriptions, and parameter definitions are complete and well-formed.

Basic invocation — Each tool can be called with valid inputs and returns a well-formed response. No crashes, no hangs, no undefined behavior on the happy path.

Community certification is fully automated and completes in minutes. It confirms that the server does what it claims to do.

Tier 2: Verified

Verified servers pass the full functional test suite:

Invocation completeness — Every tool is tested with valid inputs, edge-case inputs (empty strings, max-length values, Unicode, special characters), and invalid inputs. All three categories must be handled without crashes or malformed responses.

Error handling — Invalid inputs produce structured MCP error responses with appropriate error codes. No stack traces, no internal state leaked in error messages.

Idempotency — Read operations are verified idempotent. Write operations that claim idempotency are tested with identical calls. Non-idempotent writes are documented.

Connection lifecycle — The server handles connect, disconnect, and reconnect gracefully. Simulated network failures do not leave orphaned resources or corrupted state.

Verified certification includes manual review by a JieGou engineer. A human reads the code, runs the suite, and signs off.

Tier 3: Enterprise

Enterprise-certified servers pass the security review framework covering 6 domains:

Input sanitization — All tool inputs are validated and sanitized before processing. No injection vectors (SQL, shell, path traversal, SSRF).

Credential handling — API keys and OAuth tokens are never logged, never included in error responses, and never stored in plaintext. Credential rotation is supported.

Rate limiting — The server implements backoff and retry logic for downstream API calls. Burst traffic does not cause cascading failures.

Data boundary enforcement — Tool responses contain only the data documented in the schema. No additional fields, no metadata leakage, no cross-tenant data exposure.

Error isolation — Failures in one tool invocation do not affect others. No shared mutable state between requests.

Audit trail — Tool invocations can be logged with sufficient detail for compliance auditing without exposing sensitive data.

Enterprise certification is the highest bar. It is designed for organizations that need SOC 2-grade assurance about every external integration their AI agents use.

What This Means in Practice

Consider a typical enterprise scenario: an AI workflow that pulls deal data from Salesforce, generates a summary, checks inventory in an ERP system, and sends a Slack notification.

That workflow touches four MCP servers. Each one handles sensitive business data on every invocation.

AspectJieGou Certified MarketplaceUncertified MCP Servers
Schema validationAutomated, every serverNot guaranteed
Error handlingTested with edge casesUnknown
Credential safetySecurity-reviewed (Enterprise tier)Developer’s discretion
Quality visibilityBadge on every server cardNo quality signals
Update testingRe-tested on version changesNo regression testing
AccountabilityJieGou reviews and certifiesCommunity-maintained

The difference is not theoretical. It is the difference between “this integration probably works” and “this integration has been tested against 47 failure modes and passed a security review.”

The Pipeline in Numbers

Our automated testing pipeline runs continuously:

  • Schema validation: 100% of servers tested on every catalog update
  • Tool invocation: Each tool tested with 3+ input variants (valid, edge-case, invalid)
  • Connection lifecycle: Simulated disconnect/reconnect for every server
  • Security review: Manual review for Enterprise-tier candidates within 72 hours
  • Regression testing: Re-run on server version updates

Community contributors earn badges (Bronze, Silver, Gold) based on approved submissions, with priority support access and profile recognition.

Quality Is the Differentiator

The MCP ecosystem will continue to grow. More servers, more platforms, more sharing. That growth is good for the protocol.

But for enterprises deploying AI agents in production, the question was never “how many MCP servers exist?” The question is “how many can I trust with my production data?”

JieGou’s answer: every server in the marketplace has been tested. The certification tier tells you exactly how much testing it received. The quality badges are visible on every server card, not buried in documentation.

When an AI agent calls a tool, it should work correctly, handle errors gracefully, protect credentials, and respect data boundaries. That is the baseline — not a premium feature.


Ready to explore the certified MCP marketplace? Visit Integrations to browse 267+ tested servers across 16 categories. Or read our deep dive into MCP enterprise certification for the full security framework.

mcp quality testing certification enterprise zapier integrations
Share this article

Enjoyed this post?

Get workflow tips, product updates, and automation guides in your inbox.

No spam. Unsubscribe anytime.