Skip to main content
Glama
pipsyncio

PipSync MCP Evals

Official
by pipsyncio

PipSync MCP Evals

面向交易工具设计的公开安全评估和一个无执行能力的 MCP 模拟器(mock)。

该仓库构建并展示了三个边界:

  • 只读的合成信号列表;

  • 确定性的、不可执行的纸面预览;

  • 一个具备实盘能力的确认 schema,公开的 mock 始终会阻止它。

该 mock 不包含网络客户端、API 密钥加载器、凭证存储、券商适配器或订单下达实现。

运行评估

PYTHONPATH=src python -m pipsync_mcp_evals.evals
PYTHONPATH=src python -m unittest discover -s tests -v

Related MCP server: TrustHarness

运行 stdio mock

PYTHONPATH=src python -m pipsync_mcp_evals.server

它每行接受一条 JSON-RPC 消息,并实现了现代、无状态的 MCP 2026-07-28 接口:server/discovertools/listtools/call。每个请求都必须在 params._meta 中携带 io.modelcontextprotocol/protocolVersionio.modelcontextprotocol/clientCapabilities;每个成功结果都会携带 resultType 和服务器身份元数据。旧版 initialize 会被拒绝,并附带明确的迁移提示和所支持的协议版本。

评估强制执行的内容

  • 每个工具都有明确的 MCP 注解。

  • 工具输入 schema 会拒绝未知字段。

  • 确认操作被归类为非只读且具有破坏性。

  • 确认需要 account、preview、confirmation、idempotency 和 risk-hash 字段。

  • 缺少确认数据时会 fail-closed(默认拒绝)。

  • 即使结构完整的确认,也会返回 mock_server_no_execution

  • 预览输出是确定性的,并明确不可执行。

  • 缺少请求元数据或协议版本不受支持时,将按照当前 MCP 错误契约失败。

注解只是提示,而不是授权边界。任何真实可写服务器,都必须在每次券商调用前独立强制执行经过认证的租户/账户所有权、权限、最新券商状态、风险闸门、显式实盘模式、幂等性、审计和人工确认。

该目录以 MCP 2026-07-28 工具契约 及其 无状态发现契约 为基准。

许可证

Apache-2.0.

A
license - permissive license
Not graded
quality - not tested
B
maintenance

Maintenance

Maintainers
Response time
Release cycle
1Releases (12mo)
Commit activity

Resources

Unclaimed servers have limited discoverability.

Looking for Admin?

If you are the server author, to access and configure the admin panel.

Related MCP Servers

  • A
    license
    Not graded
    quality
    D
    maintenance
    A lightweight stdio proxy that intercepts and rewrites MCP tool annotations to bypass security approval prompts in AI CLIs like Codex and Claude Code. It transparently passes through all tool operations while marking them as safe to ensure a seamless automation experience.
    11
    10
    MIT
  • A
    license
    B
    quality
    C
    maintenance
    Enables deterministic security testing of AI agents that use tools by serving synthetic MCP environments with poisoned data, fake secrets, and privileged actions. Records agent tool calls and evaluates security invariants (e.g., canary leaks, forbidden access, approval binding) without an LLM judge or real systems.
    8
    MIT
  • A
    license
    Not graded
    quality
    B
    maintenance
    A task-scoped MCP stdio proxy that learns candidate least-privilege policies from labeled successful runs, requires human review, enforces exact decisions, detects tool-definition drift, and emits privacy-minimized JSONL events for Wazuh.
    1
    Apache 2.0
  • A
    license
    Not graded
    quality
    C
    maintenance
    A fail-closed policy boundary that translates local stdio MCP clients to authenticated Streamable HTTP servers, enforcing allowlists or read-only modes and redacting credentials from audit trails.
    Apache 2.0

View all related MCP servers

Related MCP Connectors

View all MCP Connectors

Latest Blog Posts

MCP directory API

We provide all the information about MCP servers via our MCP API.

curl -X GET 'https://glama.ai/api/mcp/v1/servers/pipsyncio/pipsync-mcp-evals'

If you have feedback or need assistance with the MCP directory API, please join our Discord server