3 checks that ran failed — permission scope, version behavior and transport config — so this release can’t be trusted as-is.
- Publisher
- io.github.sipyourdrink-ltd
- Repository
- github.com/sipyourdrink-ltd/bernstein
- Install
- pypi:bernstein, oci:ghcr.io/sipyourdrink-ltd/bernstein:3.4.3, pypi:bernstein, oci:ghcr.io/sipyourdrink-ltd/bernstein:3.4.4, pypi:bernstein, oci:ghcr.io/sipyourdrink-ltd/bernstein:3.5.0, pypi:bernstein, oci:ghcr.io/sipyourdrink-ltd/bernstein:3.6.0, pypi:bernstein, oci:ghcr.io/sipyourdrink-ltd/bernstein:3.7.0, pypi:bernstein, oci:ghcr.io/sipyourdrink-ltd/bernstein:3.8.0, pypi:bernstein, oci:ghcr.io/sipyourdrink-ltd/bernstein:3.8.1, pypi:bernstein, oci:ghcr.io/sipyourdrink-ltd/bernstein:3.8.2, pypi:bernstein, oci:ghcr.io/sipyourdrink-ltd/bernstein:3.8.3, pypi:bernstein, oci:ghcr.io/sipyourdrink-ltd/bernstein:3.8.4, pypi:bernstein, oci:ghcr.io/sipyourdrink-ltd/bernstein:3.10.0, pypi:bernstein, oci:ghcr.io/sipyourdrink-ltd/bernstein:3.9.0, pypi:bernstein, oci:ghcr.io/sipyourdrink-ltd/bernstein:3.11.0, pypi:bernstein, oci:ghcr.io/sipyourdrink-ltd/bernstein:3.12.0, pypi:bernstein, oci:ghcr.io/sipyourdrink-ltd/bernstein:3.13.0, pypi:bernstein, oci:ghcr.io/sipyourdrink-ltd/bernstein:3.14.159, pypi:bernstein, oci:ghcr.io/sipyourdrink-ltd/bernstein:3.15.0, pypi:bernstein, oci:ghcr.io/sipyourdrink-ltd/bernstein:3.15.1, pypi:bernstein, oci:ghcr.io/sipyourdrink-ltd/bernstein:3.16.0, pypi:bernstein, oci:ghcr.io/sipyourdrink-ltd/bernstein:3.17.0, pypi:bernstein, oci:ghcr.io/sipyourdrink-ltd/bernstein:3.17.1, pypi:bernstein, oci:ghcr.io/sipyourdrink-ltd/bernstein:3.17.2
- Versions
- 22
- Inspected
- 5 of 6 checks · 75%
- Scored
- 2026-08-31 · rubric 1.0.0
What we checked
Six static checks, weighted by risk. Every result reflects only what could be observed in the published package and repository — never intent.
Injection surface
unscannable25% of gradeTool descriptions/manifest scanned for instruction-injection patterns (imperatives at the model, hidden text, 'ignore previous', data-exfil URLs).
No tool descriptions, server instructions, prompts, or resources were fetched; nothing to scan for injection.
Supply chain
pass25% of gradePackage provenance: namespace verification, repo linkage, maintainer count, account age, postinstall scripts, typosquat distance.
repository linkage verified
Credential hygiene
warn15% of gradeHow the server takes secrets (env vs plaintext config vs hardcoded); secrets appearing in tool schemas.
src/bernstein/adapters/claude.py: assigns a literal to SECRET (${BE…N} (len 47)) — non-provider secret literal; prefer environment intake. Reads secrets from the environment (e.g. examples/plugins/custom_router_plugin.py) — the recommended intake shape.
Permission scope
fail15% of gradeDeclared tools vs. breadth (filesystem, network, exec); flags shell-exec and unbounded filesystem access.
HIGH: downloads and pipes straight to a shell (src/bernstein/adapters/cursor.py: pipes a download into a shell). references credential paths: src/bernstein/adapters/use_cases.py: references a credential path (/mcp.json) references credential paths: src/bernstein/cli/commands/remote_cmd.py: references a credential path (/.ssh/) has both shell/exec and destructive filesystem writes (benchmarks/bench_orchestrator.py: subprocess.* call; benchmarks/bench_orchestrator.py: destructive filesystem call (shutil.rmtree/os.remove/etc.)). discloses shell/exec capability: 92 files (benchmarks/bench_orchestrator.py, benchmarks/bench_startup.py, benchmarks/run_benchmark.py, +89 more) discloses dynamic code execution: benchmarks/swe_bench/run.py: uses eval()/exec() discloses dynamic code execution: src/bernstein/cli/commands/remote_cmd.py: uses eval()/exec() discloses dynamic code execution: src/bernstein/core/agents/container.py: uses eval()/exec() discloses broad/destructive filesystem access: 65 files (benchmarks/bench_orchestrator.py, benchmarks/bench_quality_gates.py, benchmarks/bench_startup.py, +62 more) Capability DISCLOSURE, not a verdict: static analysis sees the primitive is present and reachable, not whether its use is attacker-controlled.
Version behavior
fail10% of gradeDiff of tool definitions between versions; new permissions or changed descriptions in a patch release (the postmark-mcp class).
vs prior 3.17.1 (patch bump): new capability primitive(s) in source: child_process, dynamic-eval, fs-write, http-client, net, subprocess; new hardcoded outbound host/BCC destination(s): ..., 0.0.0.0, 127.0.0.1, adaptivecards.io, ampcode.com, api.anthropic.com, api.bernstein.run, api.cloudflare.com, api.github.com, api.linear.app, api.openai.com, api.together.xyz, app.factory.ai, auth.example.com, autohand.ai, benchmark, bernstein-server, bernstein.readthedocs.io, bernstein.run, cdnjs.cloudflare.com, central, claude.ai, cli.devin.ai, cli.github.com, cursor.com, discord.com, docs.anthropic.com, docs.astral.sh, docs.augmentcode.com, docs.aws.amazon.com, docs.cline.bot, dtrack.example.com, evil, example.com, files.pythonhosted.org, forgecode.dev, g4f.space, git-scm.com, github.com, glitchtip.example.com., google.github.io, hermes-agent.nousresearch.com, hooks.slack.com, hub.oxen.ai, img.shields.io, iterm2.com, junie.jetbrains.com, kilocode.ai, kiro.dev, linear.app, mistral.ai, my-agent-worker.account.workers.dev, mycompany.atlassian.net, ollama.com, openai.github.io, opencode.ai, openrouter.ai, org.atlassian.net, plandex.ai, pypi.org, raw.githubusercontent.com, registry.npmjs.org, s3.amazonaws.com, schema.org, shields.io, sipyourdrink-ltd.github.io, slack.com, sourcegraph.com, support.atlassian.com, sw.kovidgoyal.net, www.codebuff.com, www.continue.dev, www.kimi.com, www.npmjs.com, www.python.org, www.w3.org, your-host, your-org.atlassian.net, your-org.webhook.office.com, your-server.
Transport config
fail10% of gradeRemote servers: TLS and auth mode (none/token/OAuth). Local servers: whether the manifest indicates it phones home.
source performs runtime self-update / download-and-execute (bypasses version_behavior); sends telemetry to third-party SDK (amplitude) — disclosure, verify opt-in; manifest/source references tracking behavior — disclosure
Version history
Each release plotted by grade against the safe line at B. A version that sinks below the line has lost its trusted standing — the shape of a rug-pull.
| Version | Published | Grade | Score | Inspected | Change |
|---|---|---|---|---|---|
| v3.17.2 · current | 2026-08-24 | D | 57.5 | 5/6 · 75% | B→D in v3.17.2 |
| v3.17.1 | 2026-08-22 | B | 75 | 4/6 · 65% | ±0 |
| v3.17.0 | 2026-08-21 | B | 75 | 4/6 · 65% | ±0 |
| v3.16.0 | 2026-08-17 | B | 75 | 4/6 · 65% | ±0 |
| v3.15.1 | 2026-08-14 | B | 75 | 3/6 · 55% | D→B in v3.15.1 |
| v3.14.159 | 2026-08-10 | D | 42.5 | 5/6 · 75% | F→D in v3.14.159 |
| v3.13.0 | 2026-08-01 | F | 32.5 | 5/6 · 75% | C→F in v3.13.0 |
| v3.12.0 | 2026-08-01 | C | 67.5 | 5/6 · 75% | D→C in v3.12.0 |
| v3.11.0 | 2026-07-28 | D | 42.5 | 4/6 · 65% | F→D in v3.11.0 |
| v3.10.0 | 2026-07-25 | F | 32.5 | 5/6 · 75% | ±0 |
| v3.9.0 | 2026-07-25 | F | 32.5 | 5/6 · 75% | ±0 |
| v3.8.4 | 2026-07-24 | F | 32.5 | 5/6 · 75% | D→F in v3.8.4 |
| v3.8.3 | 2026-07-22 | D | 42.5 | 5/6 · 75% | ±0 |
| v3.8.2 | 2026-07-20 | D | 42.5 | 4/6 · 65% | C→D in v3.8.2 |
| v3.7.0 | 2026-07-17 | C | 70 | 4/6 · 65% | — |