io.github.vaaraio/vaara

What we checked

Six static checks, weighted by risk. Every result reflects only what could be observed in the published package and repository — never intent.

• Injection surface

  unscannable25% of grade

  Tool descriptions/manifest scanned for instruction-injection patterns (imperatives at the model, hidden text, 'ignore previous', data-exfil URLs).

  No tool descriptions, server instructions, prompts, or resources were fetched; nothing to scan for injection.

• Supply chain

  fail25% of grade

  Package provenance: namespace verification, repo linkage, maintainer count, account age, postinstall scripts, typosquat distance.

  Python build script executes at build time: network call in build script

• Credential hygiene

  warn15% of grade

  How the server takes secrets (env vs plaintext config vs hardcoded); secrets appearing in tool schemas.

  tests/test_signed_export.py: embeds a PRIVATE KEY block. (in an example/sample file — lower severity, but a real key here still leaks.) Reads secrets from the environment (e.g. src/vaara/integrations/_egress_guard.py) — the recommended intake shape.

• Permission scope

  fail15% of grade

  Declared tools vs. breadth (filesystem, network, exec); flags shell-exec and unbounded filesystem access.

  HIGH: src/vaara/adversarial_classifier.py: references a sensitive credential path (.aws/credentials) — the tool-poisoning exfiltration target. HIGH: src/vaara/integrations/init_governance.py: references a sensitive credential path (/.cursor/) — the tool-poisoning exfiltration target. HIGH: shell/exec capability AND network egress together — download-and-execute risk (src/vaara/integrations/_mcp_upstream.py: subprocess.* call; src/vaara/attestation/_inference_crosscheck.py: outbound HTTP/socket call). HIGH: shell/exec capability AND destructive filesystem writes together (src/vaara/integrations/_mcp_upstream.py: subprocess.* call; src/vaara/audit/sqlite_backend.py: path traversal ('../') combined with file access). discloses shell/exec capability: src/vaara/integrations/_mcp_upstream.py: subprocess.* call discloses shell/exec capability: src/vaara/integrations/claude_code_hooks.py: subprocess.* call discloses shell/exec capability: tests/test_acp_vectors.py: subprocess.* call discloses shell/exec capability: tests/test_agent_decision_vectors.py: subprocess.* call discloses shell/exec capability: tests/test_agent_identity_vectors.py: subprocess.* call discloses shell/exec capability: tests/test_anchor_release.py: subprocess.* call discloses shell/exec capability: tests/test_ap2_vectors.py: subprocess.* call discloses shell/exec capability: tests/test_article12_fold.py: subprocess.* call discloses shell/exec capability: tests/test_attestation_result.py: subprocess.* call discloses shell/exec capability: tests/test_audit_summary.py: subprocess.* call discloses shell/exec capability: tests/test_build_bundle_cli.py: subprocess.* call discloses shell/exec capability: tests/test_bundle_set.py: subprocess.* call discloses shell/exec capability: tests/test_class_gate_vectors.py: subprocess.* call discloses shell/exec capability: tests/test_claude_code_hook_runner.py: subprocess.* call discloses shell/exec capability: tests/test_conformance_corpus.py: subprocess.* call discloses shell/exec capability: tests/test_conformance_statement.py: subprocess.* call discloses shell/exec capability: tests/test_cross_org_handoff.py: subprocess.* call discloses shell/exec capability: tests/test_cross_stack_revocation.py: subprocess.* call discloses shell/exec capability: tests/test_enforcement_attestation.py: subprocess.* call discloses shell/exec capability: tests/test_enforcement_set.py: subprocess.* call discloses shell/exec capability: tests/test_evidence_bundle.py: subprocess.* call discloses shell/exec capability: tests/test_external_evidence_vectors.py: subprocess.* call discloses shell/exec capability: tests/test_governance_decision_vectors.py: subprocess.* call discloses shell/exec capability: tests/test_handoff_set.py: subprocess.* call discloses shell/exec capability: tests/test_ingest_emit.py: subprocess.* call discloses shell/exec capability: tests/test_key_rotation.py: subprocess.* call discloses shell/exec capability: tests/test_normalize.py: subprocess.* call discloses shell/exec capability: tests/test_plugin_config.py: subprocess.* call discloses shell/exec capability: tests/test_pq_hybrid.py: subprocess.* call discloses shell/exec capability: tests/test_record_conformance.py: subprocess.* call discloses shell/exec capability: tests/test_record_set_conformance.py: subprocess.* call discloses shell/exec capability: tests/test_tap_vectors.py: subprocess.* call discloses shell/exec capability: tests/test_threshold_export.py: subprocess.* call discloses shell/exec capability: tests/test_transparency_consistency.py: subprocess.* call discloses shell/exec capability: tests/test_verify_bundle_cli.py: subprocess.* call discloses dynamic code execution: src/vaara/audit_cli.py: uses eval/exec/__import__ discloses dynamic code execution: src/vaara/cli.py: uses eval/exec/__import__ discloses dynamic code execution: tests/test_integrations.py: uses eval/exec/__import__ discloses broad/destructive filesystem access: src/vaara/audit/sqlite_backend.py: path traversal ('../') combined with file access discloses broad/destructive filesystem access: src/vaara/cli.py: destructive filesystem call (shutil.rmtree/os.remove/etc.) discloses broad/destructive filesystem access: tests/test_audit_cli.py: destructive filesystem call (shutil.rmtree/os.remove/etc.) discloses broad/destructive filesystem access: tests/test_bundle_integrity.py: destructive filesystem call (shutil.rmtree/os.remove/etc.) Capability DISCLOSURE, not a verdict: static analysis sees the primitive is present and reachable, not whether its use is attacker-controlled.

• Version behavior

  fail10% of grade

  Diff of tool definitions between versions; new permissions or changed descriptions in a patch release (the postmark-mcp class).

  vs prior 1.37.0 (minor bump): new capability primitive(s) in source: fs-write, http-client, subprocess; new hardcoded outbound host/BCC destination(s): 0.0.0.0, 0xa9fea9fe, 0xa9fea9feee, 10.0.0.5, 127.0.0.1, 169.254.169.254, 169.254.170.2, 169254169254, 172.16.0.1, 192.168.1.10, 224.0.0.1, 240.0.0.1, 2852039166, 2852039167, 8.8.8.8, a.com, agents.example.com, alice.btc.calendar.opentimestamps.org, anthropic, api., api.example.com, api.github.com, api.us-east-1.model.example, b.com, bad.example, bob.btc.calendar.opentimestamps.org, builder, console, eur-lex.europa.eu, example.com, finney.calendar.eternitywall.com, freetsa.org, host, in-toto.io, kdsintf.amd.com, logs.example, m.example, merchant.example, metadata.google.internal, metrics.example.com, ollama, p, pin.test, proxy, psp.example, qtsp.example, rebind.test, remote, schema.org, shop.example.com, slsa.dev, test, timestamp.digicert.com, timestamp.sectigo.com, tsa.example, tsa.test, up, www.w3.org, x.

• Transport config

  warn10% of grade

  Remote servers: TLS and auth mode (none/token/OAuth). Local servers: whether the manifest indicates it phones home.

  manifest/source references tracking behavior — disclosure