Skip to content

third_party

diapason.evals.comparison.third_party

Path resolution and commit-pin verification for foreign frameworks.

The _third_party.toml file declares the canonical filesystem path and expected git commit for each foreign framework (Hermes Agent, OpenClaw). Env vars (HERMES_AGENT_PATH, OPENCLAW_PATH) override the default path. DIAPASON_ALLOW_COMMIT_DRIFT=1 disables strict commit-pin enforcement.

CommitDriftError

Bases: ThirdPartyError

Raised when the third-party repo's HEAD does not match the pinned commit.

ThirdPartyConfig dataclass

Top-level config: a map from framework name -> entry.

ThirdPartyEntry dataclass

One foreign framework's configuration.

ThirdPartyError

Bases: Exception

Base exception for third-party framework problems.

ThirdPartyNotFoundError

Bases: ThirdPartyError

Raised when the third-party path cannot be resolved or doesn't exist.

load_third_party_config(toml_path=None)

Load the third-party config, applying env-var path overrides.

Raises:

Type Description
ThirdPartyNotFoundError

if the TOML doesn't exist.

verify_commit_pin(entry)

Verify the entry's path is at the pinned commit.

Raises:

Type Description
ThirdPartyNotFoundError

if the path doesn't exist or isn't a git repo.

CommitDriftError

if HEAD doesn't match pinned_commit, unless DIAPASON_ALLOW_COMMIT_DRIFT=1 is set (then logs a warning).