third_party
diapason.evals.comparison.third_party
¶
Path resolution and commit-pin verification for foreign frameworks.
The _third_party.toml file declares the canonical filesystem path and
expected git commit for each foreign framework (Hermes Agent, OpenClaw).
Env vars (HERMES_AGENT_PATH, OPENCLAW_PATH) override the default path.
DIAPASON_ALLOW_COMMIT_DRIFT=1 disables strict commit-pin enforcement.
CommitDriftError
¶
Bases: ThirdPartyError
Raised when the third-party repo's HEAD does not match the pinned commit.
ThirdPartyConfig
dataclass
¶
Top-level config: a map from framework name -> entry.
ThirdPartyEntry
dataclass
¶
One foreign framework's configuration.
ThirdPartyError
¶
Bases: Exception
Base exception for third-party framework problems.
ThirdPartyNotFoundError
¶
Bases: ThirdPartyError
Raised when the third-party path cannot be resolved or doesn't exist.
load_third_party_config(toml_path=None)
¶
Load the third-party config, applying env-var path overrides.
Raises:
| Type | Description |
|---|---|
ThirdPartyNotFoundError
|
if the TOML doesn't exist. |
verify_commit_pin(entry)
¶
Verify the entry's path is at the pinned commit.
Raises:
| Type | Description |
|---|---|
ThirdPartyNotFoundError
|
if the path doesn't exist or isn't a git repo. |
CommitDriftError
|
if HEAD doesn't match pinned_commit, unless
|