Skip to content

test_cli_endpoint

diapason.evals.tests.test_cli_endpoint

--base-url/--api-key forwarding through the eval CLI plumbing.

Covers the fix for the eval-CLI endpoint gap: the flags used to be silently dropped for diapason-direct/diapason-agent and ignored by terminalbench-native (which hardcoded api_base="http://localhost:8000/v1").

TestBuildBackendForwardsEndpoint

test_suite_mode_scopes_endpoint_to_external_backends(mock_cls)

[backend.external] suite semantics stay hermes/openclaw-only: first_party_endpoint=False must not forward to first-party.

TestTerminalBenchNativeApiBase

test_api_key_exported_as_openai_api_key_during_run(mock_cls, monkeypatch)

terminus-2 reads OPENAI_API_KEY via LiteLLM; the var must be set during harness.run() and restored afterwards.