artifact_coverage

Strict identity coverage checks for expensive Puzzletron campaign artifacts.

Classes

CoverageReport

CoverageRow

Functions

verify_campaign_artifacts

Compare required campaign identities without mutating any artifact.

verify_real_campaign_artifacts

Audit durable campaign identities immediately before no-bypass MIP.
class CoverageReport

Bases: object

__init__(rows, identity_mismatches, bypass_enabled)
Parameters:

  • rows (Mapping[str, CoverageRow])

  • identity_mismatches (Mapping[str, tuple[Any, Any]])

  • bypass_enabled (bool)

Return type:

None

bypass_enabled: bool
property complete: bool
identity_mismatches: Mapping[str, tuple[Any, Any]]
require_complete()
Return type:

None

rows: Mapping[str, CoverageRow]
class CoverageRow

Bases: object

__init__(expected, present, missing, extra)
Parameters:

  • expected (tuple[Hashable, ...])

  • present (tuple[Hashable, ...])

  • missing (tuple[Hashable, ...])

  • extra (tuple[Hashable, ...])

Return type:

None

classmethod compare(expected, present)
Parameters:

  • expected (Iterable[Hashable])

  • present (Iterable[Hashable])

Return type:

CoverageRow

expected: tuple[Hashable, ...]
extra: tuple[Hashable, ...]
missing: tuple[Hashable, ...]
present: tuple[Hashable, ...]
verify_campaign_artifacts(*, expected_scores, present_scores, expected_runtimes, present_runtimes, expected_depths, present_depths, expected_identity, observed_identity, bypass_enabled)

Compare required campaign identities without mutating any artifact.

Parameters:

  • expected_scores (Iterable[Hashable])

  • present_scores (Iterable[Hashable])

  • expected_runtimes (Iterable[Hashable])

  • present_runtimes (Iterable[Hashable])

  • expected_depths (Iterable[Hashable])

  • present_depths (Iterable[Hashable])

  • expected_identity (Mapping[str, Any])

  • observed_identity (Mapping[str, Any])

  • bypass_enabled (bool)

Return type:

CoverageReport

verify_real_campaign_artifacts(puzzle_dir, *, expected_depth_scenarios, bypass_enabled, expected_checkpoint_dir=None, expected_data_identity=None)

Audit durable campaign identities immediately before no-bypass MIP.

Parameters:

  • puzzle_dir (str | Path)

  • expected_depth_scenarios (int)

  • bypass_enabled (bool)

  • expected_checkpoint_dir (str | Path | None)

  • expected_data_identity (Mapping[str, Any] | None)

Return type:

CoverageReport