Skip to content

A benchmark example may carry its own cutoff - #99

Open
tarekziade wants to merge 1 commit into
mainfrom
bench/per-example-cutoff
Open

tarekziade wants to merge 1 commit into
mainfrom
bench/per-example-cutoff

Conversation

@tarekziade

Copy link
Copy Markdown
Collaborator

A run-level --before puts one instant on every example in a set. That is
right for a smoke test and wrong for a set whose examples come from different
points in history: twenty examples drawn from twenty issues have twenty
cutoffs, and a flag holds exactly one.

Example gains before (ISO 8601, timezone-aware or refused — a cutoff with
no zone is a different instant depending on who runs the set) and exclude,
both defaulting to nothing, so every existing frozen set stays loadable and
every untimed run is unchanged.

IndexSystem.window() narrows an example's window against the run's. An
example may narrow the run and can never widen it
— the same rule, and the
same argument, as the AsOf daemon pin: a bound the run was started with is
not something the data it reads may lift. Exclusions are the union, because
neither side is entitled to readmit the other's withheld thread.

The signal post-filter is now pinned per example rather than per run: it
re-derives each hit thread's signals as of a cutoff, so a run-level one would
size the leak against the wrong instant for every example carrying its own.

20 tests. Suite 1326 passed, 4 skipped, 2 xfailed on both dialects.

🤖 Generated with Claude Code

A run-level --before puts one instant on every example in a set. That is right
for a smoke test and wrong for a set whose examples come from different points
in history: twenty examples drawn from twenty issues have twenty cutoffs, and a
flag holds exactly one.

Example gains `before` (ISO 8601, timezone-aware or refused -- a cutoff with no
zone is a different instant depending on who runs the set) and `exclude`, both
defaulting to nothing, so every existing frozen set stays loadable and every
untimed run is unchanged.

IndexSystem.window() narrows an example's window against the run's. An example
may narrow the run and can never widen it -- the same rule, and the same
argument, as the AsOf daemon pin: a bound the run was started with is not
something the data it reads may lift. Exclusions are the union, because neither
side is entitled to readmit the other's withheld thread.

The signal post-filter is now pinned per example rather than per run: it
re-derives each hit thread's signals as of a cutoff, so a run-level one would
size the leak against the wrong instant for every example carrying its own.

20 tests. Suite 1326 passed, 4 skipped, 2 xfailed on both dialects.

Co-Authored-By: Claude Opus 5 (1M context) <noreply@anthropic.com>

This branch has not been deployed

No deployments
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant