Repository navigation
Land filter gentle threshold - #31
Merged
Merged
Conversation
Collaborators asked for maximum gentleness: only unambiguous land should be screened, nothing with water, a lagoon, or a beach that could hold birds. Sets WATER_LOSS_BUDGET to 0.0 (was 0.03), moving the fitted operating point from 0.610 (87.5% land recall, 1/37 water lost) to 0.920 (33.3% land recall, 0/37 water lost) on the current 61 labelled frames. Also adds a Mixed-frame diagnostic to the refit script so that once collaborators label some Mixed (shoreline) frames, we can directly check the threshold doesn't screen them. Co-Authored-By: Claude Sonnet 5 <noreply@anthropic.com>
The check added in the previous commit only looked at the primary "Land Screen" project and only had features for images already in manifest.csv. Both real Mixed annotations that exist (found right after that commit, on BOEM - Land Screen Validation) come from the broader mined pool used for validation sampling, so the check silently produced zero rows instead of catching them. Now pulls labels from both projects and falls back to new_flight_scores.csv / new_flight_scores_deep.csv for features. Refit with one new Water label since the last commit: threshold 0.920 -> 0.910, cv_auc 0.968 -> 0.971. Confirmed both known Mixed frames score below the new threshold (0.860 and 0.907 vs 0.910) -- both would have been wrongly flagged as land under the old 0.610 threshold, neither is now. Co-Authored-By: Claude Sonnet 5 <noreply@anthropic.com>
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
No description provided.