Overview
The VoS Scoring report is generated for a production survey that contains validation targets: emplaced ground-truth items whose true identity is known. BTField compares the classification result (the Non-Redundant Dig List) against this ground-truth and produces an Excel scoring report with a ROC curve.
Set the ground-truth validation targets
Validation targets are configured through the seed workflow, but as a validation (ground-truth) set rather than synthetic seeds. When you set them, BTField confirms:
You will be setting ground-truth validation targets for the purpose of generating a VoS scoring report. Please ensure your Dig List stages are selecting all required library items (3ms or 8ms). Do you wish to continue?
Validation targets are drawn on the views with a distinct outline colour so they are easy to tell apart from ordinary targets.
Validation targets are not inverted
Because validation targets are ground-truth (not unknowns), BTField excludes them from inversion. If a survey containing validation targets is run through the Dig List Stage 1 / Auto-Invert flow, BTField reminds you:
This survey has ground-truth for the purpose of generating a VoS scoring report. Please ensure your Dig List stages are selecting all required library items (3ms or 8ms). Do you wish to continue?
The validation targets are used only as ground-truth for scoring; they are not inverted or classified as unknowns.
Generate the report
- Process and classify the survey as usual, and set your Dig List lock / Stop Dig points.
- Open the Generate Dig List Reports dialog and select Dig List and VoS Score as the Report type. BTField confirms:
You will be generating both the Dig List and the VoS Score Report for … purposes. Do you wish to continue?
- BTField writes an Excel VoS Scoring report (a
Validation….xlsxfile) to the same output folder as the Dig List reports.
What the report contains
The VoS Scoring report scores the classified dig list against the ground-truth validation targets and includes a ROC curve summarising detection / classification performance, in line with the Full VoS deliverable defined in the software-control SOP.