PSI - Issue 66

Andrii Kompanets et al. / Procedia Structural Integrity 66 (2024) 388–395 Author name / Structural Integrity Procedia 00 (2025) 000–000

393

6

between crack and background pixels. For example, if an image contains no crack pixels in its ground truth annotations, both TP and FN will be zero, resulting in F1 =0 and IoU =0, regardless of how many false positives are present, thus making these metrics insensitive to false positives. To overcome this limitation, we modify the evaluation process by summing the total number of TP , FP , and FN across all images in the test set. Using these cumulate values, we then compute the overall precision, recall, and F1 -score for the entire test set, providing a more accurate performance assessment.

Fig. 3: Examples of output segmentation maps.