AI has greater treatment effects on radiologists when the AI assistance underestimates probabilities, rather than overestimates probabilities, given the same absolute error on all pathologies aggregated. The nine bins are presented as -3.560 (95% CI: -9.472 to 2.353), 2.089 (95% CI: 0.334 to 3.844), 2.698 (95% CI: 1.497 to 3.899), 2.483 (95% CI: 1.897 to 3.070), 0.398 (95% CI: 0.235 to 0.561), -2.933 (95% CI: -3.787 to -2.079), -5.018 (95% CI: -6.516 to -3.519), -6.968 (95% CI: -9.346 to -4.591) and -16.845 (95% CI: -24.288 to -9.403). The error bars show 95% CIs. The blue bars show the overall treatment effect across AI error. * and ** indicate statistically significant difference among subgroups of different AI signed error through a joint equality test at a significance level of 0.05 and 0.01, respectively.
