Scatter Plot from Scientific Research

We plotted the Pearson correlation coefficient of ID versus OOD performance versus the Pearson correlation coefficient of ID versus OOD fairness. Here, each point was derived from a grid of models trained on a particular combination of task and attribute. We found that there was a high correlation between ID and OOD performance in all cases, but the correlation between ID and OOD fairness was tenuous.

DOI