A theory is presented that establishes a dominance hierarchy of potential distinctions (order relations) between two distributions. It is proposed that it is worthwhile for the researcher to ascertain the strongest possible distinction, because all weaker distinctions are logically implied. Implications of the theory for hypothesis testing, theory construction and scales of measurement are considered. Open problems for future research are outlined.