Why do undergraduate admissions in the U.S take into account nonacademic criteria?

College admissions in the U.S. takes into account many factors that are rarely considered in other countries and seem unrelated to academics. For example, legacy status (children of alumni may be given preference), athletics, extracurricular activities, etc. Why do these nonacademic criteria play a larger role in the U.S. than they do elsewhere?