Yes, he actually said that during an affirmative action argument before the Supreme Court:

In the oral arguments Wednesday for a Supreme Court affirmative action case, Justice Antonin Scalia—a well known critic of affirmative action—suggested that the policy was hurting minority students by sending them to schools too academically challenging for them.

Referencing an unidentified amicus brief, Scalia said that there were people who would contend that “it does not benefit African-Americans to — to get them into the University of Texas where they do not do well, as opposed to having them go to a less-advanced school, a less — a slower-track school where they do well.”

He argued that “most of the black scientists in this country don’t come from schools like the University of Texas.”

“They come from lesser schools where they do not feel that they’re — that they’re being pushed ahead in — in classes that are too — too fast for them,” Scalia said.

Remember when I said that I was ready for Scalia to choke on his own bile?

It’s not gonna happen.

If it could, he would have been taken to hospital in an ambulance today.

In fact, half the court would have had to be treated for bile suffocation just from the amount that he spewed.