Line Of The Day

"Are you gonna party and get wasted with allergies?"

"Nope, I feel too sick."

"You don't party with them white boys then."

I still don't understand what the last line had to do with being sick.