Yeah, usually bullies are jerks, but in the episode in question, he finds out something radically different about Larry that prevents him from seeing him the same way again: Larry's attracted to *guys*, as it turns out.