The rapper’s stream of antisemitic remarks led to the departure of some team members