It is most effective to do this when the table is empty so you are not slowing down play for other folks, but most people today will be understanding or move to a diverse table.