IPSE warns of “brittle workforce” after “disproportionate and disturbing” self-employed slump