Broker business hits record high despite confidence fall