Downsizers are struggling to find buyers for detached homes