Dwindling workforce poses threat to future housing delivery