My point exactly. I could quite easily imagine my life without ever building a house. And so could everyone else. So your argument doesn’t really work.
I’m not entirely sure what you’re trying to say, so let me rephrase the question. What exactly would have to change to adhere to this tenet, and why would that benefit society?
Recognition isn’t as important as you make it sound. And most people will hardly start to work out of boredom. There’s plenty of ways to spend your time that are not productive.
In addition, there are plenty of jobs literally nobody wants to do, and consequently, nobody would do under your proposed system.