In order to not “start from scratch”, though, you will need to save some state persistently about your location (and the location of the satellites), which will cost power. Then you go in a building and lose all your signal, while still burning power to maintain that old state.
If it was that easy and cheap in terms of power, AirTags would have GPS receivers. They don’t.