WDYM by “directory it drops down into”? nix develop stays in your current working directory.
If I wanted to clean up state, I’d create a clean task in the build system or build a clean script that I’d wire up to the flake outputs such that you could run nix run .#clean.