My obscure nostalgia moment from the N64 was the game Blast Corps, where you had to destroy buildings with a range of vehicles to clear a path for a nuclear missile on a truck. Getting the side-swiper to skid just right was so satisfying.
And of course Banjo-Kazooie, as much for the immersive soundtrack as the colourful worlds.