Turn off the water, turn off the burner (or electric), unscrew the old, a little Teflon tape one the new and screw the new one in. If there is zero way for air to get in, then no water will leak out when the valve is removed, though I'd be the unlucky person with a basement full of hot water.
Good luck. It should be easy, but things often go wrong.
Plumbing
Hot