The water needs to be turned off.
You should shut the water down into your tank when you have a leaky heating system. The cool inlet tubes are shut down by your tank with a special hot water heater shut off valve.