The order is short: water off, heat off, then find the source. Everything else can wait until those three are done.
Water off
Close the valve on the cold side of the tank. Where a pump is the only means of stopping it, cut the pump. What is already inside will escape through the break, so clear the floor around it.
Heat off
Shut the gas or propane cock at the appliance, or throw the breaker. A unit firing while it empties is a unit that will be replaced rather than repaired.
Finding the source
Rust and water at the base: the vessel. A wet union: a joint. A wet drain: a part. Water from the relief pipe: pressure, temperature or the valve, and never a pipe to cap. Water under the building: follow the pipework before condemning the heater.
When ice is involved
A split opens on a cold night and shows itself later. Gentle warmth, never a flame, and keep water off electrics. If the vessel or the exchanger has split, the appliance is finished.
When gas is present
Leave, avoid switches, and telephone from the road. A propane smell is not a job for a wrench.
What can wait
No hot water with the supply working, a drip in a container, a sooty burner. Those are repairs, described on the repair page. A split shell belongs on the replacement page rather than the repair list.