Roughly half the calls a plumber gets about a cold shower trace back to an undersized unit, not a broken one. Getting a tankless water heater installed the right way is less about the box on the wall and more about the gas line, the vent path, and the flow-rate math done before anyone picks up a wrench. Do that homework and you get endless hot water in a footprint the size of a carry-on suitcase. Skip it, and you get lukewarm frustration you paid a premium for. This guide walks through what actually happens during a proper install, what it costs, and where projects go sideways.
- How a Tankless Unit Actually Works
- Sizing: The Step That Makes or Breaks the Project
- Gas Versus Electric
- What the Installation Actually Involves
- Real Costs You Should Budget
- Permits, Code, and Why They Matter
- Maintenance That Protects Your Investment
- Point-of-Use Versus Whole-House Strategy
- Recirculation and the Cold-Water Sandwich
- Is It Worth It for Your Home?
How a Tankless Unit Actually Works
A conventional tank keeps 40 to 50 gallons hot around the clock, whether you use it or not. A tankless heater sits idle until you open a hot tap. Then a flow sensor fires either a gas burner or a bank of electric elements, and water races through a heat exchanger, leaving at your target temperature within a couple of seconds. Because nothing sits stored, standby heat loss disappears, and that is where the 24 to 34 percent efficiency gain the Department of Energy cites comes from for households using under 41 gallons a day.
The catch is capacity. A tank can dump its whole reserve at once. A tankless unit can only heat as fast as water moves past the exchanger, measured in gallons per minute. That single number, and the incoming water temperature it has to overcome, decides whether your install feels luxurious or leaves someone shivering when the dishwasher kicks on.
Sizing: The Step That Makes or Breaks the Project
Sizing starts with two figures: the flow rate you need at peak, and the temperature rise required. Add up fixtures that might run together. A shower pulls about 2.0 to 2.5 gpm, a kitchen faucet 1.5 gpm, a washing machine 2.0 gpm. Two showers at once already demand roughly 5 gpm.
Temperature rise is the gap between your groundwater and your target, usually 120 degrees Fahrenheit at the tap. In southern states, incoming water might be 65 degrees, a 55-degree rise. In a Minnesota winter, it can drop to 40 degrees, an 80-degree rise, and that same heater’s output falls dramatically. A gas unit rated for 9 gpm in Florida may only deliver 5 gpm in the upper Midwest. Size for your coldest month, not the spec sheet’s best case, or you will be sizing again next January.
Gas Versus Electric
Gas whole-house units dominate for a reason: a single condensing model can push 8 to 11 gpm and serve a family of four with room to spare. Electric whole-house units exist but draw brutal amperage. A unit covering a cold-climate home can demand 120 to 150 amps across multiple 40-amp breakers, which frequently means a 200-amp service panel and sometimes a costly utility upgrade.
- Gas (condensing): 90 to 98 percent efficient, higher unit cost, needs sealed venting and often a bigger gas line
- Gas (non-condensing): around 80 to 85 percent efficient, cheaper, requires stainless Category III venting that adds cost
- Electric: lower equipment price, simple to vent (none needed), but panel and wiring upgrades can erase the savings
Electric shines for point-of-use jobs: a single bathroom addition, a workshop sink, a cabin. For a busy household in a cold region, gas is almost always the practical answer.
What the Installation Actually Involves
Once you have a tankless water heater installed on paper, the physical work covers several trades. A gas retrofit is rarely a simple swap. The old tank drains and comes out, but a half-inch gas line that fed it usually cannot supply a burner rated at 150,000 to 199,000 BTU. Expect the installer to run new three-quarter-inch pipe from the meter, or verify the existing line is adequate.
Venting is the next hurdle. Condensing units vent through PVC or polypropylene out a side wall, which is often cheaper and easier than reusing an old vertical flue. The unit also produces acidic condensate that must drain to a proper location, frequently through a neutralizer cartridge so it does not eat your pipes or violate code. Mounting, water connections with isolation valves, and electrical for the control board round out a job that typically runs six to ten hours for a clean retrofit.
Real Costs You Should Budget
The unit alone runs $500 to $1,500 for gas and $500 to $700 for a solid electric whole-house model. Installation is where numbers swing. A straightforward like-for-like gas replacement might land at $1,500 to $2,500 all in. A full retrofit that needs a new gas line, new venting, and a condensate drain commonly reaches $3,000 to $4,500, and difficult routing or panel upgrades push it higher.
Two costs homeowners forget: the permit and the isolation valve kit. Nearly every jurisdiction requires a permit and inspection for gas and venting work, typically $75 to $300. A pair of isolation valves adds $50 to $100 but makes the annual descaling flush a twenty-minute task instead of a plumber’s visit. Skipping them to save fifty bucks is the definition of penny wise.
Permits, Code, and Why They Matter
Gas appliances and combustion venting are life-safety systems. An inspector checks vent slope, clearance to windows and soffits, gas pressure, and combustion air. Unpermitted work can void your homeowner’s insurance and surface as a red flag when you sell. Any licensed installer will pull the permit as standard; if a bidder suggests skipping it, that tells you everything about their standards.
Maintenance That Protects Your Investment
Tankless heaters last 20 years or more, roughly double a tank’s lifespan, but only with upkeep. Hard water scales the heat exchanger, and scale is the number one killer. In hard-water regions, flush the unit with a vinegar or descaling solution once a year through those isolation valves. Clean the inlet screen filter every few months, and if you have a condensing model, check the condensate neutralizer annually and swap the media when it stops fizzing.
Watch for a rising error code or a slow decline in output temperature. Both usually mean scale, and catching it early keeps a $200 flush from becoming a $1,000 exchanger replacement.
Point-of-Use Versus Whole-House Strategy
Not every home benefits from a single central unit. In a sprawling one-story or a house where the master bath sits far from the utility room, you wait a long time for hot water to travel the pipes, wasting gallons down the drain every morning. A point-of-use tankless heater, mounted right under the sink or in the wall near a distant bathroom, solves that by producing hot water at the fixture instantly.
Some households run a hybrid strategy: a whole-house gas unit handling the bulk of demand, plus a small electric point-of-use heater dedicated to a remote bathroom or a wet bar. This eliminates the long wait and the water waste at the far end of the house without oversizing the main unit. It costs more upfront in equipment, but for a large or spread-out floor plan it can pay back in comfort and water savings, and it takes pressure off the central heater during peak demand.
Recirculation and the Cold-Water Sandwich
The most common complaint after a tankless install is the so-called cold-water sandwich, a brief slug of cool water that arrives mid-shower when the burner cycles between draws. It happens because the unit shuts off when you close a tap, leaving cooled water in the line that reaches you before the newly heated water catches up. It is a quirk of how on-demand heating works, and it is manageable.
Many modern units offer a built-in recirculation feature or pair with a dedicated recirculation pump and a small buffer tank. Recirculation keeps hot water primed near your fixtures, so you get near-instant hot water and far less of that temperature swing. It does use a bit more energy to keep water moving, so weigh the comfort against the efficiency, but for households that hate the wait or the sandwich, a recirculation setup is often the feature that makes them love the system rather than tolerate it.
Is It Worth It for Your Home?
If you are replacing a failed tank and already have adequate gas and a convenient vent path, the premium over a new tank is modest and the long-term payback in efficiency and lifespan is real. If your project demands a new gas line, a service upgrade, and complex venting, the math gets tighter and depends on how much you value endless hot water and reclaimed floor space. For a growing family that regularly runs out of hot water, a correctly sized tankless install solves the problem permanently. For a light-use household on cheap electricity, a heat-pump tank may pencil out better.
The bottom line is simple: a tankless heater is only as good as the sizing and installation behind it. Get the flow-rate math right for your coldest month, hire a licensed pro who pulls the permit, insist on isolation valves, and commit to the annual flush. Do that, and the unit on your wall will still be quietly delivering hot showers long after a tank would have rusted through and flooded your utility room.