Traditional water heaters keep 40 or 50 gallons hot around the clock, burning energy even when nobody’s home. A tankless unit heats water only when you turn on the tap. But how does a tankless water heater work exactly, and is it worth the higher upfront cost? Let’s break down the technology, the math, and the maintenance.
The Core Technology: Heating on Demand
Inside a tankless unit is a powerful heat exchanger — either a gas burner or electric heating elements. When you open a hot water tap, a flow sensor detects the movement and fires the burner or elements instantly. Cold water flows through the heat exchanger’s coils, picks up heat in seconds, and arrives at your tap at the set temperature. Close the tap and the unit shuts off completely. There’s no tank, no pilot light burning all day, and no standby heat loss — which is where the efficiency gains come from. The Department of Energy’s guide to tankless water heaters explains the efficiency ratings in detail.
Gas vs. Electric Models
- Gas tankless: Higher flow rates (typically 5–10 gallons per minute), better for whole-house use, but requires gas lines and venting. Installation is more complex and expensive.
- Electric tankless: Easier to install, no venting needed, but lower flow rates (2–5 GPM) and they demand serious electrical capacity — often requiring panel upgrades.
For most whole-house applications in colder climates, gas wins. For point-of-use (a single bathroom or sink), electric is simpler and cheaper.
Sizing: The Number That Matters Most
The critical spec is flow rate, measured in gallons per minute (GPM), matched against your groundwater temperature. A shower uses about 2.5 GPM; a dishwasher about 1.5. If your incoming water is 50°F and you want 120°F at the tap, the heater must raise the temperature 70 degrees at your peak flow rate. Undersize the unit and you’ll get lukewarm showers when two fixtures run at once — the number one complaint about tankless systems. When in doubt, size up slightly or install two units in different zones of a large home.
Pros and Cons, Honestly
Advantages: 20+ year lifespan (roughly double a tank heater), endless hot water, smaller footprint, lower energy bills (24–34% savings for typical households per DOE estimates), and no catastrophic tank rupture flooding your basement.
Disadvantages: Higher upfront cost ($1,000–$3,000 installed vs. $500–$1,500 for tank), the “cold water sandwich” (a brief burst of cool water when the unit cycles), minimum flow requirements (a trickling tap may not trigger heating), and annual descaling maintenance in hard-water areas.
Maintenance: Descaling Is Non-Negotiable
Mineral buildup is the enemy of tankless units, especially with hard water. Once a year, flush the system with white vinegar or a descaling solution using a small pump — kits cost about $100–$150, or a plumber will do it for $150–$250. Skip this and efficiency drops, flow sensors clog, and the heat exchanger can fail years early. Installing a water softener or scale inhibitor upstream dramatically extends service intervals. Pairing your system with good water treatment — like the shower filters we cover in our guide — also protects fixtures throughout the house.
Is It Worth Switching?
Do the math on your situation: if your tank heater is dying anyway, the incremental cost of going tankless is modest. If your tank is new, the payback period stretches to 7–12 years, so it may not pencil out. Households with high hot water use (big families, frequent guests) benefit most. Also check for utility rebates — many gas and electric companies offer $200–$500 incentives for high-efficiency tankless units, which shortens the payback considerably.
Start with the technical overview of tankless water heating if you want the engineering details before you shop.
Installation: What It Really Costs
The unit itself runs $500–$1,500 for a quality residential model, but installation is where the bill grows. A straightforward replacement of an existing gas tank heater with a gas tankless unit typically costs $2,000–$4,500 total, including the unit, venting upgrades, gas line upsizing, and labor. Electric units are cheaper to install ($1,000–$2,500) but may require a $1,500–$3,000 electrical panel upgrade if your home lacks capacity — get an electrician’s assessment before buying. Homes switching fuel types (electric to gas) face the highest costs since new gas lines and venting must be run. Always get three quotes; this is not a DIY job for most homeowners because gas and venting mistakes are dangerous.
Top Brands Worth Considering
The tankless market has clear leaders. Rinnai dominates the premium gas segment with excellent reliability and a strong warranty network. Navien offers high-efficiency condensing units at competitive prices and is popular with installers. Rheem provides solid mid-range options widely available at home centers. Noritz has a long track record in the category. For electric, Stiebel Eltron and EcoSmart are the names to know. Warranty length (12–15 years on heat exchangers for top brands) is a good proxy for build quality.
Common Problems and Troubleshooting
- Lukewarm water with multiple fixtures: The unit is undersized for your peak demand. Reduce simultaneous use or add a second unit.
- Cold water sandwich: Brief cold burst when the unit cycles — normal for tankless, minimized by models with small buffer tanks or recirculation pumps.
- Unit won’t fire on low flow: Most units need 0.4–0.6 GPM to activate. A dripping faucet won’t trigger it — that’s by design.
- Error codes: Usually indicate scale buildup, ignition failure, or venting issues. Descale first; if codes persist, call a technician.
- Fluctuating temperature: Often caused by pressure imbalances when toilets flush or washers fill — a pressure-balancing valve helps.
Tank vs. Tankless: Side-by-Side
Here’s the honest comparison most salespeople won’t give you: tank heaters cost less upfront, work with existing infrastructure, and deliver hot water instantly to every tap — but they waste energy on standby, last 10–12 years, and can flood your home when they fail. Tankless costs more upfront, needs annual maintenance, and can struggle with simultaneous demand — but lasts 20+ years, cuts energy use meaningfully, frees up floor space, and never dumps 50 gallons on your basement floor. There’s no universal winner; it depends on your household size, water use patterns, fuel costs, and how long you plan to stay in the home.
Rebates and Tax Credits
Before buying, check the Database of State Incentives for Renewables and Efficiency (DSIRE) for your state’s current rebates — many utilities offer $200–$500 for ENERGY STAR certified tankless units. Federal tax credits for high-efficiency water heaters have varied by year, so verify current eligibility at purchase time. These incentives can shave 10–20 percent off the project cost, which meaningfully shortens the payback period.
Environmental Impact
Beyond the utility bill, tankless heaters meaningfully reduce a home’s carbon footprint — the DOE estimates 24–34 percent less energy for water heating in typical homes, and up to 50 percent for households using under 41 gallons daily. Over a 20-year lifespan, that’s thousands of pounds of CO2 avoided. Condensing gas models squeeze even more efficiency by capturing exhaust heat. If you’re electrifying your home, pair an electric tankless with solar panels and your hot water becomes nearly carbon-free.