Home/Concepts/Weather forecasting and data assimilation in municipal water systems
Weather forecasting and data assimilation in municipal water systems
Weather forecasting is the existence proof. It shows that the third intake position is not speculative and not terminal by assertion — it was reached in one domain seventy years…
The strongest case against
Take the objection at full strength. Weather forecasting works because the atmosphere obeys the Navier-Stokes equations and a handful of conservation laws. A numerical model integrates a closed physical state vector forward in time; assimilation is the projection of new observations onto that vector, weighted by known error covariances. A municipal water system has no equations of motion. There is no primitive variable set — no analogue of temperature, pressure, wind — that fully determines what the network will do next. A trunk main does not obey a conserved quantity the way a parcel of air conserves potential vorticity. Without a dynamical prior, continuous intake from chlorine analysers, turbidity meters, pressure loggers and SCADA tags is not a running belief about the system. It is an unbounded log with timestamps. Calling it an "analysis," in the meteorological sense, borrows credibility the domain has not earned.
This lands, and it should be stated before anything else, because it is the objection that actually threatens the Large Universe Model claim rather than merely irritating it.
What the utility engineer already does
Sit with an ordinary distribution network for a moment. Pressure transducers report every few seconds at hundreds of points. Chlorine residual and turbidity analysers report at fixed intervals, drift, get recalibrated, drift again. Bacteriological assay results — the ground truth for contamination — arrive on a lag measured in hours to days, because a culture has to grow. Maintenance logs record valve operations, main breaks, flushing events, each of which changes what the sensors mean without changing what they say. None of these streams stops. The utility engineer's job, whether or not it is described this way, is state estimation: reconcile a hydraulic model's prediction of pressure and flow against telemetry that disagrees with it, weight each sensor by how much it has been trusted lately, and decide what is actually true about water that cannot be directly seen once it leaves the treatment works.
This is recognisably the same shape as data assimilation. It is not the same shape as reading a frozen corpus once, and it is not the same shape as a single bounded sensor sweep either. The characteristic failure of the domain makes the point sharply: a contamination event is confirmed after distribution rather than before. The assay result that would have caught it was still incubating while the water was already at the tap. That is not a modelling failure in the meteorological sense. It is a latency failure inside an otherwise continuous intake architecture — the analogue of Lorenz's predictability horizon, but caused by biology and logistics rather than chaos.
Conceding the physics point
The objection survives, in large part. Meteorology has something municipal water does not: a closed, well-validated dynamical model that turns observations into forecasts with quantified skill. A hydraulic network model — EPANET-class solvers, demand patterns, pump curves — is far weaker than the primitive equations. It is calibrated locally, degrades as pipe roughness and demand drift, and has no equivalent of the atmosphere's forgiving redundancy, where one bad radiosonde among ten thousand observations barely moves the analysis. In a water network, one mis-set valve or one failed booster pump can dominate the local physics entirely, and the model may not know it happened until pressure telemetry disagrees badly enough to flag.
So if the claim were "municipal water systems predict their own future the way medium-range forecasts do," it would fail immediately. They do not, and nothing in this piece pretends otherwise.
What holds anyway: the intake question is separate from the skill question
The narrower claim is about intake, not prediction quality. Weather forecasting demonstrates an achievable architecture: heterogeneous streams, each with its own known error characteristics, folded continuously into a state that is always provisional and always being corrected, with provenance retained per observation and revision applied retrospectively when the model improves. Nothing in that description requires the atmosphere's equations. It requires only that the domain be willing to build the plumbing.
Municipal water systems already have more of that plumbing than the physics objection allows for. Pressure telemetry is already reconciled against a hydraulic model in real time in a growing number of utilities, using something close to weighted least squares over the sensor network — directly comparable to the SCADA state estimation run continuously on electric grids, where redundant measurements are checked against network topology and a bad meter is identified by its residual rather than by an inspector. Chlorine and turbidity analysers already carry per-instrument calibration drift, and utilities that take this seriously downweight a sensor automatically once its readings depart from a maintained baseline — a cruder cousin of variational bias correction, but the same idea: distrust the instrument, not the world, when the two disagree in a characteristic way.
What is missing is not the concept of continuous, provenance-tagged, revisable intake. It is the integration of that intake with a strong enough dynamical or microbiological prior to convert observation into genuine lead time before the contamination reaches a tap.
The schema objection, and why it matters more here
A second objection bites harder in this domain than the first. The atmospheric state vector has a fixed schema — temperature, wind, humidity, pressure, on a defined grid — and that schema has not changed in seventy years even as instruments multiplied. A water network's ontology is not fixed in the same way. New contaminants get regulated and start being assayed for. New sensor types — for PFAS, for specific pathogens, for disinfection by-products — arrive with their own detection limits and failure modes. A maintenance log entry about a corroded main changes what "normal" pressure means at that point in the network, in a way no meteorological observation ever changes what temperature means.
This is the sharper limit. Meteorological assimilation is schema-closed: the grid gets finer, the variable list barely grows. Municipal water intake is schema-open: the categories of thing worth measuring keep expanding, often in response to a regulatory or epidemiological event rather than a scientific one. An assimilation architecture built for pressure, flow and chlorine residual does not automatically know how to absorb a new PFAS congener assay next year.
But notice where this objection actually lands. It is not an objection to continuous intake as an achievable position — it is an objection to how flexible the schema inside that position needs to be. Even in meteorology, the observation side was never fully closed: bias correction was built precisely so that instruments unknown at system design time could be admitted and self-calibrated against the background. A comparable move in water utilities is not speculative; it is what happens, imperfectly, when a new assay type gets folded into an existing alarm and trending system rather than kept in a separate spreadsheet. The schema problem is real, and it is harder here than in meteorology. It is also downstream of the intake question, not a rebuttal of it.
The claim that survives
If additional sensors and faster assay turnaround do not close the gap between contamination and confirmation, then continuous intake was never the terminal position — the real ceiling is somewhere else, and "everything, continuously" is an expensive plateau.
This is close to correct, and worth taking seriously rather than deflecting. The lag between sampling and culture-based confirmation is a genuine ceiling, and no amount of additional pressure telemetry removes it; it removes something else — the delay in noticing the event exists at all, which is not nothing. Faster assay chemistry, more assay points, better hydraulic tracing to bound the affected zone: all of this is scale and trust, not a new category of evidence, and it will keep reducing the interval between contamination and confirmation without ever eliminating the biological lag entirely.
The terminal claim is architectural, not predictive. Municipal water systems that reconcile pressure, assay, and maintenance streams into a continuously revised belief about the state of the network, with provenance per reading and automatic distrust of drifting instruments, are standing in the same intake position medium-range forecasting reached in 1955. What they lack is not a fourth kind of stream to observe. It is the dynamical and microbiological priors strong enough to convert that position into lead time — and that gap is real, large, and worth being honest about.