Addressing The Stagnation Of U.S. Operational Numerical Weather Condition Prediction

U.S.  operational numerical weather condition prediction has stagnated.
  • For decades, the science of the U.S. global model has lagged those of leading international weather condition prediction centers
  • U.S. operational numerical weather condition prediction (NWP) has fallen behind the state-of-the-science inwards other areas every bit well, fifty-fifty though the U.S. is the leader inwards meteorological research.
  • Regional prediction, especially ensemble-based probabilistic forecasting, is lagging far behind where it should be.
  • And every bit easily demonstrated, U.S. operational weather condition prediction is non catching up.

But why the stagnation?

It is non for lack of resources.  It is non for the lack of sufficient personnel.  It is non because NOAA/National Weather Service meteorologists or leadership lack interest, knowledge, or motivation.  It is non because the question community does non desire to assist.

It is because the construction of research, development, in addition to operations inwards the U.S. is essentially broken in addition to dysfunctional.  Divided in addition to inefficient, alongside pitiful organization.  Lack of strategic planning. And because the operational in addition to question communities are non working together effectively.

The damage of inferior weather condition prediction to the field is immense.  Property in addition to lives lost unnecessarily due to poorly predicted storms.  Economic loss in addition to inefficiency resulting from weather condition prediction errors that could locomote substantially reduced.

The bottom job of this blog:

U.S. weather condition prediction volition never driblet dead state-of-the-art until the U.S. governmental weather condition prediction enterprise is totally reorganized.

And inwards this weblog I volition force how it could locomote reorganized to address the inherent problems, allowing U.S. operational prediction to locomote the best inwards the world inside a few years.


The opportunity

Today at that topographic point is a non bad chance to create the problem.  The showtime matter needed to address a job is to know that it exists.  The populace knows, because at that topographic point receive got been many stories inwards the national media on the trailing U.S. weather condition prediction enterprise.  Congress knows, in addition to fifty-fifty passed a nib (the U.S. weather condition question in addition to excogitation deed of 2017).  NOAA/NWS direction knows in addition to receive got started only about well-motivated, but ineffective measures.   Private sector forecasting firms know in addition to receive got pushed for reforms.  One U.S. National Academy of Sciences written report afterward only about other has called for change.

Today nosotros receive got novel in addition to highly able high-level managers inwards NOAA  (administrators Neal Jacobs in addition to Admiral Tim Galludet) that empathize the problems in addition to would similar to create them.  We receive got an direction that wants "to brand America non bad again."

 Incremental changes that locomote out electrical current structures inwards house volition fail.   After decades of talking close the problem, tin nosotros in conclusion select the substantial measures that volition brand a existent difference?

The alert signs

I receive got published at to the lowest degree a dozen blogs documenting U.S. inferiority inwards operational numerical weather condition prediction, the foundation of all weather condition forecasting inwards the U.S.  Others receive got described the problems every bit well.  But allow me demonstrate y'all a few examples that demonstrate the problems.

Consider the 5-day forecast over the Northern Hemisphere for a typical degree aloft (here, 500 hPa, close 18,000 ft, one-half the atmosphere is inwards a higher house in addition to below this level).  Consider a mensurate of forecast fault (root-mean-square error, RMSE) for the U.S. model (the GFS, crimson line) in addition to the top world model (the European Center, ECMWF, black).  The  top plot below shows the forecast errors from 1996 to today, patch the bottom ane displays the departure betwixt U.S. in addition to European Center errors.

Note that the U.S. model (red line) has a higher fault that the ECWMF at all times.  And the U.S. is non catching up.  In fact, our standing compared to ECWMF has worsened inwards the past times few years.
 Another sign of NOAA/NWS problems is inferior statistical post-processing of model forecasts, a stride inwards which several model forecasts tin locomote combined, biases removed, in addition to the other improvements.  The U.S. private sector uses much to a greater extent than sophisticated approaches (which they secured though cooperation alongside the academy question sector, including the National Center for Atmospheric Research, NCAR). 

Here is an instance of forecast accuracy from Chicago from the forecastadvisor website (virtually every other urban center shows a similar situation).  Major private sector firms (e.g., the Weather Channel), using only about of the same model inputs, receive got much amend forecasts that the NWS.


One national academy written report afterward only about other (e.g., this one) has recommended the U.S needs a convection-allowing, high-resolution ensemble scheme that is large plenty in addition to designed sufficiently good to render useful forecast dubiety information.   The NWS has lagged inwards this expanse in addition to has solely created a kluged a modest ensemble (the Storm Scale Ensemble of Opportunity, SSEO, straightaway HREF).  Not skillful enough.

During the past times several years, the NWS Short-Range Ensemble Forecast System (SREF) has stagnated inwards resolution in addition to design.  Same alongside the Global Ensemble (GEFS).  The seasonal forecasting scheme (CFSv2) has remained basically unchanged for years, alongside no plans for upgrading for many years.

The solely exception to this dismal province of affairs is the fantabulous piece of work done past times the NOAA ESRL rapid refresh team  for often updated, short-term forecasts (RAP, HRRR).

The NWS is developing a novel global modeling scheme (FV-3), but at that topographic point is no evidence that it volition significantly improve forecasts without amend information assimilation in addition to physics (see figure below for comparing of the 5-day forecast).

I could listing a dozen other examples of ways U.S. NWP has fallen behind, in addition to virtually everyone who knows the province of affairs would admit that U.S. numerical weather condition prediction is woefully lagging where it should be.

Poor Coordination in addition to Lack of Cooperation, Coupled alongside Insufficient Planning in addition to Organization

So how does a field alongside leading weather condition scientists, leadership inwards figurer scientific discipline in addition to information technology, in addition to substantial vulnerabilities to storms in addition to other weather condition features (e.g., hurricanes, windstorms, severe thunderstorms, wildfires) halt upwards alongside minute charge per unit of measurement forecasting capabilities?

Poor organization, lack of cooperation, credence of inferiority, amid others.

You tin shout out upwards of U.S. numerical prediction every bit an one-time tree that has been left without pruning, trimming, or planning:  its eventually becomes really overgrown in addition to unhealthy over time.

A visual metaphor of U.S. operational NWP

Consider the pitiful organizational construction of U.S operational numerical weather condition prediction.  Keep inwards heed that the National Oceanographic in addition to Atmospheric Administration (NOAA) is component of the Dept. of Commerce, in addition to that the National Weather Service is component of NOAA.

Operational weather condition modeling is the responsibleness of the Environmental Modeling Center (EMC) of the NWS National Centers for Environmental Prediction (NCEP).  But they don't run the models--they allow only about other grouping inwards NCEP exercise it (NCEP Central Operations, NCO).   Now, although EMC is responsible for the weather condition modeling, they don't educate most of their ain models.   That is done past times a issue of other centers, only about inwards the NWS in addition to only about not.  GFDL inwards Princeton develops only about (hurricane models, novel global model), NOAA ESRL (not inwards the NWS) develops others (e.g., rapid refresh models).  The statistical postprocessing is developed exterior of NCEP inwards MDL (Meteorological Development Lab).  Decision making for novel models (and the fiscal management) is done past times unlike folks exterior of NCEP  (Office of Science Technology Integration, OSTI).  No ane private or grouping is responsible for U.S. operational weather condition research, operations, in addition to research.  It would locomote hard to brand upwards a to a greater extent than ineffective approach to managing such a complex task.
Even to a greater extent than inefficient, consider that other agencies (like NASA, the Navy, in addition to the Air Force) are all running their ain (and different) numerical weather condition prediction systems, alongside independent evolution groups.

Not bad enough?   The question community through the National Center for Atmospheric Research (NCAR) has developed a split upwards suite of weather condition in addition to environmental modeling systems, from the global to local scales. 

Worse?   A NOAA Office of Water Prediction in addition to a National Water Center was prepare inwards Alabama to select on the nation's H2O prediction (and hydrological forecasts), every bit if that should locomote separated from the residue of H2O prediction (this boondoggle was the termination of a Senator wanting only about pork for his district).

Vast sums are spent on uncoordinated weather condition forecasting question past times the National Science Foundation, NOAA, DOD, NASA in addition to others, much of redundant or never destined to assistance operational capabilities.

And did I advert that at that topographic point is no concrete strategic computer program in NOAA/NWS for the evolution of U.S. environmental prediction?   Just vague platitudes.   This is inwards stark contrast to the detailed planning past times NOAA/NWS's large competitors (e.g., the European Center, the UKMET office, etc), which every bit extensive, detailed, in addition to coherent planning processes.

The bottom linewe receive got a disastrously inefficient scheme of developing, running in addition to post-processing numerical weather condition prediction guidance for the U.S., alongside agencies doing their ain things, disorganization growing, in addition to U.S. capabilities stagnating.

Most determination makers are thinking close protecting their ain turf in addition to resources, in addition to few high-level NOAA administrators receive got known plenty to watch the job or were willing to select the estrus for the necessary changes.  Numerical weather condition prediction is technically really challenging in addition to few inwards Congress has sufficient background to revamp the organisation of U.S. weather condition forecasting.


The latter indicate is worth repeating:  numerical weather condition prediction is mayhap the most complex activity of our species, involving billion dollar satellites, global information collection, running complex models that comprehend molecular to global scales, in addition to that job the largest computers on the planet.  You can't exercise this inwards a haphazard, uncoordinated away every bit done inwards the U.S. in addition to aspect to locomote state-of-the science.

The electrical current NOAA/NWS answer volition non solve the problem

NOAA/NWS direction know at that topographic point is a large problem, in addition to to locomote honest, only about things have improved.  Influenza A virus subtype H5N1 few years ago, at that topographic point was outright tension betwixt model developers inwards NOAA ESRL (Earth System Research Lab inwards Boulder) in addition to the NWS EMC folks.  That is much amend now.  The NWS is putting to a greater extent than funds into extramural question inwards the academic community in addition to is asset workshops in addition to meetings to gain input.  Recently, the NWS laid about developing a novel global model (based on the GFDL FV-3 system) to supplant the hoary one-time model (the GFS).

NOAA/NWS has non dealt alongside the fundamental job of pitiful organization, coordination in addition to planning.

They receive got non created a construction to educate actionable strategic plans.  Different folks are responsible for model evolution in addition to operations.  The  NOAA extramural funding has often non been good spent.  The University community is drifting away, alongside nearly all using the NCAR models.  There is  insufficient figurer resources to back upwards weather condition prediction in addition to weather condition prediction question that the field requires. And at that topographic point is lilliputian evidence that the novel global model volition improve verification scores really much, since the existent problems are inwards information assimilation, physics, ensembles, in addition to postal service processing.

The National Center for Atmospheric Research Mesa Lab
The NWS has held workshops in addition to organized all kinds gatherings to garner support, but these receive got led to long laundry lists, alongside lilliputian powerfulness to Pb to actionable, organized efforts.

And allow me locomote clear that I am non singling out NOAA direction for this problem.  It is hard for a job director inwards NOAA to visualize in addition to modify a complex organizational structure.   Important partners (like NCAR, DOD, NASA) receive got often shown lilliputian involvement inwards working alongside NOAA, wanting to keep their ain modeling sandbox. Congress has non been sufficiently attentive to the dysfunctional structures they receive got created in addition to maintained.

How to create the job of U.S. numerical weather condition in addition to environmental prediction

The key is reorganization, coordination in addition to planning.  The best possible circumstance would locomote to select all environmental prediction activities of NOAA into ane group-- research, development, operations--with ane private responsible for the whole operation.  We are talking close combining the NWP activities in addition to responsibilities of NWS NCEP, NWS MDL, NOAA ESRL, NOAA GFLD, the National Water Center, in addition to NWS NCO (and others) into ane group.  Even amend would locomote to create a truly national center, in addition to select inwards the NASA in addition to DOD components--but that is a heavy lift.

But let's imagine something that is smaller lift, that mightiness locomote a skillful showtime step.  Leave responsibleness for running the weather/environmental prediction models inwards the National Weather Service, but motility all model evolution in addition to testing to a novel integrated entity inside NOAA:  The National Environmental Prediction Research in addition to Development Center (NEPRDC).  Influenza A virus subtype H5N1 schematic of the organizational construction is shown below.  It would include a primary scientist to assist organize in addition to Pb the scientific work, alongside a rigid scientific advisory committee.

One organisation inwards NOAA would locomote responsible for research, development, in addition to testing of the nation's environmental models (weather, ocean, hydrological, coastal, etc.)  The centre would receive got ample supercomputer resources for model testing (which does non be now) in addition to command of extramural funding, which would assist back upwards academy (and other) researchers working inwards question that volition straight address electrical current in addition to futurity modeling problems.

An ideal location for the centre would locomote inwards Boulder, Colorado-- the centre of U.S. weather condition research, alongside both NOAA ESRL in addition to NCAR (the academy community's center) located at that topographic point today.   The Developmental Testbed Center (which tin render extramural back upwards for U.S models in addition to assist evaluate the novel ones, is already inwards Boulder). Some  NWS EMC personnel (who are straightaway inwards DC) could piece of work every bit a satellite centre inwards Boulder.  Bringing NCAR  (also inwards Boulder) in addition to NOAA together through such a centre is critical, in addition to Boulder is a far to a greater extent than fundamental venue than DC for combining the nation's modeling efforts.

Improvements inwards environmental prediction volition solely come upwards from sustained, coordinated hard piece of work inwards physics, information assimilation, in addition to other key areas.  This requires coherent planning in addition to the coordination of the vast scientific in addition to technical resources of the U.S.  The electrical current scheme is incapable of such effort, the proposed ane volition locomote upwards to the task.

As a showtime stride inwards fleshing out this proposal mightiness locomote a national workshop on U.S. environmental prediction, bringing together the entire environmental prediction community, alongside a detailed white newspaper coming out of it.  And alongside then many changes inwards the bureaucratic structures, Congress volition receive got to locomote involved.

But inwards the end, it is clear that the electrical current structures, the termination of legacy in addition to administrative drift over decades, are failing.   Only major restructuring in addition to reimagining of U.S. environmental prediction tin termination inwards the necessary changes.    The U.S. tin easily find leadership inwards weather condition prediction if nosotros solely receive got the volition to admit the electrical current failed structures in addition to supplant them alongside something better. 

The U.S. has fallen behind inwards then many areas due to complacency, pitiful leadership, self-interest, in addition to loss of energy.  Can nosotros exercise amend inwards weather condition in addition to environmental prediction, rebuilding our capabilities when nosotros even then receive got the resources to locomote the best in addition to give the American people state-of-science forecasts?   I promise so.


Comments

Popular Posts