![]() ![]() Thanks to some late nights, coffee and a ton of passion and dedication from the Maxar and AWS team, we combed through the FV3GFS source code and the various supporting libraries, as well as system architecture configs, to get the output to match. We figured if we couldn’t match NOAA’s output using the same configuration of their FV3GFS model, then we had something awry in our system. When we started running the model in a small-scale HPC environment, we discovered some challenges in matching the output with what NOAA was providing through its public access points. The above diagram outlines the AWS tools and services used to create an automated cloud-based HPC architecture and workflow for running the complex weather forecasting code. By combining our teams of data scientists and engineers, Maxar and AWS were able to create an automated workflow that leverages a whole suite of AWS tools and services, as well as allowing Maxar’s physical scientists to dig into the Earth Science side of NWP. We reached out to Amazon Web Services ( AWS) to build a cloud-based, high performance computing ( HPC) architecture. ![]() And, this new way had to give us more control on the output – both in terms of performance of forecast skill and speed at which the data was created. Maxar’s WeatherDesk™ team decided there had to be a better, faster, quicker, and less capital-intense way to generate the forecast. For more info on NOAA’s supercomputer fleet – check out this article or this one. There are additional costs for the teams of people focused on maintenance and electricity costs to power and cool the equipment. For computing power like this, a single machine comes with a price tag in the tens of millions of dollars. ![]() NOAA supercomputers are capable of running the massively parallelized code bases required to generate these numerical weather forecasts. NOAA created this forecast on Novemby running its FV3GFS model on its supercomputer. On a normal day, it takes NOAA and its National Center for Environmental Prediction (NCEP) division about 100 minutes to run its main numerical weather prediction (NWP) model, called the Finite Volume Cubed-Sphere Global Forecast System (FV3GFS). They create this forecast using a long, complex code base and a world-class supercomputer. National Oceanic and Atmospheric Administration ( NOAA) produces a detailed global weather forecast multiple times per day that provides information about what the weather will be like in the upcoming hours, days and even weeks. And military and intelligence agencies, to inform the strategy and tactics of their missions and operations.Humanitarian and disaster response (HADR) missions, to pre-stage relief resources and estimate the damage that might occur.Transportation companies, to prepare for potential shipping and logistics disruptions. ![]()
0 Comments
Leave a Reply. |