Performance of the Unstructured-Mesh, SWAN+ADCIRC Model in Computing Hurricane Waves and Surge

JSC2012Coupling wave and circulation models is vital in order to define shelf, nearshore and inland hydrodynamics during a hurricane. The intricacies of the inland floodplain domain, level of required mesh resolution and physics make these complex computations very cycle-intensive. Nonetheless, fast wall-clock times are important, especially when forecasting an incoming hurricane.

We examine the performance of the unstructured-mesh, SWAN+ADCIRC wave and circulation model applied to a high-resolution, 5M-vertex, finite-element SL16 mesh of the Gulf of Mexico and Louisiana. This multi-process, multi-scale modeling system has been integrated by utilizing inter-model communication that is intra-core. The modeling system is validated through hindcasts of Hurricanes Katrina and Rita (2005), Gustav and Ike (2008) and comprehensive comparisons to wave and water level measurements throughout the region. The performance is tested on a variety of platforms, via the examination of output file requirements and management, and the establishment of wall-clock times and scalability using up to 9,216 cores. Hindcasts of waves and storm surge can be computed efficiently, by solving for as many as 2.3E12 unknowns per day of simulation, in as little as 10 minutes of wall-clock time.

JC Dietrich, S Tanaka, JJ Westerink, CN Dawson, RA Luettich Jr, M Zijlema, LH Holthuijsen, JM Smith, LG Westerink, HJ Westerink (2012). “Performance of the Unstructured-Mesh, SWAN+ADCIRC Model in Computing Hurricane Waves and Surge.Journal of Scientific Computing, 52(2), 468-497, DOI:10.1007/s10915-011-9555-6.

Surface Trajectories of Oil Transport along the Northern Coastline of the Gulf of Mexico

CSR2012After the destruction of the Deepwater Horizon drilling platform during the spring of 2010, the northern Gulf of Mexico was threatened by an oil spill from the Macondo well. Emergency responders were concerned about oil transport in the nearshore, where it threatened immediately the fishing waters and coastline from Louisiana to Florida. In this region, oil movement was influenced by a continental shelf with varying width, the protruding Mississippi River delta, the marshes and bayou of southern Louisiana, and the shallow sounds and barrier islands that protect the coastline. Transport forecasts require physics-based computational models and high-resolution meshes that represent the circulation in deep water, on the continental shelf, and within the complex nearshore environment.

This work applies the coupled SWAN+ADCIRC model on a high-resolution computational mesh to simulate the current velocity field on the continental shelf, nearshore and marsh areas during the time that oil was visible on the surface of the Gulf. The SWAN+ADCIRC simulations account for the influence of tides, riverine discharge, winds and wind-driven waves. A highly-efficient Lagrangian particle transport model is employed to simulate the surface trajectories of the oil. The transport model accounts for dispersion and advection by wind and currents. Transport is evaluated using two week-long sequences of satellite images. During both periods, the SWAN+ADCIRC current fields alone appeared to be more successful moving the oil than when direct wind forcing was included. In addition, hypothetical oil transport is considered during two hurricane scenarios. Had a hurricane significantly impacted the areas, depending on its track, oil would have moved farther into the marshes of southern Louisiana or farther along the shelf toward Texas than actually occurred during the spill.

JC Dietrich, CJ Trahan, MT Howard, JG Fleming, RJ Weaver, S Tanaka, L Yu, RA Luettich Jr, CN Dawson, JJ Westerink, G Wells, A Lu, K Vega, A Kubach, KM Dresback, RL Kolar, C Kaiser, RR Twilley (2012). “Surface Trajectories of Oil Transport along the Northern Coastline of the Gulf of Mexico.Continental Shelf Research, 41(1), 17-47, DOI:10.1016/j.csr.2012.03.015.

Hurricane Gustav (2008) Waves and Storm Surge: Hindcast, Synoptic Analysis, and Validation in Southern Louisiana

MWR2011Hurricane Gustav (2008) made landfall in southern Louisiana on 1 September 2008 with its eye never closer than 75 km to New Orleans, but its waves and storm surge threatened to flood the city. Easterly tropical-storm-strength winds impacted the region east of the Mississippi River for 12-15 h, allowing for early surge to develop up to 3.5 m there and enter the river and the city’s navigation canals. During landfall, winds shifted from easterly to southerly, resulting in late surge development and propagation over more than 70 km of marshes on the river’s west bank, over more than 40 km of Caernarvon marsh on the east bank, and into Lake Pontchartrain to the north. Wind waves with estimated significant heights of 15 m developed in the deep Gulf of Mexico but were reduced in size once they reached the continental shelf. The barrier islands further dissipated the waves, and locally generated seas existed behind these effective breaking zones.

The hardening and innovative deployment of gauges since Hurricane Katrina (2005) resulted in a wealth of measured data for Gustav. A total of 39 wind wave time histories, 362 water level time histories, and 82 high water marks were available to describe the event. Computational models – including a structured-mesh deepwater wave model (WAM) and a nearshore steady-state wave (STWAVE) model, as well as an unstructured-mesh “simulating waves nearshore” (SWAN) wave model and an advanced circulation (ADCIRC) model – resolve the region with unprecedented levels of detail, with an unstructured mesh spacing of 100-200 m in the wave-breaking zones and 20-50 m in the small-scale channels. Data-assimilated winds were applied using NOAA’s Hurricane Research Division Wind Analysis System (H*Wind) and Interactive Objective Kinematic Analysis (IOKA) procedures. Wave and surge computations from these models are validated comprehensively at the measurement locations ranging from the deep Gulf of Mexico and along the coast to the rivers and floodplains of southern Louisiana and are described and quantified within the context of the evolution of the storm.

JC Dietrich, JJ Westerink, AB Kennedy, JM Smith, RE Jensen, M Zijlema, LH Holthuijsen, CN Dawson, RA Luettich Jr, MD Powell, VJ Cardone, AT Cox, GW Stone, H Pourtaheri, ME Hope, S Tanaka, LG Westerink, HJ Westerink, Z Cobell (2011). “Hurricane Gustav (2008) Waves and Storm Surge: Hindcast, Synoptic Analysis, and Validation in Southern Louisiana.Monthly Weather Review, 139(8), 2488-2522.

Origin of the Hurricane Ike Forerunner Surge

GRL2011A large, unpredicted, water level increase appeared along a substantial section of the western Louisiana and northern Texas (LATEX) coasts 12-24 hrs in advance of the landfall of Hurricane Ike (2008), with water levels in some areas reaching 3m above mean sea level. During this time the cyclonic wind field was largely shore parallel throughout the region. A similar early water level rise was reported for both the 1900 and the 1915 Galveston Hurricanes. The Ike forerunner anomaly occurred over a much larger area and prior to the primary coastal surge which was driven by onshore directed winds to the right of the storm track. We diagnose the forerunner surge as being generated by Ekman setup on the wide and shallow LATEX shelf. The longer forerunner time scale additionally served to increase water levels significantly in narrow-entranced coastal bays. The forerunner surge generated a freely propagating continental shelf wave with greater than 1.4m peak elevation that travelled coherently along the coast to Southern Texas, and was 300km in advance of the storm track at the time of landfall. This was, at some locations, the largest water level increase seen throughout the storm, and appears to be the largest freely-propagating shelf wave ever reported. Ekman setup-driven forerunners will be most significant on wide, shallow shelves subject to large wind fields, and need to be considered for planning and forecasting in these cases.

AB Kennedy, U Gravois, BC Zachry, JJ Westerink, ME Hope, JC Dietrich, MD Powell, AT Cox, RA Luettich Jr, RG Dean (2011). “Origin of the Hurricane Ike Forerunner Surge.Geophysical Research Letters, 38, L08608, doi:10.1029/2011GL047090.

Modeling Hurricane Waves and Storm Surge using Integrally-Coupled, Scalable Computations

CE2011The unstructured-mesh SWAN spectral wave model and the ADCIRC shallow-water circulation model have been integrated into a tightly-coupled SWAN+ADCIRC model. The model components are applied to an identical, unstructured mesh; share parallel computing infrastructure; and run sequentially in time. Wind speeds, water levels, currents and radiation stress gradients are vertex-based, and therefore can be passed through memory or cache to each model component. Parallel simulations based on domain decomposition utilize identical sub-meshes, and the communication is highly localized. Inter-model communication is intra-core, while intra-model communication is inter-core but is local and efficient because it is solely on adjacent sub-mesh edges. The resulting integrated SWAN+ADCIRC system is highly scalable and allows for localized increases in resolution without the complexity or cost of nested meshes or global interpolation between heterogeneous meshes. Hurricane waves and storm surge are validated for Hurricanes Katrina and Rita, demonstrating the importance of inclusion of the wave-circulation interactions, and efficient performance is demonstrated to 3062 computational cores.

JC Dietrich, M Zijlema, JJ Westerink, LH Holthuijsen, CN Dawson, RA Luettich Jr, RE Jensen, JM Smith, GS Stelling, GW Stone (2011). “Modeling Hurricane Waves and Storm Surge using Integrally-Coupled, Scalable Computations.Coastal Engineering, 58, 45-65.

Development and Application of Coupled Hurricane Wave and Surge Models for Southern Louisiana

DissertationCoastal Louisiana and Mississippi are especially prone to large hurricanes due to their geographic location in the north-central Gulf of Mexico. Several recent hurricanes have devastated the region, creating complicated environments of waves and storm surge. Katrina (2005) and Gustav (2008) made landfall in southeastern Louisiana, and their counter-clockwise winds pushed surge onto the Louisiana-Mississippi continental shelf, into the low-lying wetlands surrounding the Mississippi River, and over and through the levee system that protects metropolitan New Orleans. Rita (2005) and Ike (2008) passed farther to the west, moved across the Texas-Louisiana continental shelf, and created surge that flooded large portions of southwestern Louisiana.

These hurricanes demand detailed hindcasts that depict the evolution of waves and surge during these storm events. These hindcasts can be used to map the likely floodplains for insurance purposes, to understand how the current protection system responded during each storm, and to design a new protection system that will resist better the waves and surge. In addition, the resulting computational model can be used to forecast the system’s response to future storm events.

The work described herein represents a significant step forward in the modeling of hurricane waves and surge in complicated nearshore environments. The system is resolved with unprecedented levels of detail, including mesh sizes of 1km on the continental shelf, less than 200m in the wave breaking zones and inland, and down to 20-30m in the fine-scale rivers and channels. The resulting hindcasts are incredibly accurate, with close matches between the modeled results and the measured high-water marks and hydrograph data. They can be trusted to provide a faithful representation of the evolution of waves and surge during all four hurricanes.

This work also describes advancements in the coupling of wave and surge models. This coupling has been implemented typically with heterogeneous meshes, which is disadvantageous because it requires intra-model interpolation at the boundaries of the nested, structured wave meshes and inter-model interpolation between the wave and circulation meshes. The recent introduction of unstructured wave models makes nesting unnecessary. The unstructured-mesh SWAN wave and ADCIRC circulation models are coupled in this work so that they run on the same unstructured mesh. This identical, homogeneous mesh allows the physics of wave-circulation interactions to be resolved correctly in both models. The unstructured mesh can be applied on a large domain to follow seamlessly all energy from deep to shallow water. There is no nesting or overlapping of structured wave meshes, and there is no inter-model interpolation. Variables and forces reside at identical, vertex-based locations. Information can be passed without interpolation, thus reducing significantly the communication costs.

The coupled SWAN+ADCIRC model is highly scalable and integrates seamlessly the physics and numerics from deep ocean to shelf to floodplain. Waves, water levels and currents are allowed to interact in complex problems and in a way that is accurate and efficient to thousands of computational cores. The coupled model is validated against extensive measurements of waves and surge during the four recent Gulf hurricanes. Furthermore, the coupling paradigm employed by SWAN+ADCIRC does not interfere with the already-excellent scalability of the component models, and the coupled model maintains its scalability to 7,168 computational cores. SWAN+ADCIRC is well-suited for the simulation of hurricane waves and surge.

JC Dietrich (2010). “Development and Application of Coupled Hurricane Wave and Surge Models for Southern Louisiana,” University of Notre Dame.

Waves in Wetlands: Hurricane Gustav

ICCE2010Few wave measurements have been made in wetlands during high-energy, surge events, such as hurricanes. During Hurricane Gustav in 2008, many nearshore wave measurements were made in Southeastern Louisiana. These data are used to verify a nearshore wave modeling system and to explore the characteristics of hurricane waves in wetlands. The modeling system consists of the wave generation model WAM, the nearhsore wave model STWAVE, and the circulation model ADCIRC. The measurements confirm reasonable success in modeling the waves. The measurements and modeling also expose some of the problems of measuring waves in highly-variable water depths under hurricane forcing and modeling waves in rapidly degrading wetlands.

JM Smith, RE Jensen, AB Kennedy, JC Dietrich, JJ Westerink (2010). “Waves in Wetlands: Hurricane Gustav.Proceedings of the International Conference on Coastal Engineering, 2010, 32.

A High-Resolution Coupled Riverine Flow, Tide, Wind, Wind Wave, and Storm Surge Model for Southern Louisiana and Mississippi, Part II: Synoptic Description and Analysis of Hurricanes Katrina and Rita

MWR2010bHurricanes Katrina and Rita were powerful storms that impacted southern Louisiana and Mississippi during the 2005 hurricane season. In Part I, the authors describe and validate a high-resolution coupled riverine flow, tide, wind, wave, and storm surge model for this region. Herein, the model is used to examine the evolution of these hurricanes in more detail. Synoptic histories show how storm tracks, winds, and waves interacted with the topography, the protruding Mississippi River delta, east-west shorelines, man-made structures, and low-lying marshes to develop and propagate storm surge. Perturbations of the model, in which the waves were not included, show the proportional importance of the wave radiation stress gradient induced setup.

JC Dietrich, S Bunya, JJ Westerink, BA Ebersole, JM Smith, JH Atkinson, RE Jensen, DT Resio, RA Luettich Jr, CN Dawson, VJ Cardone, AT Cox, MD Powell, HJ Westerink, HJ Roberts (2010). “A High-Resolution Coupled Riverine Flow, Tide, Wind, Wind Wave, and Storm Surge Model for Southern Louisiana and Mississippi, Part II: Synoptic Description and Analysis of Hurricanes Katrina and Rita.Monthly Weather Review, 138, 378-404.