XSEDE Science Successes
Science of Jet Noise
The Science of Jet Noise
XSEDE ECSS support helps researcher with performance gains, new code
Daniel Bodony's love of science began with a love of airplanes. He worked for one of his dad's colleagues on the weekends who had an airplane. "I would mow his grass and he would let me fly," Bodony remembers fondly.
Those early boyhood days fueled the fire for Bodony as he committed himself to a career as a military pilot but, at that time, a pilot who wore glasses was not allowed. Taking that in stride, Bodony decided he would instead design airplanes, only to experience another shift in his early career.
"When I got to college and started to design airplanes I realized that I liked the science behind the design more than I liked the design itself," he said.
Bodony, the Blue Waters Associate Professor in Aerospace Engineering at the University of Illinois at Urbana-Champaign (UIUC), is looking into the science surrounding the aeroacoustics of jet engines and researching how to make them quieter.
A veteran user of NSF high performance computing (HPC) resources since 2008, Bodony says: "The reason we use supercomputers is because in aeroacoustics there is no simple relationship that relates an unsteady flow field to the sound it creates. So we have to resort to elaborate experiments or simulations to try to come up with the contextual underpinnings that relate cause and effect. And we still haven't done it. The fact that aircraft has gotten quieter over the years is more by accident than by design, and we're trying to change that, but it relies on bigger calculations, bigger codes, and more complex computing capabilities."
The computational challenges that Bodony and his team face invariably involve turbulence, which is an unsteady, chaotic motion of a fluid. In the practicalities of calculating a turbulent flow, a researcher has two options: 1) make many assumptions and have a small computational model or 2) make few assumptions and have a very large computational model. Because the researchers don't yet understand sound generation at a fundamental level, they have to resolve all of the scales of motion involved in the turbulent flow.
"It's a classical multi-scale problem," Bodony says. "Computational research is required to resolve all of those scales which requires us to use the largest computers to which we have access – XSEDE's Stampede being one of them." The NSF Extreme Science and Engineering Discovery Environment (XSEDE) is the most advanced, powerful, and robust collection of integrated advanced digital resources and services in the world. It is a single virtual system that scientists can use to interactively share computing resources, data, and expertise.
XSEDE'S Extended Collaborative Support Service (ECSS)
Through XSEDE's Extended Collaborative Support Service (ECSS) program, researchers have access to cyberinfrastructure experts with a variety of expertise. ECSS experts, many with advanced degrees in domain areas, are available for collaborations lasting months to a year to help researchers fundamentally advance their use of XSEDE resources.
Bodony has used the ECSS program for a variety of projects. When asked if he would recommend the ECSS program to other researchers, his response was a quick, "Yes, wholeheartedly. The ECSS experts are able to look at the code and understand the hardware and software very quickly to make a diagnosis."
Currently, through XSEDE's ECSS program, Bodony works primarily with Luke Wilson from the Texas Advanced Computing Center, one of the top advanced computing centers for open science in the nation. Wilson, who serves as the technical expert — his expert knowledge about the hardware, and how the software interacts with the hardware — is helping Bodony and his team achieve real performance results on their code.
Three categories of ECSS support exist for projects: Extended Support for Research Teams; Extended Support for Community codes; and Extended Support for Gateways. Bodony is in the Research Teams category, with the single investigator code known as PlasComCM, a multi-physics solver that can solve for the motion of a compressible viscous fluid with a compressible, finite strain solid.
"When we run our code we have a basic idea of what its weaknesses are, and we try to identify the biggest weakness that impacts our ability to run efficiently on XSEDE systems, including being able to utilize Stampede's Intel® Xeon Phi™ processors," Bodony says.
According to Wilson, "the goal has always been to get this code up and running on the Intel® Xeon Phi™, and we started out looking for some simple places we could target to improve performance, mostly through vectorization. We found that the data encoding and the original algorithm weren't well suited to the Xeon Phi…there was a lot of out of order memory access, which you can't vectorize very easily."
It was a team effort among Bodony, Wilson and several people at UIUC, but Wilson was instrumental in taking the cumulative view of the code and speeding it up by a factor of seven. How? He figured out where the performance bottlenecks were. With too many memory loads for every floating point operation, the code had to copy data out of memory, add and multiply, and then store it back into memory. At first, Wilson executed a simple performance analysis of the code and identified the algorithmic weaknesses to find better ways to express the algorithms. Sometimes the algorithms needed new data structures, sometimes an entirely new algorithm needed to be implemented to perform the same operation, and sometimes the researchers needed to rewrite part of the code that made that algorithm no longer necessary.
"It took a long time to figure out that some of the constructs we were using in Fortran were causing unnecessary memory loads, and that was a big shock to us," Bodony said. "We thought the compilers were supposed to do this automatically." Then, they found that by reordering some of the add and multiplies they were able to get better cache utilization and better vectorization. When they achieved multiple adds and multiplies done concurrently, it brought them closer to 100 percent of Stampede's theoretical peak performance.
"We still have a long way to go with jet noise and we're going to continue to follow jet noise for the foreseeable future," Bodony says. "We think the flow that exits the jet engines contains the information that we need to figure out how to make jet engines quieter. We just haven't probed it in the right way. We've been working on tools to extract that information. Our current hypothesis has shown that our idea has merit using small scale simulations and now we're applying these ideas to the full scale jet noise problem."
What's next for Bodony and team?
According to Bodony, future computers are going to look a lot different than Stampede or any of the other NSF-funded systems. Now, they're not using ECSS to focus on performance; they're working with ECSS to change how the code is programmed.
As part of the exascale applications group, Bodony and his team are focused on building scalable algorithms. "How you program on future machines is going to be very different from how we program for Stampede," Bodony said. "What that means is that the codes that we have now may not run on future machines. We're trying to rewrite the code in such a way that it's ready for those future machines. Luke and I are working together to figure out how to fix our current code and transform it into one that's useful at exascale."
"Most people think that Knight's Landing (a second generation Xeon Phi product using a 14 nm process) is a preview of what processors will look like going forward as we push toward exascale — lots of concurrency, many cores in a single package, the memory footprint per thread is going to be very small — so we will completely rethink the way we solve our problems. It's safe to say that every time a new processor comes out it's a completely new challenge," Wilson concluded.
Dr. Dan Bodony's research is funded by the Office of Naval Research. XSEDE and TACC's Stampede supercomputer are funded by the National Science Foundation.
Dan Bodony: Associate Professor, Aerospace Engineering, University of Illinois at Urbana-Champaign
Luke Wilson: XSEDE ECSS Representative and Research Associate, High Performance Computing, TACC
Final-checker-method-schematic: By connecting large simulations of jet exhaust turbulence with advanced parallel algorithms for computing eigenvalues and eigenvectors, jet noise reducing controllers can be constructed and shown to work.
- XSEDE Resources, Trinity Enable Non-Human Primate Reference Transcriptome Resource to Support Study of Genes in Our Closest Relatives
- Turtle Tree of Life
- Region 1 Champions meet at Idaho National Laboratory
- Crash test simulations expose real risks
- NSF supports development of new arctic maps
- How was the planet Earth formed?
- Exploring Large Data for Scientific Discovery
- XSEDE Value Added
- Scholars program helps realize dream
- Making sense of cyberinfrastructure
- XSEDE15 Wrap Up
- Bioinformatics Scripts Solutions
- XSEDE15 Plenary Panel
- Polymer Potential
- The Future of NSF Advanced Computing Infrastructure
- 2015 International Summer School on HPC Challenges
- A Catalyst for Complexity
- As Austin Grows So Does Its Traffic Woes
- The University of Tennessee, Knoxville, Wins Second Place in an International Student Supercomputing Competition
- PSC Receives NSF Award for Bridges Supercomputer
- Innovative New Supercomputers Increase Nation's Computational Capacity and Capability
- Exploring Competitive Balance
- A Direct Bridge
- The Dopamine Transporter
- XSEDE Supercomputers Laid the Foundation for an Unprecedented Simulation of Cosmological Evolution
- Big Data Needs Big Funding
- XSEDE helps create a more effective way to assemble genomic information
- Of Micelles and Machines
- XSEDE Allocation System to Receive Makeover
- Internet2: Advancing Science in the Age of Big Data
- XSEDE User Portal At Your Fingertips: Mobile App
- Researchers Study Air Pollution
- Dan Stanzione: New Executive Director at TACC
- People of XSEDE: Campus Champions - Preaching the HPC Gospel
- XSEDE and Blue Waters Go Supernova
- Two at a Time
- Show Him the Money
- Cosmic Slurp
- Turning Salt into the Unknown
- Looking Inside Images
- Farming the Wind
- Breaking out of the Digital Graveyard
- The Mechanism of Short-term Memory
- Open Science and Industry Collaboration
- XSEDE, Prace Call for Requests of Joint Support
- XSEDE Wins HPCWire Award
- Shields to Maximum, Mr. Scott
- The Ultimate Timekeeper
- Blue Waters, XSEDE sign collaborative agreement
- People of XSEDE - Outreach programs set XSEDE apart
- Wrangler Reels in Award
- The Great Comet: NSF awards $12 Million Grant to SDSC to deploy Comet
- Meet the Gribbles
- 2013 Nobel Prize in Chemistry winners bring HPC to the lab
- XSEDE helps create a more effective way to assemble genomic information
- XSEDE facilitates large-scale image analysis to understand diseases
- XSEDE announces new campus briding services and tools
- XSEDE, NSF Release Cloud Survey Report
- XSEDE13: Programming Competition Allows Students to "Geek Out" and Gain Crucial Skillsets
- Katlin Thaney gave XSEDE13 Keynote: Gateways for Open Science
- XSEDE13 conference selects best papers, posters visualizations and more
- XSEDE13 speaker tells how turbulence simulations help make movie magic
- XSEDE13 Plenary Talk: Accelerating Brain Research with Supercomputers
- Invited speakers announced for Extreme Scaling Workshop - Heterogenous Computing
- XSEDE13 speaker LeManuel "Lee" Bitsóí: Democratizing Scientific Research
Read more about Bitsóí's talk at this year's conference
- More than 70 students from 4 continents gain HPC skills at fourth annual Summer School
- Registration opens for Extreme Scaling Workshop 2013
- Campus Champions Fellows Named
- Campus Champions program reaches 200 members
- Rock Snot Genomics: University of Texas researchers use advanced sequencing and TACC's Ranger supercomputer to uncover origin of common algae
- Experiencing some turbulence: Researchers Take on One of Physics' Most Important and Enduring Problems
- Register now for Virtual School summer courses on data-intensive and many-core computing
- XSEDE seeks a Scientific Workflow Specialist for Extended Collaborative Support Service
Applications are due May 31, 2013
- XSEDE13 schedule now available online
- Students from high school to grad school levels invited to participate in programming contest at XSEDE13 high performance computing conference
- SDSC's Gordon enables discoveries in the study of genetics Read about Gordon's role in pinpointing the genetic patterns underlying autism-spectrum disorders, schizophrenia and similar brain conditions.
- XSEDE, National Computational Science Institute offer summer workshops for educators
- XSEDE13 Student Day applications due May 15 High school and undergraduate students get hands-on experience in computational science and interact with expert researchers
- XSEDE upgrades to Internet2's 100G Network
- XSEDE13 Registration now open!
- Get to know XSEDE Staff XSEDE Allocations Manager Ken Hackworth: The Man, The Myth, The Legend
- Two sponsors commit to XSEDE13 conference: Cray and Intel .
- Texas Unleashes Stampede
- Swirling Secrets-Understanding the turbulence of gases
- Blacklight helps researchers develop better materials for carbon capture
- Journey to the limits of spacetime
- Students invited to participate in XSEDE13 Multiple ways for high school, undergraduate, and graduate students to get involved; funding support available.
- XSEDE Call for Humanities, Arts and Social Science ProjectsIf you and your collaborators need to access to large collections of digital data, need more computer power, or require substantial storage capacity and computing power – please share it with XSEDE.
- XSEDE needs your feedback! If you received an invitation to complete the 2013 User Satisfaction Survey, please take 10 minutes today to share your comments about the XSEDE user experience.
- XSEDE deploys Globus Online for data transfer The first official software service on XSEDE has been accepted for production deployment
- The Stampede Era Begins XSEDE supercomputer now operational and available to the national open science community
- Call for ParticipationInternational Summer School on HPC Challenges in Computational Sciences
- XSEDE, European Grid Infrastructure seek collaborative use cases
Deadline extended to March 8!
- XSEDE offers free online parallel computing course Learn to use parallel computers more efficiently and productively
- NICS makes the top of Green500 list XSEDE partner recognized for energy-conscious high-performance computer, Beacon
- XSEDE's John Towns appointed to Compute Canada board of directors Board includes leaders in industry, academia, and computational research
- STILL ACCEPTING RESPONSES to Cloud Use Survey from XSEDE, NSF All researchers encouraged to respond and help shape future of cloud computing in XSEDE
- Make room for Stampede: TACC expands data center for new supercomputer
Read more about the new data center at TACC
See TACC Deputy Director, Dan Stanzione describe the new center
- SDSC welcomes Gordon supercomputer as a research powerhouse
Read more about SDSC's Gordon
- Campus Bridging Early Adopter Program issues Call For Proposals to be submitted Dec. 1-9
Read more about the program
- XSEDE12 announced -- first conference of Extreme Science and Engineering Discovery Environment
Read more about XSEDE12
- PSC, SGI Team Up on Shared-Memory Supercomputer
Read more about PSC's shared-memory supercomputer
- Pittsburgh Supercomputing Center Wins High-Performance Computing Award
Read more about PSC
- Blacklight Goes to Work at the Pittsburgh Supercomputing Center
Read more about Blacklight
- Ranger supercomputer's lifespan extended one year as part of NSF XD initiative.
Read more about Ranger
- Kraken set to deliver 2 billionth CPU hour, sustains 96 percent utilization
Read more about Kraken
- TACC Offers New, Broader Computational Biology Software Stack to Open Science Community.
Read more about biology software stack
- ACM launches new Special Interest Group on High Performance Computing. Join by Nov. 18 for special rate.
Read more about the new SIGHPC
- 'What Are You Working on Today,' Ranger, Jaguar and iForge?
Read more about TACC's Ranger supercomputer
Read more about ORNL's Jaguar supercomputer
Read more about NCSA's iForge supercomputer
- Adventures with HPC Accelerators, GPUs and Intel MIC Coprocessors
Read more about experiences with new hardware
- Developing Scientific Computing Communities
Read more about development efforts
- Indiana University to create the National Center for Genome Analysis Support, which will be integrated with XSEDE resources
Read more about the NCGAS at IU
- Scientists use XSEDE/TeraGrid resources to determine how shock waves move through solids
Read more about 'super-elastic shock waves'
- XSEDE upgrades network
Read more about the XSEDE upgrade
- Richard Tapia, Rice University mathematician and professor and member of XSEDE outreach team, receives National Medal of Science
Watch the Oct. 21 webcast
Read more about Tapia's award
Learn more about Richard Tapia
- Stampede's comprehensive capabilities to bolster U.S. open science computational resources
Read more about Stampede
Watch a video of Jay Boisseau, director of TACC, discussing Stampede
- SDSC announces scalable, high-performance data storage cloud
Read more about SDSC cloud
- Appro and SDSC Gordon supercomputer to provide up to 35M IOPS
Read more about SDSC's Gordon
- Dr. Barry Schneider from the National Science Foundation to describe XSEDE in the Oklahoma Supercomputing Symposium keynote, Oct. 11-12
Read more about Dr. Schneider's keynote
Go to symposium site
- Students research solar cells with HPC
Read more about HPC and solar research
- Seeing Is Believing: Extreme Digital visualization and data analysis resources help researchers derive insights from massive data sets
Read more about Extreme Digital
- New "Memory Advantage Program" on Blacklight at the Pittsburgh Supercomputing Center
Read more about PSC's MAP
- XSEDE project brings advanced cyberinfrastructure, digital services, and expertise to nation's scientists and engineers
Read more about XSEDE
- Watch the John Towns video
- How XSEDE will facilitate collaborative science
Read more about XSEDE and collaboration