ECSS Symposium

Extended Collaborative Support program provides expert assistance in a wide range of
cyberinfastructure technologies. Any user may request this assistance through the XSEDE allocation process.

The primary goal of this monthly symposium is to allow the over 70 staff members working in ECSS to exchange information about successful techniques used to address challenging science problems. Tutorials on new technologies may also be featured. Two 30-minute, technically-focused talks will be presented each month and will include a brief question and answer period. This series is open to all.

Symposium coordinates:

Third Tuesday of the month, pending scheduling conflicts. Upcoming events will be listed on the website and announcements posted to the News Training category.
1pm Eastern/12pm Central/10am Pacific

These sessions will be recorded. For this large webinar, only the presenters and host will be broadcasting audio. Attendees may submit questions to the presenters through a moderator by sending a chat message.

Join from PC, Mac, Linux, iOS or Android:
Or iPhone one-tap (US Toll):  +14086380968,350667546# or +16465588656,350667546#
Or Telephone:
    Dial: +1 408 638 0968 (US Toll) or +1 646 558 8656 (US Toll)
    Meeting ID: 350 667 546

Videos and slides from past presentations are available below.
(Videos not listed below, from prior years, can be found here: 201220132014, 2015)

January 16, 2018

An Introduction to Jetstream

Presenter(s): Virginia Trueheart (TACC)

Presentation Slides

Jetstream is an interactive computing resource designed to make High Performance Computing accessible to users that are not part of traditional HPC fields. This tutorial aims to introduce Jetstream's capabilities to this expanded user base. It will demonstrate how to access the system, make use of the various Virtual Machines available, and use publicly available images to assist with research. It will also cover how to create, modify, and save personal images that can be customized to individual workflows and be saved long term for reference in publication.

Visualizations of Simulated Supercell Storm Data

Presenter(s): Greg Foss (TACC)
Principal Investigator(s): Amy McGovern (University of Oklahoma)

Presentation Slides

XSEDE ECSS project: High Performance Computing Resources in Support of Spatiotemporal Relational Data Mining for Anticipation of Severe Weather.
Amy McGovern and her collaborator Corey Potvin from the National Severe Storms Laboratory are developing and applying novel spatiotemporal data mining techniques to supercell thunderstorm simulations, with the goal of identifying tornado precursors. The overall goal of the project is to improve tornado warning lead time and accuracy by integrating into the "Warn on Forecast" project, a National Oceanic and Atmospheric Administration research program tasked to increase tornado, severe thunderstorm, and flash flood warning lead times.
XSEDE ECSS staff was enlisted to see what could be found using 3D visualization techniques and an interactive user interface. The resulting images and animations will assist in defining storm features and as input to the data mining: ensuring automatically extracted objects match visually identified ones. This talk will feature graphics from a selection of three (5.7 TB) datasets, with visualization samples identifying various supercell thunderstorm features.

December 19, 2017

Jupyter Notebooks deployments at scale for Gateways and Workshops

Presenter(s): Andrea Zonca (SDSC)

Presentation Slides

Andrea Zonca (SDSC) will give an overview on deployment options for Jupyter Notebooks at scale on XSEDE resources. They are all based on deploying Jupyterhub on Jetstream, then either spawn Notebooks on a traditional HPC system or setup a distributed scalable system on Jetstream instances either via Docker Swarm or Kubernetes.

Deployment and benchmarking of RDMA Hadoop, Spark, and HBase on SDSC Comet

Presenter(s): Mahidhar Tatineni (SDSC)

Presentation Slides

Data-intensive computing middleware (such as Hadoop, Spark) can potentially benefit greatly from the hardware already designed for high performance and scalability with advanced processor technology, large memory/core, and high performance storage/filesystems. Mahidhar Tatineni (SDSC) will give an overview of the deployment and performance of Remote Direct Memory Access (RDMA) Hadoop, Spark, and HBase middleware on the XSEDE Comet HPC resource. These packages have been developed by Dr. D.K. Panda's Network-Based Computing (NBC) Laboratory at the Ohio State University. The talk will cover details of the integration with the HPC scheduling framework, the design and components of the packages, and the performance benefits of the design. Applications tested include the Kira toolkit (astronomy image processing), latent Dirichlet allocation (LDA) for topic modeling, and BigDL (distributed deep learning library).

October 17, 2017

Geodynamo Simulation Code for Paleomagnetic Observations

Presenter(s): Shiquan Su (NCAR) Chad Burdyshaw (NICS)
Principal Investigator(s): David Gubbins (Scripps Institution of Oceanography at UCSD)

Presentation Slides

Presentation Slides

This study characterizes a geodynamo simulation code for paleomagnetic observations targeted to run on TACC Stampede2 KNL cluster; a hybrid, distributed many-core parallel architecture. Issues examined are parallel scaling across distributed nodes and within the many core architecture, as well as vectorization efficiency, arithmetic intensity and memory throughput.

This presentation includes two parts. In the first part, Shiquan Su from NCAR will introduce the background of the project, the parallelization algorithm, the experience on Stampede KNL cluster, OpenMP treatment, and the two approaches to run the project jobs on the machines. In the second part, Chad Burdyshaw from UTK takes a close look at the code. Chad will discuss the tools used to interrogate performance, observations, remedies, and potential solutions.

September 19, 2017

COSMIC2 - A Science Gateway for Cryo-Electron Microscopy with Globus for Terabyte-sized Dataset

Presenter(s): Mona Wong-Barnum (SDSC)
Principal Investigator(s): Andres Leschziner (UCSD) Michael Cianfrocco (University of Michigan)

Presentation Slides

Structural biology is in the midst of a revolution. Instrumentation and software improvements have allowed for the full realization of cryo-electron microscopy (cryo-EM) as a tool capable of determining atomic structures of protein and macromolecular samples. These advances open the door to solving new structures that were previously unattainable, which will soon make cryo-EM a ubiquitous tool for structural biology worldwide, serving both academic and commercial purposes. However, despite its power, new users to cryo-EM face significant obstacles. One major barrier consists of the handling of large datasets (10+ terabytes), where new cryo-EM users must learn how to interface with the Linux command line while also dealing with managing and submitting jobs to high performance computing resources. To address this barrier, we are developing the COSMIC2 Science Gateway as an easy, web-based, science gateway to simplify cryo-EM data analysis using a standardized workflow. Specifically, we have adapted the successful and mature Cyberinfrastructure for Phylogenetic Research (CIPRES) Workbench [8] and integrated Globus Auth [6] and Globus Transfer [7] to enable federated user identity management and large dataset transfers to Extreme Science and Engineering Discovery Environment's (XSEDE) [1] high performance computing (HPC) systems. With the support of XSEDE's Extended Collaborative Support Services (ECSS) [16] and the Science Gateway Community Institute's (SGCI) Extended Developer Support (EDS), this gateway will lower the barrier to high performance computing tools and facilitate the growth of cryo-EM to become a routine tool for structural biology. Talk previously given at PEARC'17

First steps in optimising Cosmos++: A C++ MPI code for simulating black holes

Presenter(s): Damon McDougall (ICES)
Principal Investigator(s): Patrick C. Fragile (College of Charleston)

Presentation Slides

This ECSS project is to have Cosmos++ run on Stampede2 effectively. Stampede2, at present, is made up entirely of Intel Xeon Phi nodes. These are low clock-frequency but high core-count nodes, and there are some challenges associated with running on this hardware efficiently. Although the project's end goal is to hybridise a pure MPI code, this talk will focus on some of the initial steps we have taken to improve serial performance and how these steps relate to C++ software design. Prior knowledge of compiled languages and custom types would be beneficial but isn't required.

August 15, 2017

HTC with a Sprinkle of HPC: Finding Gravitational Waves with LIGO

Presenter(s): Lars Koesterke (TACC)
Principal Investigator(s): Duncan Brown (Syracuse University) Josh Willis (Abilene Christian University)

Presentation Slides

XSEDE is supporting the LIGO project to detect signatures of gravitational waves in a stream of data generated by (currently) two observatories in the U.S., located in Washington State and Louisiana. I will report on an ECSS project tasked to improve the performance of one of the largest (most resource demanding) pipelines called pycbc (python compact binary collision). The software evolved from a slow and performance-unaware state to a high-performing pipeline capable of utilizing Xeon, Xeon Phi, and Nvidia GPU architectures alike. Achieving high performance required only a few sprinkles of HPC (High Performance Computing) on top of a HTC (High Throughput Computing) pipeline. While the HPC pieces relevant for this particular project are all well known to ECSS staff it may be surprising what was missing in the considerations of the software developers. Hence this is more a story of how to educate users than a story of new and groundbreaking HPC concepts. Nevertheless I am confident that my fellow ECSS staffers will find this project interesting and enlightening.

Enabling multi-events 3D simulations for earthquake hazard assessment

Presenter(s): Yifeng Cui (SDSC)
Principal Investigator(s): Morgan Moschetti (USGS)

Presentation Slides

Researchers from USGS use Stampede to perform a series of computationally intensive simulations for improved understanding of earthquake hazards. Hercules, a finite element solver developed at CMU, is used to make the calculations which combines meshing, partitioning and solving functions in a single, self-contained code. Meshing employs a highly efficient octree-based algorithm that scales well. The simulation results are used to investigate the effects of complex geologic structure and topography on seismic wave propagation and ground-shaking hazards, and to evaluate model uncertainties in U.S. seismic hazard models. This talk will provide an overview of current status of the seismic hazard analysis research, and introduce the code performance, the optimizations involved in supporting multi-event simulations for this study through the ECSS project.

June 16, 2015

A Short Story of Efficiently Using Two Open-Source Applications on Stampede

Presenter(s): Ritu Arora (TACC)

Presentation Slides

This presentation will cover a summary of two challenges and solutions related to running the DROID (Digital Record Object Identification) and the FLASH astrophysics code on a large number of nodes on Stampede.
DROID is a software tool developed by The National Archives to perform automated batch identification of file formats. It is written in Java and works well when only one copy of it is run on a node. PI Jesscia Trelogan from the Institute of Classical Archaeology at UT Austin has been using DROID as part of her workflow for managing a large archaeological data collection. It would take her more than 2 days to extract metadata from about 4.3 TB of data using DROID on a local server. Since the process of culling and reorganizing the data collection is iterative, the metadata extraction using DROID needs to be done often. The goal of the ECSS project with PI Trelogan was to provide support in leveraging Stampede for parts of her workflow, which includes DROID, so that the overall time-taken in conducting all the steps in the workflow is reduced. The main challenge in using DROID on Stampede was related to executing its multiple copies in parallel on different nodes in a batch mode. An overview of this challenge and its solution strategy will be discussed during this presentation.
In another project, a copy of the FLASH astrophysics code was optimized such that the code does striped I/O on the Lustre File System. This project was proposed after it was found that a user overloaded the Lustre servers (which eventually became unresponsive) while running FLASH on 7000+ cores. The problem was related to the step that involved reading a checkpoint file. An overview of the problem and its solution will be included in this talk.

Optimization of Text Processing for the WordFlare Knowledge Graph

Presenter(s): Robert Sinkovits (SDSC)
Principal Investigator(s): Michael Douma (IDEA)

Presentation Slides

The goal of the WordFlare project is to create a tablet-based app to engage K-12 and lifelong learners in exploring language and knowledge. The app is based on a massive thesaurus and features dynamic visualizations of word relationships. Approximately 9% of the content is human-curated, while the other 91% is derived using computational methods executed on XSEDE resources. In this talk, I will describe the steps taken to accelerate two key steps in the automated text processing – optimization of the Latent Dirichlet Allocation (LDA) algorithm and the development of a fast method to simultaneously search for large numbers of words in a corpus. The speedups we obtain are highly problem dependent, ranging from 1.5-2.2x for the LDA algorithm and up to 1500x for the word search when using a large reference dictionary (e.g. the 400K words found in Wiktionary).

May 19, 2015

ECSS experience with non-traditional HPC users

Presenter(s): Junqi Yin (NICS)
Principal Investigator(s): Annette Engel (U. Tenn) Yong Zeng (UMKC)

Mothur is an open source bioinformatics pipeline used for biological sequence analysis that has gained increasing attention in the microbial ecology community. Because a large set of functionalities in Mothur are memory bound, it is well suited for shared memory architectures. I will discuss performance results for several commands in Mothur that are popular in the operational taxonomic unit analysis, and show that pipeline processes can be accelerated by orders of magnitude faster.

Real-time Bayesian estimation for financial ultra-high frequency data is plagued with the curse of high dimensionality. Methods have been developed to manage this problem through the use of MPI. By porting to CUDA, I'll show that an adequately equipped GPU workstation can rise to the task, producing reasonably real-time results with actual data from financial markets.

P3DFFT: a scalable open-source solution for Fourier Transforms and other algorithms in three dimensions

Presenter(s): Dmitry Pekurovsky (SDSC)

P3DFFT is an open-source package developed at SDSC. It implements three-dimensional Fourier Transforms and other algorithms, in a highly scalable and efficient way. P3DFFT achieves good scaling on hundreds of thousands of compute cores. It has received much interest and use from scientists in diverse fields such as DNS turbulence simulations, astrophysics, oceanography and material science. Recently it has been the subject of an internal ECSS project, aimed at making it XSEDE community software. It has been ported, tested and documented on the largest computational systems at XSEDE. Additional features have been added to help widen the impact in the community. In this presentation I will go over the main features of P3DFFT, including the recently added, and review how users of XSEDE can access it on XSEDE platforms.

April 21, 2015

reproducibility@XSEDE: Reporting Back to our Colleagues

Presenter(s): Doug James (TACC) Carlos Rosales (TACC) Nancy Wilkins-Diehr (SDSC)

Presentation Slides

The reproducibility@XSEDE workshop ( was a full-day event held in conjunction with XSEDE14. The workshop featured an interactive, open ended, discussion-oriented agenda focused on reproducibility in large-scale computational science. This presentation includes (1) independent reactions to the event by three of the workshop principals; and (2) an open discussion on the topic of reproducibility in general.

March 17, 2015

Gateway Building for the Non-Linear Adjoint Coefficient Estimation (NLACE) project

Presenter(s): Lan Zhao (Purdue) Chris Thompson (Purdue)
Principal Investigator(s): Paul Barbone (Boston University)

Presentation Slides

Presenters will discuss work providing a solution for the NLACE (Non-Linear Adjoint Coefficient Estimation) research group to making biomechanical imaging analysis model available to the community using XSEDE resources. The research has a wide variety of medical applications including brain scanning, bone structure analysis, and cancer detection. The Barbone group created and maintains the NLACE model and needed help with science gateway development. They have an allocation on Gordon, and the ECSS team was able to help them get their model installed there and quickly create an application for utilizing it on DiaGrid, a HubZero-based gateway for hosting scientific applications

Real-Time Next Generation Sequencing (NGS) in the Classroom using Galaxy

Presenter(s): Josephine Palencia (PSC) Alex Ropelewski (PSC)

Presentation Slides

We present an interesting real-user case scenario supporting 30 Carnegie Mellon University (CMU) Bioinformatics students from three classes performing real-time next generation sequencing (NGS). We describe the system setup, the scaling preparations, the tools and the full workflow, the data and reference files and the lessons learned from the classroom experience.

March 6, 2015

PRACE-XSEDE Interoperability projects

Presenter(s): Morris Riedel (Juelich Supercomputing Centre) Sandra Gesing (Notre Dame University) Shantenu Jha (Rutgers University)

Presentation Slides Gesing Presentation

Presentation Slides Jha Presentation

1) "Smart Data Analytics for Earth Sciences across XSEDE and PRACE", speaker Morris Riedel, Juelich Supercomputing Centre.

The ever-increasing amount of earth science data arising from measurements or computational simulations requires new ‘smart data analytics techniques' capable of extracting meaningful findings from ‘pure big data'. XSEDE as well as PRACE provides excellent resources that enable efficient and effective data analytics when several technical frameworks and data analysis packages would be available. While we assessed tools and technologies for a couple of earth science case studies, the scientific case in this particular Webinar is driven by one particular earth science analytics use case: automated anomaly/outlier detection of earth science time series datasets that require a parallel and scalable clustering detection algorithm that is able to take advantage of the interoperability between XSEDE and PRACE systems today. As one of the key results of our technology assessment project, we present our parallel and scalable Density-based Spatial Clustering of Applications with Noise (DBSCAN) algorithm implementation and how it can be used across different infrastructures using open standards to decouple architecture from concrete implementations. Solutions will be outlined that can be used today in production if associated resource allocations in XSEDE and/or PRACE are granted for the user. More details will be presented at the Research Data Alliance (RDA) 5th Plenary Big Data Analytics Group Session at San Diego in March 2015 and at the European Geosciences Union (EGU) 2015 Big Data for Earth Science session in Vienna in April 2015.

2) "Unicore Use Case Integration for XSEDE and PRACE", speaker Sandra Gesing, U of Notre Dame

European Team: Molecular Simulation Community represented by MoSGrid, SCI-BUS and ER-flow and the computational radiation physics community represented by the Helmholtz-Zentrum Dresden-Rossendorf (HZDR), US: Center for Research Computing, University of Notre Dame

The project focuses on the integration of two UNICORE use cases for the joint support of XSEDE and PRACE: the first one targets the molecular simulation community, the second one the computational radiation physics community. The project MoSGrid (Molecular Simulation Grid) offers a web-based science gateway supporting the community with various services for quantum chemistry, molecular modeling, and docking applying UNICORE as grid middleware.

The main technical challenge in MoSGrid has been to extend the portal infrastructure for the intuitive use of the XSEDE and PRACE infrastructure via UNICORE and according credentials. The members of the computational radiation physics community involved in this project focuses on the generation of advanced laser-driven sources of particle and X-ray beams. They aim to "simulate what is measured" to reproduce experimental measurements and connecting them to the fundamental plasma processes on the single-particle scale. The main goal wasto make the according tools on both XSEDE and PRACE systems via UNICORE available to allow for the exchange of common workflows, which can be applied on both infrastructures. The talk will go into detail about the goals, the lessons learned and the accomplished steps.

3) "Interoperable High Throughput Binding Affinity Calculator for Personalised Medicine", speaker Shantenu Jha, Rutgers Team European: Prof Peter V. Coveney (University College London) and Prof Dieter Kranzlmuller (LRZ/LMU), US: Prof. Shantenu Jha (RADICAL, Rutgers)

To improve the ability calculate drug-binding affinities the CCS at UCL has developed the Binding Affinity Calculator (BAC), which allows the building of the necessary patient specific models required to simulate drug performance, a process which requires a complex number of steps in order to customise a generic model with patient specific information, and then run the calculations As part of this XSEDE-PRACE project, BAC has been interfaced with RADICAL-Cybertools to interoperably utilize XSEDE and PRACE resources. We will present some preliminary results

Meeting number: 849 368 891
Meeting password: PRACE-XSEDE