escience2019

Large-scale experimental and observational facilities, individually and collectively, provide new opportunities for data-driven research across a wide range of science and engineering domains. These facilities provide shared-use infrastructure, instrumentation, and data products that are openly accessible to a broad community of researchers and educators. However, as these facilities grow in scale and provide increasing volumes of data and data products, effectively using them has become a significant challenge. In this talk, I will explore new opportunities enabled by these facilities as well as the new challenges presented. I will also explore how the cyberinfrastructure continuum, from the edge to extreme scales systems, can be harnessed to support end-to-end data-driven workflows. Specifically, I will explore approaches for intelligent data delivery, in-transit data processing and edge-core integration. This research is part of the Continuum Computing project at the Rutgers Discovery Informatics Institute.