Maintaining Trust in Reduction: Preserving the Accuracy of Quantities of Interest for Lossy Compression

Date

2022-01-01

Author

Gong, Qian
Liang, Xin
Whitney, Ben
Choi, Jong Youl
Chen, Jieyang
Wan, Lipeng
Ethier, Stephane
Ku, Seung-Hoe
Churchill, R. Michael
Chang, C-S
Ainsworth, Mark
Tuğluk, Ozan
Munson, Todd
Pugmire, David
Archibald, Richard
Klasky, Scott

Metadata

Show full item record

This work is licensed under a Creative Commons Attribution-NonCommercial-NoDerivatives 4.0 International License.

Item Usage Stats

35
views

0
downloads

Cite This

As the growth of data sizes continues to outpace computational resources, there is a pressing need for data reduction techniques that can significantly reduce the amount of data and quantify the error incurred in compression. Compressing scientific data presents many challenges for reduction techniques since it is often on non-uniform or unstructured meshes, is from a high-dimensional space, and has many Quantities of Interests (QoIs) that need to be preserved. To illustrate these challenges, we focus on data from a large scale fusion code, XGC. XGC uses a Particle-In-Cell (PIC) technique which generates hundreds of PetaBytes (PBs) of data a day, from thousands of timesteps. XGC uses an unstructured mesh, and needs to compute many QoIs from the raw data, f. One critical aspect of the reduction is that we need to ensure that QoIs derived from the data (density, temperature, flux surface averaged momentums, etc.) maintain a relative high accuracy. We show that by compressing XGC data on the high-dimensional, nonuniform grid on which the data is defined, and adaptively quantizing the decomposed coefficients based on the characteristics of the QoIs, the compression ratios at various error tolerances obtained using a multilevel compressor (MGARD) increases more than ten times. We then present how to mathematically guarantee that the accuracy of the QoIs computed from the reduced f is preserved during the compression. We show that the error in the XGC density can be kept under a user-specified tolerance over 1000 timesteps of simulation using the mathematical QoI error control theory of MGARD, whereas traditional error control on the data to be reduced does not guarantee the accuracy of the QoIs.

URI

https://hdl.handle.net/11511/116470

Collections

Graduate School of Applied Mathematics, Conference / Seminar