Please use this identifier to cite or link to this item: https://hdl.handle.net/11681/36758
Title: Parallel file I/O for geometric models : formats and methods
Authors: Hunter, Robert H.
White, Barry C.
Patel, Reena R.
Ballard, Jerrell Ray, 1965-
Keywords: High performance computing
Geometry--Computer programs
Geometry--Data processing
Computer input-output equipment
Parallel processing (Electronic computers)
Electronic data processing
Computer architecture
Geometrical models
Publisher: Information Technology Laboratory (U.S.)
Engineer Research and Development Center (U.S.)
Series/Report no.: Special Report (Engineer Research and Development Center (U.S.)) ; no. ERDC/ITL SR-20-5
Abstract: Processing large amounts of data in a High-Performance Computing (HPC) environment can be throttled quickly without an efficient method for utilizing disk I/O. The Geometry Engine component of the Virtual Environment for Sensor Performance Assessment (VESPA) uses MPI-IO to load the geometric data in parallel and avoid creating a bottleneck on disk I/O interactions. This parallel I/O method requires formatting the data into specific binary file formats so each MPI process of the parallel program can determine where to read or write data without colliding with other MPI processes. Addressing the collision problem resulted in the development of two binary file formats, the Mesh Binary file (.mb) and the Scene Chunk Pack file (.scp). The Mesh Binary file contains the essential data required to recreate the landscape and vegetation geometry used by the Geometry Engine. The Scene Chunk Pack file is used to write the partitioned geometry to disk, so the ray casting engine can reload the distributed geometry without repeating the partitioning process. Both of these files together support reading and writing for the partitioning phase and the ray casting phase of the Geometry Engine. This report discusses these formats in detail and outlines how the Geometry Engine reads and writes these files in parallel on HPC.
Description: Special Report
Gov't Doc #: ERDC/ITL SR-20-5
URI: https://hdl.handle.net/11681/36758
http://dx.doi.org/10.21079/11681/36758
Appears in Collections:Documents

Files in This Item:
File Description SizeFormat 
ERDC-ITL SR-20-5.pdf1.54 MBAdobe PDFThumbnail
View/Open