Please use this identifier to cite or link to this item:
https://hdl.handle.net/11681/36758| Title: | Parallel file I/O for geometric models : formats and methods |
| Authors: | Hunter, Robert H. White, Barry C. Patel, Reena R. Ballard, Jerrell Ray, 1965- |
| Keywords: | High performance computing Geometry--Computer programs Geometry--Data processing Computer input-output equipment Parallel processing (Electronic computers) Electronic data processing Computer architecture Geometrical models |
| Publisher: | Information Technology Laboratory (U.S.) Engineer Research and Development Center (U.S.) |
| Series/Report no.: | Special Report (Engineer Research and Development Center (U.S.)) ; no. ERDC/ITL SR-20-5 |
| Abstract: | Processing large amounts of data in a High-Performance Computing (HPC) environment can be throttled quickly without an efficient method for utilizing disk I/O. The Geometry Engine component of the Virtual Environment for Sensor Performance Assessment (VESPA) uses MPI-IO to load the geometric data in parallel and avoid creating a bottleneck on disk I/O interactions. This parallel I/O method requires formatting the data into specific binary file formats so each MPI process of the parallel program can determine where to read or write data without colliding with other MPI processes. Addressing the collision problem resulted in the development of two binary file formats, the Mesh Binary file (.mb) and the Scene Chunk Pack file (.scp). The Mesh Binary file contains the essential data required to recreate the landscape and vegetation geometry used by the Geometry Engine. The Scene Chunk Pack file is used to write the partitioned geometry to disk, so the ray casting engine can reload the distributed geometry without repeating the partitioning process. Both of these files together support reading and writing for the partitioning phase and the ray casting phase of the Geometry Engine. This report discusses these formats in detail and outlines how the Geometry Engine reads and writes these files in parallel on HPC. |
| Description: | Special Report |
| Gov't Doc #: | ERDC/ITL SR-20-5 |
| Rights: | Approved for Public Release; Distribution is Unlimited |
| URI: | https://hdl.handle.net/11681/36758 http://dx.doi.org/10.21079/11681/36758 |
| Size: | 27 pages / 1.54 MB |
| Types of Materials: | |
| Appears in Collections: | Special Report |
Files in This Item:
| File | Description | Size | Format | |
|---|---|---|---|---|
| ERDC-ITL SR-20-5.pdf | 1.54 MB | Adobe PDF |  View/Open |