Skip to content

Parallel read-in for HOPR hdf5 meshes (after partitioning)#24

Merged
amrueda merged 41 commits intodevelopfrom
parallel_readin_hopr
Jan 27, 2026
Merged

Parallel read-in for HOPR hdf5 meshes (after partitioning)#24
amrueda merged 41 commits intodevelopfrom
parallel_readin_hopr

Conversation

@amrueda
Copy link
Collaborator

@amrueda amrueda commented Nov 12, 2025

This is step 2/3 of improving the pre-processing of HOPR hdf5 meshes in parallel.

  1. Epicure optimizations for mesh read-in were done in 22.
  2. In this PR, we enable parallel read access to HDF5 mesh files from separate processes in ConstructMeshPartition_FromHDF5File_() for space-filling curve (SFC) partitioning (it requires partitioning = SFC in the control file). This reduces the allocation burden and speeds up the mesh reading, as each rank will only read the mesh data that it requires (which is stored contiguously in the mesh file). However, a serial read-in of the mesh is still necessary for partitioning. Here, we also fix the initialization and finalization of hdf5 within horses and add tests for parallel read-in.
  3. In a future PR, we will do the domain partitioning in parallel.

@amrueda amrueda marked this pull request as draft November 12, 2025 10:24
@amrueda amrueda force-pushed the parallel_readin_hopr branch from 0646d4c to 1135496 Compare November 17, 2025 15:50
@amrueda amrueda force-pushed the parallel_readin_hopr branch from 200cba5 to 93ee083 Compare November 18, 2025 14:24
@loganoz
Copy link
Owner

loganoz commented Nov 21, 2025

@amrueda, check with @oscarmarino but I do not think horses mpi compiles in debug mode. It has to do with the colouring class that no one is currently using.

@amrueda amrueda marked this pull request as ready for review January 20, 2026 15:47
@amrueda amrueda changed the title WIP: Parallel read-in for HOPR hdf5 meshes Parallel read-in for HOPR hdf5 meshes (after partitioning) Jan 20, 2026
@amrueda amrueda requested a review from oscarmarino January 21, 2026 12:12
Copy link
Owner

@loganoz loganoz left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

ok to merge, as discussed in the previous horses meeting

@amrueda amrueda merged commit 4bd7ec2 into develop Jan 27, 2026
4 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants