kennellyt / cans Goto Github PK

CaNS (Canonical Navier-Stokes) is a code for massively-parallel numerical simulations of fluid flows. It aims at solving any fluid flow of an incompressible, Newtonian fluid that can benefit from a FFT-based solver for the second-order finite-difference Poisson equation in a 3D Cartesian grid. In two directions the grid is regular and the solver supports the following combination of (homogeneous) boundary conditions:

• Neumann-Neumann
• Dirichlet-Dirichlet
• Neumann-Dirichlet
• Periodic

In the third domain direction, the solver is more flexible as it uses Gauss elimination. There the grid can also be non-uniform (e.g. fine at the boundary and coarser in the center).

CaNS also allows for choosing an implicit temporal discretization of the diffusion term of the N-S equations. This results in solving a Helmholtz equation for each velocity component. Since FFT-based solvers are also used, the same options described above for pressure boundary conditions apply to the velocity, in case implicit diffusion is active.

Reference

P. Costa. A FFT-based finite-difference solver for massively-parallel direct numerical simulations of turbulent flows. Computers & Mathematics with Applications 76: 1853--1862 (2018). doi:10.1016/j.camwa.2018.07.034 [arXiv preprint]

[26/12/2021] Implicit temporal discretization of the diffusion term along only one direction (z) is now also supported.

[29/10/2021] Major update -- a few neat features have been incorporated in the the most recent version of CaNS:

• x-aligned pencils are now used by default, which results in improved speed and scalability. This behavior can be changed using the flags -D_DECOMP_Y/-D_DECOMP_Z for y- or z-aligned pencils;
• support uneven partitioning of the computational subdomains: the total number of grid points along one direction does not have to be divisible by the number of tasks;
• simplified rk.f90 and mom.f90 routines and the option of implicit diffusion (based on SNaC);
• improved the routines for imposing boundary conditions, and the MPI I/O checkpointing (based on SNaC);
• ... and lots of minor improvements and polishing.

The many-GPU version of CaNS can be found here.

Some features are:

• Hybrid MPI/OpenMP parallelization
• FFTW guru interface used for computing multi-dimensional vectors of 1D transforms
• The right type of transformation (Fourier, Cosine, Sine, etc) is automatically determined form the input file
• 2DECOMP&FFT routines used for performing global data transpositions and data I/O
• A different canonical flow can be simulated just by changing the input files

Some examples of flows that this code can solve are:

• periodic or developing channel
• periodic or developing square duct
• tri-periodic domain
• lid-driven cavity

This project aimed first at being a modern alternative to the well-known FISHPACK routines (Paul Swarztrauber & Roland Sweet, NCAR) for solving a three-dimensional Helmholtz equation. After noticing some works simulating canonical flows with iterative solvers -- when faster direct solvers could have been used instead -- it seemed natural to create a versatile tool and make it available. This code can be used as a first base code for which solvers for more complex flows can be developed (e.g. extensions with fictitious domain methods).

The fluid flow is solved with a second-order finite-volume pressure correction scheme, discretized in a MAC grid arrangement. Time is advanced with a three-step low storage Runge-Kutta scheme. Optionally, for increased stability at low Reynolds numbers, at the price of higher computational demand, the diffusion term can be treated implicitly. See the reference above for details.

The input file dns.in sets the physical and computational parameters. In the examples/ folder are examples of input files for several canonical flows. See src/INFO_INPUT.md for a detailed description of the input file.

Files out1d.h90, out2d.h90 and out3d.h90 in src/ set which data are written in 1-, 2- and 3-dimensional output files, respectively. The code should be recompiled after editing out?d.h90 files.

The code should be compiled in src/. The prerequisites are the following:

• MPI
• FFTW3
• OpenMP (optional)
• LAPACK & BLAS (optional)

The Makefile in src/ should be modified in agreement to the installation paths of each library. Also, the following preprocessor options are available:

• -D_DEBUG : performs some basic checks for debugging purposes
• -D_TIMING : wall-clock time per timestep is computed
• -D_IMPDIFF : diffusion term of the N-S equations is integrated in time with an implicit discretization (thereby improving the stability of the numerical algorithm for viscous-dominated flows)
• -D_IMPDIFF_1D : same as above, but with implicit diffusion only along Z; this option needs to be combined with -D_IMPDIFF
• -D_SINGLE_PRECISION : calculation will be carried out in single precision (the default precision is double)

Typing make run will compile the code and copy the executable cans and input file dns.in to a run/ folder.

Run the executable with mpirun with a number of tasks and shared threads complying to what has been set in the input file dns.in. Data will be written by default in a folder named data/, which must be located where the executable is run.

See src/INFO_VISU.md.

I appreciate any feedback that can improve the code. Also, feel free to send case files pertaining to flows not listed in the examples folder.

Please read the ACKNOWLEDGEMENTS and LICENSE files.

Pedro Costa ([email protected])