Comments (8)
ulrikeyang
commented on August 12, 2024
It looks like you are using special settings. That particular interpolation isn’t tested very well. Do you also use truncation with it? Specifically Pmaxelmts?
…Sent from my iPhone
On Sep 9, 2019, at 6:18 PM, Bobby Philip <[email protected]<mailto:[email protected]>> wrote:
Hi:
I'm getting an error in the BoomerAMGSetup. At present I can reproduce this on 5760 MPI processes and more and only sporadically at lower number of ranks. It looks like a comm_handle is not being consistently destroyed by all ranks. Below is the information I could extract from the DDT stack trace. A majority of ranks are destroying a comm_handle in hypre_ParCSRMatrixExtractBExt_Overlap while a couple seem to have exited the routine and are trying to destroy a different handle. I recognize this is not much to go on but would appreciate any ideas you have to debug this. I have a dedicated chunk of time tomorrow (09/10) on one of the machines so I could try out any suggestions you have. Otherwise the usual turnaround time is much slower. Interestingly, the error being reported to the command line is a oom-kill event.
From DDT the stack trace I am getting is:
Majority of MPI Ranks:
hypre_BoomerAMGSetup(par_amg_setup.c:1715)
hypre_BoomerAMGBuildExtPICCInterp(par_lr_interp.c:1982)
hypre_exchange_interp_data(aux_interp.c:601)
hypre_ParCSRMatrixExtractBExt_Overlap(par_csr_matop.c:1464)
hypre_ParCSRCommHandleDestroy(par_csr_communication.c:537)
hypre_exchange_interp_data(aux_interp.c:601)
hypre_ParCSRCommHandleDestroy(par_csr_communication.c:537)
Couple of MPI Ranks:
hypre_BoomerAMGSetup(par_amg_setup.c:1715)
hypre_BoomerAMGBuildExtPICCInterp(par_lr_interp.c:1982)
hypre_exchange_interp_data(aux_interp.c:607)
hypre_ParCSRCommHandleDestroy(par_csr_communication.c:537)
—
You are receiving this because you are subscribed to this thread.
Reply to this email directly, view it on GitHub<#44?email_source=notifications&email_token=AD4NLLP3EQHWP6IAPD4OE63QI3YVPA5CNFSM4IVBXNC2YY3PNVWWK3TUL52HS4DFUVEXG43VMWVGG33NNVSW45C7NFSM4HKKEZ3A>, or mute the thread<https://github.com/notifications/unsubscribe-auth/AD4NLLPTDUQS3M5P7UIYDH3QI3YVPANCNFSM4IVBXNCQ>.
from hypre.
bobby-philip
commented on August 12, 2024
I have a nonsymmetric system and empirically tried a bunch of different configurations to see which one would converge best. What I have is:
call HYPRE_BoomerAMGSetStrongThrshld (amg_solver, 0.25_REAL64, error_status)
call HYPRE_BoomerAMGSetCycleRelaxType (amg_solver, 8_SINT, 1_INT64, error_status)
call HYPRE_BoomerAMGSetCycleRelaxType (amg_solver, 8_SINT, 2_INT64, error_status)
call HYPRE_BoomerAMGSetCycleRelaxType (amg_solver, 9_SINT, 3_INT64, error_status)
call HYPRE_BoomerAMGSetCoarsenType (amg_solver, 10_INT64)
call HYPRE_BoomerAMGSetMaxCoarseSize (amg_solver, 16_INT64, error_status)
call HYPRE_BoomerAMGSetInterpType (amg_solver, 7_INT64, error_status)
call HYPRE_BoomerAMGSetPMaxElmts (amg_solver, 0_INT64, error_status)
call HYPRE_BoomerAMGSetMaxRowSum(amg_solver, 0.7_REAL64, error_status)
from hypre.
bobby-philip
commented on August 12, 2024
If this set of parameters is problematic, it would be great if you could suggest an alternative set of parameters for nonsymmetric systems that would not incur a high setup cost as I am using BoomerAMG as a preconditioner.
from hypre.
bensworth
commented on August 12, 2024
@bobby-philip what kind of problem are you solving? We recently added a nonsymmetric AMG routine to hypre called AIR that works well on some nonsymmetric problems, primarily designed for transport applications. The setup cost is not particularly low right now, but convergence is quite good on some problems. There is not an example yet, but I am happy to help get you setup w/ the parameters.
from hypre.
bobby-philip
commented on August 12, 2024
Hi, I had actually sent Ruipeng a matrix where AIR does not perform well - convergence is bad. Would be wonderful if you could look at it. At present I have the AIR options turned off in the application I am working with but it would be easy to turn them back on and modify according to your suggestions. I did read the papers you and Tom and written. It was nice :-)
from hypre.
bensworth
commented on August 12, 2024
Happy to look at it, send me an email at ben (dot) southworth (at) colorado.edu!
from hypre.
bobby-philip
commented on August 12, 2024
I've sent you an email with an example matrix
from hypre.
rfalgout
commented on August 12, 2024
Has this issue been resolved? Thanks! -Rob
from hypre.
Related Issues (20)
- changed default settings from 2.0.0 to 2.30.0 HOT 3
- Bad convergence using BoomerAMG for system of equations and InterpType doesn't work HOT 2
- New hypre release 2.31.0 HOT 6
- ParCSRAAt for nonsquare matrices HOT 1
- INSTALL.md: add Macports option for macOS
- Broken link in docs
- Requesting information on cmake for applications
- Improve GPU-aware MPI option
- When using AMS_PCG to solve multiple right-hand sides iteratively, I've noticed a continuous increase in memory usage.
- Could NOT find HYPRE (missing: HYPRE_LIBRARIES HYPRE_INCLUDE_DIRS)
- Floating point exception inf pcg.c HOT 1
- Can we find a minimal self-contained gpu example of using hypre ij interface nad its related solver?
- Best configuration to BoomerAMG on CPUs
- ij.c fails when compiling with cuda 12.2
- Missing MPI C++ bindings when using FEI
- Question: Externally owned data in hypre_CSRMatrix
- Potentially incorrect `hypre_assert` HOT 3
- Matrices with zero diagonal entries in `hypre_ParCSRTMatMatKTDevice` HOT 1
- CMake build with HIP/ROCM HOT 1
- Recommended CUDA/clang on LC machines
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from hypre.