Comments (11)
@danbarto I suspect you'll need to involve your T2 support. @khurtado may also have suggestions.
If you want to make the issue easier to debug, you can uncomment out line 1105 of bin/internal/cluster.py
open('submit_condor','w').write(text % dico)
so that the condor submit file is actually stored. I think it gets stored in the SubProcesses folders, but you might also want to make it an explicit path. You can then run
condor_submit submit_condor
on this file, which should fail in the same way, but will at least be more useful for the T2 support to help debug. One thing you might try is adding the line
GetEnv 1
to the submit file, as my first impression is that there could be an environment issue.
By the way, can you confirm that the older scripts that you were using before at UCSD are still working? I don't understand why this issue would show up now but not previously.
from genproductions.
Thanks for the reply. I did manually run the condor job as you suggested, and the logs are here:
http://cmsdoc.cern.ch/~dspitzba/logs/condor.out
http://cmsdoc.cern.ch/~dspitzba/logs/condor.err
http://cmsdoc.cern.ch/~dspitzba/logs/condor.log
Condor.out shows the same error about loading the shared gfortran library.
getenv=True
was already set in the condor submit file (http://cmsdoc.cern.ch/~dspitzba/logs/submit_condor in case you are interested).
About the older scripts I have to point to @vdutta since I only have started using the UCSD T2.
from genproductions.
Does it work for you locally?
from genproductions.
@kdlong regarding the older scripts, they do still work but with an older version of genproductions and with a patch we used to apply specific to UCSD:
https://github.com/CMS-SUS-XPAG/GenLHEfiles/blob/master/GridpackWorkflow/test/scripts/ucsd.patch
from genproductions.
Yes, the gridpack creation runs locally without any problems
from genproductions.
@vdutta @danbarto, can you modify the old patch to be applied on top of the current branch and see if that fixes your issue? Things have been moved around a decent bit, but most of the changes that were made apply to the job management, so adjusting the submit file to be more UCSD specific should be no problem at all.
By the way, we have no problem at all with this type of customization and can even make it more centrally supported if that helps. For now, you should be able to just add the (updated) patch into the patches folder, just make sure it doesn't conflict with anything else. What we don't want is a fully independent repository that can conflict with the central one.
from genproductions.
Coming back to this: I think the work being done by @AndreasAlbert @pmandrik could be extended to cover such instances of customization. For example, we could add an option condor config customization file that gets read and appended to the submit config used internal in MadGraph. I would be interested in being able to add simple options to the submit for Wisconsin. How about at UCSD, would you be willing to help look into this?
from genproductions.
I'm referencing the cluster module changes made in #1662 by the way.
from genproductions.
We are currently working on resolving the gfortran issue at UCSD. As soon as this is done I can have a look, however, I'm not a condor expert so it might take some time.
from genproductions.
I finally resolved the issue by creating an additional patch:
https://github.com/danbarto/genproductions/blob/master/bin/MadGraph5_aMCatNLO/patches/0021-fix-libraries-T2-UCSD.patch
There's in fact no need to change the condor configuration for UCSD, but there's just a problem with LD_LIBRARY_PATH not being set.
Should I open a PR with this patch, or should it be modified?
from genproductions.
Hi, sorry I overlooked this. I think it would be best to keep such patches custom. However, note that we have added some support for custom patches starting in 2.6.0.
You could add this file to your cards directory and upload it to genproductions when you add your usual card, then it will be clear that the samples were produced with this modification, which is good for bookkeeping.
from genproductions.
Related Issues (20)
- Large gridpack fails with non zero status 137 HOT 2
- GridPack Generation fail on CMSConnect HOT 4
- MadGraph patch for 29x : color flow HOT 4
- Filter efficiency from fragments should be dropped once and for all HOT 8
- MadGraph tarballs on cvmfs HOT 4
- CPX Tune Import Path for Run3 fragments HOT 1
- adding MG version 3.5 HOT 25
- Track CMS changes to MG5 source via git repository instead of patch files HOT 5
- Compilation issue when generating the diphotonJets gridpack HOT 8
- cleaning up the unneeded files in madgraph HOT 6
- Update for `request_fragment_check.py` script
- SLHA Issue for the latest `request_fragment_check.py` file HOT 6
- Collided path due to case-sensitivity
- merge.pl decoupled from MG5 HOT 1
- Issue in generating gridpack using Phantom Generator HOT 2
- 3 questions with regards to a new PR(#3629) HOT 1
- reweighting samples with madspin HOT 9
- Validation of pLHE should check the total number of events
- Move user-specific patching after extramodel download, or vice versa, in MadGraph gridpack generation HOT 2
- Issue in checking tauola when madraph + pythia HOT 3
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from genproductions.