Comments (6)
lmorabit
commented on September 17, 2024
Hi Vijay -- okay, this is helpful. Do the *.msdpppconcat frequencies match pre-facet-target?
from lofar-vlbi.
vmahat
commented on September 17, 2024
Hmm, seems not entirely. The number of files matches (22), but there is inconsistency of central frequency between 130 MHz and 138 MHz as above
Pre-Facet-Target:
L541949_SB000_uv_128830FFAt_127MHz.msdpppconcat
L541949_SB000_uv_128830FFAt_127MHz.msdpppconcat.h5
L541949_SB000_uv_128830FFAt_129MHz.msdpppconcat
L541949_SB000_uv_128830FFAt_129MHz.msdpppconcat.h5
L541949_SB000_uv_128830FFAt_131MHz.msdpppconcat
L541949_SB000_uv_128830FFAt_131MHz.msdpppconcat.h5
L541949_SB000_uv_128830FFAt_133MHz.msdpppconcat
L541949_SB000_uv_128830FFAt_133MHz.msdpppconcat.h5
L541949_SB000_uv_128830FFAt_135MHz.msdpppconcat
L541949_SB000_uv_128830FFAt_135MHz.msdpppconcat.h5
L541949_SB000_uv_128830FFAt_137MHz.msdpppconcat
L541949_SB000_uv_128830FFAt_137MHz.msdpppconcat.h5
L541949_SB000_uv_128830FFAt_138MHz.msdpppconcat
L541949_SB000_uv_128830FFAt_138MHz.msdpppconcat.h5
L541949_SB000_uv_128830FFAt_140MHz.msdpppconcat
L541949_SB000_uv_128830FFAt_140MHz.msdpppconcat.h5
L541949_SB000_uv_128830FFAt_142MHz.msdpppconcat
L541949_SB000_uv_128830FFAt_142MHz.msdpppconcat.h5
L541949_SB000_uv_128830FFAt_144MHz.msdpppconcat
L541949_SB000_uv_128830FFAt_144MHz.msdpppconcat.h5
L541949_SB000_uv_128830FFAt_146MHz.msdpppconcat
L541949_SB000_uv_128830FFAt_146MHz.msdpppconcat.h5
L541949_SB000_uv_128830FFAt_148MHz.msdpppconcat
L541949_SB000_uv_128830FFAt_148MHz.msdpppconcat.h5
L541949_SB000_uv_128830FFAt_150MHz.msdpppconcat
L541949_SB000_uv_128830FFAt_150MHz.msdpppconcat.h5
L541949_SB000_uv_128830FFAt_152MHz.msdpppconcat
L541949_SB000_uv_128830FFAt_152MHz.msdpppconcat.h5
L541949_SB000_uv_128830FFAt_154MHz.msdpppconcat
L541949_SB000_uv_128830FFAt_154MHz.msdpppconcat.h5
L541949_SB000_uv_128830FFAt_156MHz.msdpppconcat
L541949_SB000_uv_128830FFAt_156MHz.msdpppconcat.h5
L541949_SB000_uv_128830FFAt_158MHz.msdpppconcat
L541949_SB000_uv_128830FFAt_158MHz.msdpppconcat.h5
L541949_SB000_uv_128830FFAt_160MHz.msdpppconcat
L541949_SB000_uv_128830FFAt_160MHz.msdpppconcat.h5
L541949_SB000_uv_128830FFAt_162MHz.msdpppconcat
L541949_SB000_uv_128830FFAt_162MHz.msdpppconcat.h5
L541949_SB000_uv_128830FFAt_164MHz.msdpppconcat
L541949_SB000_uv_128830FFAt_164MHz.msdpppconcat.h5
L541949_SB000_uv_128830FFAt_166MHz.msdpppconcat
L541949_SB000_uv_128830FFAt_166MHz.msdpppconcat.h5
L541949_SB000_uv_128830FFAt_168MHz.ms_concat_target_0
L541949_SB000_uv_128830FFAt_168MHz.ms_concat_target_0_CONCAT
L541949_SB000_uv_128830FFAt_168MHz.msdpppconcat
L541949_SB000_uv_128830FFAt_168MHz.msdpppconcat.h5
L541949_SB000_uv_128830FFAt_168MHz.msdpppconcat.h5imp_gsmcal
from lofar-vlbi.
tikk3r
commented on September 17, 2024
There is also an inconsistent central frequency between 4 *msdpppconcat and *.pre-cal_ddf.h5 files (between 130 MHz and 138 MHz), see below.
Theses msdpppconcat you are talking about come from the concatenate in Delay-Calibration right? This inconsistency might be due to a difference in reference SB that was used for the concatenate there and in prefactor. Are they the same between your prefactor and lofar-vlbi runs? Delay-Calibration.parset uses a hardcoded value:
lofar-vlbi/Delay-Calibration.parset
Lines 62 to 63 in 8478a28
While prefactor's default is set to None:
## concatenating the target data
! num_SBs_per_group = 10 ## make concatenated measurement-sets with that many subbands, choose a high number if running LBA
! reference_stationSB = None ## station-subband number to use as reference for grouping, "None" -> use lowest frequency input data as reference
You could to try setting reference_stationSB = None in your Delay-Calbration parset or rerunning prefactor/LINC with the same reference SB. The former is probably easiest, as the latter would also require rerunning ddf-pipeline.
from lofar-vlbi.
vmahat
commented on September 17, 2024
Okay, I will re-run Delay-Calibration (since it's quicker) -- we'll see what happens by Monday. Though, if this inconsistency between parsets was the cause then I'm surprised this hasn't happened before
from lofar-vlbi.
vmahat
commented on September 17, 2024
The Delay-Calibration has now finished without errors -- thanks Frits. I'll close the ticket, but perhaps we ought to change this in the Delay-Calibration parset.
from lofar-vlbi.
lmorabit
commented on September 17, 2024
Reopening this issue because the behaviour between pre-facet-target and delay-calibration should be the same. We had to set this because there were issues of inconsistent concatenation if it wasn't set, so this needs further investigation on how to ensure it's always the same.
from lofar-vlbi.
Related Issues (20)
- Gaps between subbands and concatenation HOT 17
- No output in log from download_cats step HOT 4
- Failures in selfcal in the natural-weighting part of the difmap loop HOT 5
- Channel range limitations in difmap HOT 2
- h5imp_ddf wrong output h5parm HOT 10
- addIS_to_h5parm should add 0 amplitude for XY and YX instead of 1
- Avoid from ... import * HOT 2
- No delay calibrator image produced HOT 3
- circular to linear conversion is missing HOT 3
- Plot positions of LBCS sources, image catalogue and potential target HOT 1
- DDECal initialized with 0 directions: something is wrong with your parset or your sourcedb HOT 12
- aoflagger doesn not open a file due to too many open files HOT 2
- std exception detected: Frequency 187211608.886719 not found in target/TGSSphase HOT 7
- Pipeline finished with ERRORS/WARNINGS HOT 3
- ERROR main() takes no arguments (8 given) HOT 6
- ERROR main() got an unexpected keyword argument 'helperscriptspath-h5merge' HOT 2
- SyntaxError: invalid syntax HOT 29
- Issue: couple of typos and import errors in scripts HOT 4
- A couple of fixes: add quote and revised argument name HOT 3
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from lofar-vlbi.