Edges on Montage and Soykbr workflows are not correct. about wfcommons HOT 5 CLOSED

Hello @cloud-np,

Thank you for reporting this potential issue. We have investigated the scenarios you described and we believe it is related to the following cases:

• Some of the workflow tasks may have additional input data that does not necessarily comes from the parent task (e.g., input_file_for_t3 for task t3 in the image below). In this case, the sum of input files sizes for task t3 will be larger than the sum of output files sizes for task t1.
• In other cases, workflow tasks may have generated output data that are not necessarily used by a child task (e.g., output_file_for_t2 for task t2 in the image below). In this case, the sum of output files sizes for task t2 will be larger than the sum of input files sizes for task t4.

Could you please confirm this is the behavior you have observed?

from wfcommons.

Makes sense, thanks for the example as well made it really clear!
But still, I am not so sure because I try to add up the files that come from each specific parent at the time only.
For example T[1] parent --> T[2] child
T[1] sends 2390 to T[2]
T[2] receives 2709 from T[1]

In the code above I try add the input files that exist in the child with the output files (with the same name ofc) from the parent.
Not sure if I am missing something.

from wfcommons.

@cloud-np, I have investigated it further and could not reproduce your error.

In this example code (issue_23.py.zip), it generates 100 workflows (you can choose between Montage or SoyKB) and test whether the files sizes (from one task output to another task input) match. In case the match fails, the program stops with exit code 1. I ran this program several times and no mismatch was found.

Could you please send me a JSON file from one of the workflows you generated and is causing the issue?
You can write the JSON file using the write_json() method from the workflow object.

from wfcommons.

Hi @cloud-np, do you have any update on this issue? Thank you!

from wfcommons.

I will be closing this issue as the error could not be reproduced. Please, re-open it if you experience the same issues again.

from wfcommons.