Occasional corruption of index about dione HOT 5 OPEN

@eyala - any update here?

from dione.

I can verify that this fix works for the sample data I have. I have given a snapshot version for the PayPal team with this bug, and if it works for them, too, we can make the sync interval a param and include it in all three of our Spark flavors.

from dione.

Just a small note on that - the sync interval of the b-tree file is an internal implementation detail.. If it is exposed externally, it should be clear that this is just a workaround, and not some meaningful user-facing configuration that the user needs to consider.

from dione.

@eyala - can we close this issue?

from dione.

Hi @shay1bz @eyala

Thank you for the support and taking this up.
We have conducted thorough manual testing of various scenarios and it appears that the issue has been successfully fixed.
However, I would like to highlight that the fix has not yet been rolled out to the production environment. And will inform here once the production rollout happens and it becomes stable.

Thanks
Abhishek Jain

from dione.