Repairs are no longer being found as the size of a dataset is increased about holoclean HOT 7 CLOSED

Hi, I would recommend using the HC version in Dev as we have fixed many issues there. Can you please let us if the error persists with the dev version? If so we would be happy to investigate.

from holoclean.

Hello,

I have just tried it in the latest dev version, but the issue persists. Values are repaired in the 20-tuple dataset, but the same values no longer change as a larger portion of the data is considered (and the new errors in the larger datasets are not repaired either).

from holoclean.

Hi @j-r77 I am currently working on reproducing and debugging this issue and will get back to you.

from holoclean.

Hi @minafarid Just wondering whether you managed to reproduce and debug the issue already? Thanks.

from holoclean.

Hi @fgeerts we are actively working on this issue. It is a bit more intricate than what it seems. This issue comes up because the only attributes that are strongly correlated in the Adult dataset are "relationship" and "sex", i.e., the ones present in your constraints (see attached image).

We are actively working on this issue and we will be getting back to you ASAP.

from holoclean.

Hi @j-r77:

We did some digging around and it seems that the issue lies in the use of InitAttFeaturizer. Because of how we currently do weak supervision, our InitAttFeaturizer feature weights actually blows up and will assign to much emphasis on the initial values which causes no repairs to occur.

If you pass in the keyword argument learnable=False, you should be able to see better results. We've recently tweaked how we do weak supervision in #43 such that InitAttFeaturizer behaves as intended.

That being said with this specific dataset as @thodrek pointed out, since there are so few correlated attributes weak supervision fails to assign confident weak labels and results in the prior behaviour.

In this case Holoclean actually prefers not to repair any cell as demonstrated because it is unconfident that any repairs are correct due to the lack of correlations.

Hope that helps.

from holoclean.

from holoclean.