Normalization of data about causalnex HOT 1 CLOSED

Hello Giovani,

Thanks for the question, its a quite interesting point.

The original paper doesn't say much. However, you can interpret the Frobenius norm as a multivariate normal distribution with equal variance. So in theory, normalisation to unit-variance as in StandardScaler makes sense.

The problem is that the weights are penalised by absolute size through the Lasso regularisation and the DAG constraint. Hence, normalising to unit-variance converts the "unit" of the weights to "standard deviation" differences, if X -> Y, a 1 SD change in X causes a W SD change in Y, which in theory should mitigate this problem.

However, and similar to your observation, on generated data we see that this can reduce the accuracy of learning the "true" model, i.e. we learn a different structure. I don't really have a good explanation though. Removing the mean certainty helps but with regard to the variance, it's an open question.

What do you think?

Philip

from causalnex.