Unable to reproduce the report's distribution metrics using SUPPORT about synthvae HOT 1 OPEN

Hi Joe, as part of our work using SynthVAE in the synthetic data pipeline we found similar issues in terms of reproducability. We found that any metrics that use sklearn components are not reproducible and cannot be made so without changing the sdv code.

The reason for this is that setting the numpy random seed doesn't have the scope to set the sklearn random_state when it's imported from another file. As a result any metrics that use a sklearn component with a random_state argument will not be reproducible.

Metrics such as GMLogLikelihood, detection metrics e.g. logistic regression, standard vector machine all use sklearn so will be affected by this.

Although no fix is available at the moment, I wanted to add the above to give more info around the likely cause of this.

from synthvae.