Code Monkey home page Code Monkey logo

Comments (4)

mandjevant avatar mandjevant commented on July 17, 2024 1

Thank you for your issue! I have implemented this in #183 and will close this when it gets merged.

from hyperopt-sklearn.

B0Gec avatar B0Gec commented on July 17, 2024

Nice! That was a quick response and nice work with #183.

The above described situation happens also in more general, whenever hpsklearn's value None coincides with some optional value of corresponding scikit function.
E.g. in components._trees_hp_space you have random_state=None but this is also possible value or same argument in sklearn.ensemble.RandomForestRegressor.
Second example is in your new rewrite_for_sklearn1.0.0 branch in function components.ensemble.forest._forest_hp_space the argument max_leaf_nodes=None, since it coincides with the default parameter of Random Forest function in scikit.
So there may be more possible improvements of this kind.

from hyperopt-sklearn.

mandjevant avatar mandjevant commented on July 17, 2024

Fixing the random_state parameter makes much sense in most applications.

  1. It ensures that the splits that are generated are reproducible.
  2. Most importantly, it ensures that the improvements are actual improvements and not improvements by pure chance.
    For a more in-depth explanation on this I would suggest checking out this towardsdatascience article by Ler Wei Han.

I will take a look at the ensemble optimizers and implement your solution in the next few days. Thanks again for raising concern on this.

from hyperopt-sklearn.

mandjevant avatar mandjevant commented on July 17, 2024

Now that it's merged I'll go ahead and close this.
Thank you for raising an issue and feel free to let us know if you find any bugs or other issues.

from hyperopt-sklearn.

Related Issues (20)

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. 📊📈🎉

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google ❤️ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.