Comments (5)
I'm playing right now with tf-ranking in order to compare its performance with that of state-of-the-art ensemble-based models.
That said, how do you think RankEval can support a neural network model given it is based on ensemble of regression trees? The simplest way to "integrate" it would be to extend the tf model with a score method with the same signature of the score method in the RTEnsemble class in such a way the analysis methods can be used without incurring in errors. Obviously, it means we will have a dependency with tf and tf-ranking for such models.
If you have any other suggestion, please let me know.
from rankeval.
Another option could be to fork the RTEnsemble
class, creating a NNModel
, with a common Model
base class. All the utility methods (the one of course for which it makes sense to accept different models, e.g., not the topological analysis) will accept a base Model
instance, and the signatures of the methods belonging to the two classes should be identical. This way everything will be transparent to the user, but still we need the dependency with tf and tf-ranking.
This is probably a cleaner solution, but with more code to change.
from rankeval.
I like the common base class approach.
The dependency does not have to be a hard one, the import could happen on demand.
from rankeval.
Let's start thus implementing this solution. I'm not sure about the timing of the implementation, I'm busy till next week then could start working on it.
from rankeval.
Update: I'm quite overwhelmed by the work this week and the next one. The implementation will not start before the middle of February...
from rankeval.
Related Issues (19)
- Input proxy for Jforest. HOT 3
- turn coremltools dependency into a soft dependency? HOT 5
- XGBoost loader fails when the training prunes out some nodes HOT 1
- support for build with Xcode? HOT 3
- 'XGBRanker' object has no attribute 'score' HOT 7
- support Python 3 HOT 13
- KeyError: 'None of [...] are in the [index]' HOT 4
- No version file /site-packages/rankeval/../VERSION' HOT 6
- give example of loading dataset and models without using using dataset_container / load_dataset() HOT 1
- supporting (gzip) compressed svmlight formatted files? HOT 5
- feature importance should be normalised. HOT 2
- support for categorical features and missing values in LGBM HOT 4
- feature_importance error HOT 5
- validation and test dataset are not used in feature analysis notebook HOT 1
- dataset documentation does not match behavior HOT 2
- inaccurate description/reasoning in LIght HOT 1
- Problem with VERSION file HOT 6
- dataset.clear_X(): What is it used for? HOT 1
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from rankeval.