Comments (4)
It's only supported for multiclass classification and multitask classification / regression. The groups are the weights of a feature in all classes / tasks. This question comes up all the time. We need to improve the documentation.
from lightning.
May i know this problem have been solved ? It is not clear to distinguish the group which have the same group penalty.In another word,in lamda*sum(sqrt(p))||beta||_2^2 , in CDClassifier which paremeter is defined each group size p.thanks
from lightning.
@zht012323 there hasn't been any progress on this
from lightning.
Would defining a custom penalty and using FISTA partially "solve" this problem by basically rolling our own custom penalty?
Not sure if my "group penalty" actually makes sense in this context, but suppose we have two groups of coefficients off a dataset with 40 coefficients. One group being the first 20 indices, and the 2nd group being the second 20 indices.
Would one way to do Group Lasso be to define the penalty as:
class L1Penalty1(object):
def __init__(self, group=[]):
self.group = group
def projection(self, coef, alpha, L):
#np.sign(coef) * np.maximum(np.abs(coef) - alpha / L, 0)
coef_group = coef.flatten().copy()
for gp in self.group:
gp_ = np.sum(np.abs(coef_group[gp]))
coef_group[gp] = gp_
coef_group = (coef_group/np.sum(coef_group)) * coef_group.shape[0]
coef_group = coef_group.reshape(1, -1)
#print(coef_group)
#print(np.sum(coef_group))
#print("---\n")
reg_ = np.sum(np.abs(coef))
projl1_ = np.sign(coef) * np.maximum(np.abs(coef) - alpha / L, 0) * coef_group
return projl1_* (reg_/np.sum(np.abs(projl1_)))
def regularization(self, coef):
return np.sum(np.abs(coef))
Would this work?
from lightning.
Related Issues (20)
- Unsafe screening with CDClassifier? HOT 1
- Forgotten intercept in SGDRegressor HOT 2
- ModuleNotFoundError: No module named 'sklearn.externals.six' HOT 4
- How to pip sklearn-contrib-lightning HOT 2
- 2d errors when passing pandas DataFrame/Series
- Nonnegative penalties actually allowed in CDRegressors HOT 3
- FistaRegressor does not converge for real data HOT 3
- build pb on python 3.9 HOT 1
- Change assert imports HOT 2
- do you have Quantile Regression for spars data after one hot transformation
- do you have Regression for spars categorical big data after one hot transformation
- do you have support vector regression with soft margin and confidence interval ?
- do you have implementation for regression with confidence intervals ?
- Does lightning natively support multi-label HOT 1
- DOC: sometimes the Lasso solution is the same as sklearn, sometimes not HOT 5
- install help
- ENH - Add support of intercept in ``SDCARegressor`` HOT 1
- Why not initialize SAG/SAGA memory with 0 and divide by seen indices so far as in sklearn?
- Missing Support for class-weights specifications to tacke Disproportionate Number of Samples between dependent variable classes
- CDClassifier : error for penalty="l1" and penalty="l2", but no error for penalty="l1/l2" HOT 5
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from lightning.