Code Monkey home page Code Monkey logo

domain-adaptation-toolbox's Introduction

domain-adaptation-toolbox

Wrappers and implementions of several domain adaptation / transfer learning / semi-supervised learning algorithms, in matlab.

Please find sample usages in showSimExp.m. The SSA algorithm needs a dependency (http://mloss.org/revision/download/851/) which is not included in this toolbox.

![discrete domains](synthetic dataset discrete.jpg)

![continuous distribution change](synthetic dataset continuous.jpg)

The domain adaptation algorithms include:

  • Transfer Component Analysis (TCA)
  • Maximum Independence Domain Adaptation (MIDA)
  • Subspace Alignment (SA)
  • Information-Theoretical Learning (ITL)
  • Geodesic flow kernel (GFK)
  • Stationary Subspace Analysis (SSA)

For comparison, we also included three semi-supervised (transductive) learning algorithms, which can be used as baselines to other domain adaptation methods:

  • Laplacian SVM (LapSVM)
  • Laplacian ridge regression (LapRR)
  • Transducive SVM (TSVM)

The PCA and kernel PCA algorithm can also be a baseline method. So, there are 10 algorithms in this toolbox. Among them, TCA, MIDA, SA, (kernel) PCA, and LapRR are self-implemented. ITL, GFK, SSA, LapSVM, and TSVM are wrappers of existing toolboxes. These toolboxes are included in the project, except SSA, which is too big and can be downloaded from the link provided below. The interfaces of the functions have been unified for convenience. We hope the work can be helpful for domain adaptation / transfer learning researchers.

Dependencies:

  1. ITL: I downloaded it from somewhere I can't find it now.
  2. GFK: http://www-scf.usc.edu/~boqinggo/
  3. GFK: plslda, http://www.mathworks.com/matlabcentral/fileexchange/47767-libpls-1-95-zip/
  4. SSA: http://mloss.org/revision/download/851/
  5. LapSVM: https://github.com/tknandu/LapTwinSVM/tree/master/Primal_LapSVM/lapsvmp_v02
  6. TSVM: http://svmlight.joachims.org/ and https://github.com/sods/svml

References:

  1. TCA: S. J. Pan, I. W. Tsang, J. T. Kwok, and Q. Yang, "Domain adaptation via transfer component analysis," Neural Networks, IEEE Trans, 2011
  2. MIDA: Ke Yan, Lu Kou, and David Zhang, "Domain Adaptation via Maximum Independence of Domain Features," http://arxiv.org/abs/1603.04535
  3. SA: B. Fernando, A. Habrard, M. Sebban, and T. Tuytelaars, "Unsupervised visual domain adaptation using subspace alignment," in ICCV, 2013
  4. ITL: Y. Shi and F. Sha, "Information-theoretical learning of discriminative clusters for unsupervised domain adaptation," in ICML, 2012
  5. GFK: B. Gong, Y. Shi, F. Sha, and K. Grauman, "Geodesic flow kernel for unsupervised domain adaptation," in CVPR, 2012
  6. SSA: P. Von Bunau, et al, "Finding stationary subspaces in multivariate time series," Physical review letters, 2009
  7. LapSVM and LapRR: M. Belkin, P. Niyogi, and V. Sindhwani, "Manifold regularization: A geometric framework for learning from labeled and unlabeled examples," J. Mach. Learn. Res., 2006.
  8. TSVM: T. Joachims, "Transductive inference for text classification using support vector machines," 1999

domain-adaptation-toolbox's People

Contributors

viggin avatar

Stargazers

 avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar

Watchers

 avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar

domain-adaptation-toolbox's Issues

question about line 27th~29th in domain-adaptation-toolbox/infometric_0.1/compute_mutual_infoL.m

Hi, I have a question about the code in line 27th~29th in domain-adaptation-toolbox/infometric_0.1/compute_mutual_infoL.m, that is,

line 27: P = expD ./ repmat( sum(expD), Ns, 1);
line 29: P = P - diag( diag(P) ).

In fact, these two lines of code are inconsistent with equation 2 in the paper "Information-Theoretical Learning of Discriminative Clusters for Unsupervised Domain Adaptation".
When normalizing the exponential distance matrix (expD), the contribution of the element to the denominator when the row index (i) is equal to the column index (j) should not be taken into account.

I sincerely hope you can spend some time to answer my doubts. Thanks.

question about line 23th~26th in domain-adaptation-toolbox/ToRelease_GFK/GFK.m

Hi, I have a question about the code in line 23th~26th in domain-adaptation-toolbox/ToRelease_GFK/GFK.m, that is,

B1 = 0.5.diag(1+sin(2theta)./2./max(theta,eps));
B2 = 0.5.diag((-1+cos(2theta))./2./max(theta,eps));
B3 = B2;
B4 = 0.5.diag(1-sin(2theta)./2./max(theta,eps));

I checked the corresponding formula (Eq. 6) in the article "Geodesic Flow Kernel for Unsupervised Domain Adaptation" and found that there was no factor 0.5 in the formula.

I sincerely hope you can spend some time to answer my doubts. Thanks.

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    ๐Ÿ–– Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. ๐Ÿ“Š๐Ÿ“ˆ๐ŸŽ‰

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google โค๏ธ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.