Comments (3)
Right now I'm sticking with random init. But will look into other places as well.
from raft.
@trivialfis, yeah that should work for now. Unfortunately, since it's too late to scrape through this and figure out the cause in time for 0.19, we should try to figure out what's going on here at some point because the spectral init has been shown to preserve more global structure than random init.
I found this bug by placing debug outputs in the spectral init for umap in cuml and found that executing it twice with the same random seed yielded different results. It could be as simple as a seed being overlooked somewhere, though I believe this was working before CTK 11.2 which makes me think something (or an assumption) has since broken, perhaps from one of the dependent libraries.
from raft.
Strangely, while reviewing rapidsai/cuml#3848 I no longer seem to be able to reproduce this issue using the spectral initialization, even w/ cuml's branch-0.20
. I'm going to close this for now and reopen if I see the behavior again.
from raft.
Related Issues (20)
- [BENCH] Don't overwrite / zero-out build metrics on restart HOT 1
- [FEA] cagra.search uint16
- [FEA] Rust API wrapper
- [QST] Graph Construction time using CAGRA HOT 2
- [QST] How can we convert GAGRA graph to the general graph format, like NSG/SSG/NSSG into a .nsg/.ssg file?
- [FEA] `raft-ann-bench.run` to support a dry-run feature
- [FEA] Pre-filtered brute-force KNN
- [FEA] CAGRA constructor accept strided matrix input
- [FEA] nn-descent Python API HOT 1
- [FEA] Radix topk remove or improve chunking HOT 1
- [ENH] Re-apply the matrix::select_k heuristics HOT 1
- [QST] How can we use cagra search with both ranked based optimization and distance-based optimization? HOT 1
- [FEA] Expose Sparse raft functions in pylibraft
- [FEA] Wrap `epsilon_neighbors` through pylibraft
- [DOC] How to used AIR Topk? HOT 1
- [FEA] Add power consumption metrics to `raft-ann-bench`
- [BUG] IVFPQ Benchmarks crash with >=8 threads on Ampere and above
- [FEA] Add runtime test for serialization format changes HOT 1
- [FEA] Remove pre-filtering template args
- [BUG] ptxas error : Value of threads per SM for entry is out of the range.
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from raft.