Comments (4)
Insert and remove record is very important in my application, I need to dynamic update LSH table, I use python interface, Do you have the plan to support it? @ludwigschmidt
from falconn.
Hi hxwu,
updates are supported in some of the core classes, in particular the DynamicLinearProbingHashTable and the DynamicCompositeHashTable:
https://github.com/ludwigschmidt/fth_lsh/blob/master/lsh_table/src/probing_hash_table.h
https://github.com/ludwigschmidt/fth_lsh/blob/master/lsh_table/src/composite_hash_table.h
What we need next is a dynamic version of the StaticLSHTable in
https://github.com/FALCONN-LIB/FALCONN/blob/master/src/include/falconn/core/lsh_table.h
We should be able to re-use quite a bit of code here. The main difference is that the static LSH table always assumes that the key range is between 0 and data_set_size - 1. This allows us to simply keep a large array for checking whether a certain candidate already appears in the answer for the current query. If the key range is arbitrary, we need a less specialized set data structure here (a hash table would probably be the right thing). Overall it should not be a big performance issue, but it's good to get it right.
The code is organized so that the query objects in the LSHTable are only responsible for producing a list of candidates. The actual distances are then computed in the NearestNeighborQuery class:
https://github.com/ludwigschmidt/fth_lsh/blob/master/lsh_table/src/nn_query.h
Two questions about your application:
- Are you planning to use the C++ or Python interface?
- How is your dynamic point set stored? Would it make sense to always have the point indices in a small range (say 0 to some_constant * largest_point_set_size)?
Cheers,
Ludwig
from falconn.
Excuse me, could you please show me how to add a dynamic LSH table?
from falconn.
I just want to insert or remove some record from the established LSH table
from falconn.
Related Issues (20)
- How to return more points? HOT 2
- windows install falconn failure HOT 1
- Comment. Application to associative memory
- How to save the hash table? HOT 1
- Calculating similarity
- website certificate expired HOT 1
- The similarity Values
- Not returning specified number of neighbors
- Better explanation regarding windows
- something error in params.feature_hashing_dimension parameters HOT 1
- Unable to install python through repository
- The header-only library seems broken HOT 1
- Distance returned is more than 1 and it's also negated when using EuclideanSquared on normalized vectors
- Package is not be able to install inside python docker image
- Detailed steps for running code
- Why can get two vectors' similarity after random projection? HOT 1
- Compile error: error: unknown register name ‘%ymm14’ in ‘asm’
- How to get similar candidate?
- FALCONN KNN alternative to save as pickle? HOT 1
- The website does not load
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from falconn.