Comments (3)
masajiro
commented on June 6, 2024
Hello,
I don't think that NGT can be replaced by QG/QBG because they have different pros and cons. But in any case, I am going to implement python functions to build QG/QBG indices in the future. I can't say for sure when.
from ngt.
siddhsql
commented on June 6, 2024
Hi Masajiro,
re: I don't think that NGT can be replaced by QG/QBG because they have
different pros and cons.
the README file says: The command-line interface ngtq and ngtqg are now
obsolete by replacing qbg
<https://github.com/yahoojapan/NGT/blob/main/bin/qbg/README.md>. (v2.0.0)
also the README says: QBG
<https://github.com/yahoojapan/NGT/blob/main/bin/qbg/README.md> can handle
billions of objects
does it mean it handles cases when the entire dataset does not fit in
memory?
and README says (for QBG):
- Supported distance functions: L2
does it mean QBG does not support cosine distance measure?
…On Thu, Jul 6, 2023 at 6:30 PM Masajiro Iwasaki ***@***.***> wrote:
Hello,
I don't think that NGT can be replaced by QG/QBG because they have
different pros and cons. But in any case, I am going to implement python
functions to build QG/QBG indices in the future. I can't say for sure when.
—
Reply to this email directly, view it on GitHub
<#142 (comment)>,
or unsubscribe
<https://github.com/notifications/unsubscribe-auth/A6NWEK424L2W37WXFHODSPDXO5RCJANCNFSM6AAAAAA2AX3IKE>
.
You are receiving this because you authored the thread.Message ID:
***@***.***>
from ngt.
masajiro
commented on June 6, 2024
To be sure, in my last comment, NGT means not NGTQ nor neither NGTQG but the basic graph-based index.
QBG places the quantized dataset instead of the entire dataset in memory and supports only L2. However, I am going to add an option to place the entire dataset in memory and cosine similarity in the near future. This option is available only for sufficient memory.
from ngt.
Related Issues (20)
- How to create a QBG with Capi ? HOT 7
- Specify num_threads for searching HOT 3
- Linking issue HOT 2
- Add more ngt_insert_index_as_TYPE methods to C API HOT 2
- Feature request: Command line output option that doesn't require intensive deserialization
- Add new QBG methods to C API HOT 7
- Is there any benchmark result for NGT QG/QBG? HOT 4
- file descriptor leak on `index.build_index` HOT 2
- Missing functions and types in the C API HOT 14
- bugs HOT 3
- Fixed seeds for deterministic results HOT 1
- Building with -DNGT_QBG_DISABLED=ON still trying to link with LAPACK and BLAS HOT 2
- How to update NGT from older version to new one? HOT 2
- pip install in python==3.11 fails : could not find a version that satisfies HOT 4
- Running sample codes (e.g., qg-l2-float) HOT 6
- Remove vector causes error, only for "Normalised" distance types: Index.h:remove:1544: Not found the specified id HOT 7
- Quantization in qg-l2-float.cpp HOT 1
- colab import ngt dose not work HOT 1
- Paper and references for QG HOT 1
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from ngt.