Comments (4)
Hi @FakeEnd
This warning has actually been removed in the latest nightlies for the 24.02 version because it's pretty much always recommended to use a pool allocator as the default allocator. We use RMM memory manager, which uses cudaMalloc and cudaFree by default but the vector search tutorial has instructions for setting a pool allocator as the default allocator. If you are using Python, you can find a similar example in the RMM readme (at https://github.com/rapidsai/rmm).
from raft.
here is the Python example for setting an RMM pool allocator.
from raft.
@FakeEnd since you are using PyTorch, another thing worth pointing out is that RMM supports PyTorch so the memory pool you create can be shared by both. We have found this to be a really useful feature when working across library boundaries.
from raft.
@FakeEnd since you are using PyTorch, another thing worth pointing out is that RMM supports PyTorch so the memory pool you create can be shared by both. We have found this to be a really useful feature when working across library boundaries.
Thank you:)
from raft.
Related Issues (20)
- [FEA] Remove pre-filtering template args
- [BUG] ptxas error : Value of threads per SM for entry is out of the range.
- [BUG] Kmeans balanced test fails when n_cols<=4
- [FEA] Precompute lookup tables for IVF-PQ search HOT 3
- [FEA] Enable direct cosine distance computation in nearest neighbors algorithms
- [QST] How to build raft with a -arch=sm_75? HOT 1
- [FEA] Replace temporary_device_buffer with mdbuffer-based copyback_buffer
- [FEA] Create a helper function for generating an mdbuffer from a pointer of unknown memory type
- [Task] Review performance impact of `std::visit` in mdbuffer
- [FEA] Improve refine_host performance when batch size is small
- [FEA] how to align rmm stream usage with raft handle
- [FEA] Consistently use the same convention for `hpp` files and their usage of device APIs
- [BUG] Crash in CAGRA optimize from invalid neighbor indices (produced by nn-descent)
- [FEA] Respect `workspace_resource` across ANN algorithms (initially) to allow the separation of memory resources in different `raft::resources` instance
- [FEA] Add filtering search support to `hnsw`
- [QST] CudaErrorInvalidConfiguration Error when query number is out of 6e4? HOT 3
- [BUG] Compile the `template` Fails with RTX 4090 HOT 4
- [BUG] CAGRA computation results will go wrong HOT 3
- [BUG]LIBRAFT cannot be built when RMM locally installed HOT 2
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from raft.