Comments (2)
MaartenGr
commented on June 18, 2024
2
The GPU can be used at different stages of BERTopic since each stage uses a different algorithm. For instance, multi-GPU is not supported out of the box but potentially could be with cuML. If you want to use a different GPU, and assuming you are using the default pipeline, you would have to instruct sentence-transformers to use a different GPU.
from bertopic.
CHesketh76
commented on June 18, 2024
@MaartenGr Thank you! I believe that resolved my issue.
For others with similar issue. Do not save the model as pickled object, use safetensors or the torch options. This allows you to control the components of what is being loaded in. Code below for reference.
embed_model = SentenceTransformer('path/to/model/', device='cuda:2')from bertopic.
Related Issues (20)
- KeyError when merging models with multiple representations HOT 3
- Kernel dies at the "Extracting topics from clusters using representation models" stage HOT 2
- Multi-GPU Utilisation HOT 1
- SpaCy: AttributeError: 'DocTransformerOutput' object has no attribute 'tensors'
- Running BERTopic on Apple Silcon (M1 & M2 chips, ARM64 architecture) HOT 4
- Persistent Zero Probability for Documents Previously Classified as Outliers after Implementing reduce_outliers and _map_probabilities HOT 1
- Visualize Topics after Transform HOT 1
- Representation Model with KeyBERTInspired doesn't work in WSL2 HOT 2
- Error when setting chain representation models as main HOT 3
- BERTopic paper experiments results HOT 1
- RuntimeError: The size of tensor a (678) must match the size of tensor b (512) at non-singleton dimension 1 HOT 3
- FEATURE: Add interactive DataMapPlot HOT 4
- Langchain Representation: No KEYWORDS tag included in generation HOT 6
- AttributeError: 'TextGeneration' object has no attribute 'random_state' HOT 2
- [Possible BUG] n_words parameter doesn't update y_label values HOT 3
- cannot build wheel hdbscan HOT 2
- Guidance on managing BERTopic models HOT 15
- Potential Bug for vectorizer_model HOT 3
- CohereAPIError HOT 4
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from bertopic.