Comments (2)
If you specify a progress_callback, it cannot be null, and should be a function.
// default empty function
static async getInstance(progress_callback = ()=>{}) {}
// default console log
static async getInstance(progress_callback = (x)=>console.log(x)) {}
from transformers.js.
Update - I got this working by explicitly setting the env.backends.onnx.wasm.wasmPaths
before initializing the model. Updated code that worked for me -
class GeneratorSingleton {
static model_id = 'Xenova/t5-small';
static model = null;
static tokenizer = null;
static async getInstance(progress_callback = (x) => console.log(x)) {
if (!this.tokenizer) {
this.tokenizer = AutoTokenizer.from_pretrained(this.model_id);
}
if (!this.model) {
env.backends.onnx.wasm.wasmPaths = 'https://cdn.jsdelivr.net/npm/[email protected]/dist/';
env.backends.onnx.wasm.numThreads = 1;
this.model = AutoModelForSeq2SeqLM.from_pretrained(this.model_id, {
dtype: 'fp32',
device: 'webgpu',
progress_callback,
});
}
progress_callback({ status: 'ready' });
return Promise.all([this.tokenizer, this.model]);
}
}
from transformers.js.
Related Issues (20)
- [next.js] Error: Route /recipes with `dynamic = "error"` couldn't be rendered statically because it used `searchParams.query`
- Please provide extensive examples of how to use langchain...
- Absolute speaker diarization? HOT 7
- Segment Anything V2 HOT 1
- Next.js server example is broken HOT 5
- The 'documents' parameter is missing in the 'apply_chat_template' function.
- [Model request] OwlV2 HOT 1
- xlm-roberta-large-finetuned-conll03-english
- Expected iterable type in for loop: got UndefinedValue HOT 2
- Speaker timestamping sometimes fails HOT 3
- Whisper sometimes goes haywire with endlessly repeating loops (V3) HOT 1
- update the onnxruntime-web version to support the multithreads HOT 8
- Failed to run Xenova/wav2vec2-bert-CV16-en on transformer.js-v3 webgpu HOT 1
- TimeSformer on the web HOT 3
- Whisper timestamped - Medium HOT 1
- VSCode Interpolation HOT 1
- [v3] Module not found: Default condition should be last one HOT 3
- Model not cacheing after download (@huggingface/transformers) HOT 4
- [Model Request] gte-multilingual-base HOT 1
- Feature request: GPU speedup for Text-To-Speech
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from transformers.js.