shravansunder / hnswlib-wasm Goto Github PK

Hi, thanks for compiling hnsw to webassembly! I am using this library for several of my open source packages.

I have found the following issue: When I try to load multiple indexes in parallel and read the saved index from indexeddb or diskemscripten FS using readIndex, Webassembly errors get thrown around. I don't get a specific error message. Just "webassembly.exception"

like this:

The error message doesn't have any real information attached to it.

--> my solution right now is to add a pause of 500ms before loading another index. And that seems to mitigate the issue for now.

here is the code if you're interested:

https://github.com/Xyntopia/taskyon/blob/5bf6076ad4b3d456f05185bc5fbeac728c740a99/src/modules/vectorSearch.ts#L49

This works. But I want to throw that in here. Maybe there is an easy solution to this. My workaround is quiet dirty.

Is there a way to save the index file from the virtual FS from Emscripten to local FS? Or export the *.bin data.

Hello,

I'm trying to use your package to run hnswlib in a Chrome extension's background script. When I call loadHnswlib I get the error:

import() is disallowed on ServiceWorkerGlobalScope by the HTML specification.

Note that I don't get this error when importing transformers.js and it's successfully working in the background script, so it's not generally failing to do imports.

Any idea why your module might be different? I'm stumped why one module would import and work but not another, given this error message.