finalfusion / finalfusion-inspector Goto Github PK

Currently, queries are executed in the main (UI) thread. This freezes up the interface while doing computations. On my machine, processing similarity/analogy queries is so fast that I don't notice anything. But it would be nice to do heavy computations asynchronously.

Possible problems: does the Rust Python module use the GIL in relevant code paths?

For embeddings that use explicit indices, this sorts the n-grams (typically) by frequency.

Also permit sorting by n-gram.

What is in the repository now is a quick mockup in Python. But Python makes it a bit harder to distribute a standalone application, plus to do (good) async processing. Consider rewriting in a native language for easy redistributability. Logical choices:

• Rust + Gtk2 (Qt bindings are nowhere yet)
• C++ + Qt (GUI could be ported easily, but far less safe)