RapidOcrOnnx.dll GPU support about ahk2_lib HOT 5 CLOSED

After applying this commit RapidAI/RapidOcrOnnx@83886d1, on my computer, the number of threads is set to 2 or 3 for the fastest recognition.

from ahk2_lib.

The current version supports only CPUs. I have tested the directml version on my computer, but no performance advantage.

from ahk2_lib.

The current version supports only CPUs. I have tested the directml version on my computer, but no performance advantage.

Ah that's unfortunate. Thanks for checking it out for me.

In that same vein, are you sure that you compiled the the dll with multithreading enabled?

I ran the following code with a variety of threads values:

#Requires AutoHotkey v2.0
#Include <RapidOcr>

image := "1.bmp"
threads := 999

param := RapidOcr.OcrParam()
param.doAngle := false

ocr := RapidOcr({ models: A_ScriptDir "\models", numThread: threads },A_ScriptDir "\RapidOcrOnnx.dll")

num := 100
loop num{
    ToolTip(Round((a_index / num)*100,2) "%")
    ocr.ocr_from_file(image, param?)
}

I've tried 1,2,4,6,8, and 999 threads, but all of them gave extremely similar (within milliseconds) results. The time varies a little bit per image, but never per thread value per given image. That suggests that the DLL isn't actually running multithreaded. Am I doing something wrong?

from ahk2_lib.

I appreciate you looking into that!

from ahk2_lib.

RapidOcrOnnx.zip

Requires onnxruntime-gpu v1.18.0, cuda 12.x, cudnn 8.x

from ahk2_lib.