wtct-hungary / unityvision-ios Goto Github PK

Hi, thanks for this nice plugin.

I just tried to use your ARKitExample code with a ARKitFaceTrackingConfiguration. It basically seems to work and I also initially get the right image classification from the front cam, however, after a short while the app crashes with an EXC_BAD_ACCESS exception.

More precisely, in:

int _vision_evaluateWithBuffer(CVPixelBufferRef buffer) {

    // In case of invalid buffer ref
    if (!buffer) return 0;
    
    // Forward message to the swift api
    return [[VisionNative shared] evaluateWithBuffer: buffer] ? 1 : 0;
}

the line return [[VisionNative shared] evaluateWithBuffer: buffer] ? 1 : 0;

produces this error:

Thread 1: EXC_BAD_ACCESS (code=1, address=0x94a2994c0)

Any suggestions?

Thanks a lot in advance!

Update:

additional testing shows that its not the RKitFaceTrackingConfiguration, but another plugin that ran in the background performing Voice recognition. Was quite surprising, as these two things don't seem to have anything to do with each other. I will contact the developer of the Voice recognition plugin.

This is such an amazing and smooth unity integration of Vision rectangle detection

Please update / fix it!

I'm trying to build this project with
unity 2018 .1
xcode 13

I have this error " Cannot initialize a parameter of type 'id _Nonnull' with an rvalue of type 'Class' "

I'm getting
VisionNative.swift:147:17: Cannot find 'UnitySendMessage' in scope
and:
VisionNative.swift:53:35: Cannot find 'Inceptionv3' in scope

I tried adding Inceptionv3 by dropping it into the project and by adding it in different location under "build phases" for Unity.iPhone target.
But the documentation is a bit ambiguous about where exactly you should add the file (copy bundle resources? copy files? compule sources? etc)

Hello,
The classification app works on many phones but on one iPhone XS it freezes up. I was wondering if anyone had some ideas why.

So here are the details:
iOS:12.2
The behavior is that it works for a few seconds then it freezes for 1-2 seconds and it works again, and this freezing continues.

I turned on Zombie Objects and get many of this error from the devices simulator console whenever it freezes
2019-03-20 12:58:34.740735-0400 snobBog3[7837:2621978] Execution of the command buffer was aborted due to an error during execution. Discarded (victim of GPU error/recovery) (IOAF code 5)
I noticed I also get this warning before
Tiled GPU perf. warning: RenderTexture color surface (1080x1920) was not cleared/discarded.

The problem is definitely is somewhere in the classification code, because all the AR stuff works when the vision script is disabled.

I have tried (that I can remember):

• updating swift version to newest version
• getting rid of all unnecessary shaders
• lowering the maxClassificationResults (trying to not overload the GPU)
• updating iphone system/closing all other apps/reinstalling etc

I tested it on a different iPhone XS and it works great.

I have never developed an app before that deals with swift or CoreML so anything you may seem as obvious to try may save me more weeks of headaches! Is there something I should be looking at that would tell me why it works on one iPhoneXS but not another?

Thanks for reading I anticipate & appreciate a response

Hello,

This is a very loose / broad question -

From a high level - I was wondering if there are any ways of increasing performance?

Thanks in advance!

Oliver

hi.. did you test also with AR Foundation

VisionOS does not have camera API access and having Vision Framework would be a great alternative. Thanks!

/Users/apple/Documents/UNITY BARCODE ML/UnityVision-iOS/Build/first/Libraries/Plugins/iOS/Vision/Native/VisionNative.swift:100:50: Use of undeclared type 'CoreImage'

Please help me I am working on a project where they want to detect a rectangle object this plugin does that but when we are in portrait mode in Ipad width of the rectangle fits properly but height doesn't fit similarly in landscape mode height fits properly but not the width.Pfa the image and if its fixed it will be really helpful.