raian / runtimeimageloader Goto Github PK

View Code? Open in Web Editor NEW

100.0 100.0 15.0 10.78 MB

Load images and GIFs into Unreal at runtime without hitches

License: MIT License

C++ 88.05% C 11.08% C# 0.87%

fast gifs importer loader unreal unreal-engine unreal-engine-4 unreal-engine-5 unreal-engine-code-plugin

runtimeimageloader's People

Contributors

Stargazers

Watchers

Forkers

imclab linecode ademets skealeye cha007 unua 594270461 snorrsi flg1217 denfrost kuzzzzzma muhammadmoizulhaq foos-unreal-archive 404126804 jeveruberry

runtimeimageloader's Issues

Support mip generation

From
https://forums.unrealengine.com/t/how-can-i-load-external-images-at-runtime/316140/11

Game crashes when using LoadImageSync

Assertion Failed: !bFlushing
[File:...HTTP\Private\HttpManager.cpp] [Line: 397]

Also happens with LoadGif with Synchronous checked.

I bought the plugin in the unreal marketplace but because I am making a product from source code using UE 5.1, the unreal launcher couldn't find my project so I couldn't use the "Install to Project" button. So to make it work I downloaded the main branch from this github page into my project's engine Engine/Runtime folder, compiled the engine, then the project, added the plugin to the project, added the node (connected to the Runtime Image Loader subsystem), and ran the game in standalone mode.
Loading the link to the gif from the browser, outside of Unreal, works fine so I know it's not a problem with the image itself.
Loading Asynchronously works as expected.

Cancel ongoing task(s)

This is often required for gallery-type projects or when user internet connection is slow

Feature request - GIF support, animated images

Working on a Vtubing program and the ability to customize things like screens in a room or have animated images attached to your avatar in a packaged project is something I want to add.

Can't find "load image async" node

I can only find a "load image sync" node, which loads in sync and causes everything to be loaded in one frame.

Add a new option "target size" (feature request from marketplace)

Android Packaging Error Undefined Symbol FRuntimeTiffLoadHelper() (3bb5ed5)

Environment

UE 4.27.2 (Launcher)
RuntimeImageLoader (commit 3bb5ed5)

What went wrong

Packaging for Android (ASTC) resulted in an undefined symbol error if the OculusVR plugin is disabled.

UATHelper: Packaging (Android (ASTC)):     ld.lld: error: undefined symbol: FRuntimeTiffLoadHelper::FRuntimeTiffLoadHelper()
UATHelper: Packaging (Android (ASTC)):     >>> referenced by RuntimeImageUtils.cpp:33 (D:/src\username\ue4\DebugRIL\Plugins\RuntimeImageLoader\Source\RuntimeImageLoader\Private\RuntimeImageUtils.cpp:33)
UATHelper: Packaging (Android (ASTC)):     >>>               D:/src/username/ue4/DebugRIL/Plugins/RuntimeImageLoader/Intermediate/Build/Android/UE4/Development/RuntimeImageLoader/RuntimeImageUtils.cppa7.o:(_GLOBAL__sub_I_RuntimeImageUtils.cpp)
UATHelper: Packaging (Android (ASTC)):   
UATHelper: Packaging (Android (ASTC)):     ld.lld: error: undefined symbol: FRuntimeTiffLoadHelper::~FRuntimeTiffLoadHelper()
UATHelper: Packaging (Android (ASTC)):     >>> referenced by RuntimeImageUtils.cpp:0 (D:/src\username\ue4\DebugRIL\Plugins\RuntimeImageLoader\Source\RuntimeImageLoader\Private\RuntimeImageUtils.cpp:0)
UATHelper: Packaging (Android (ASTC)):     >>>               D:/src/username/ue4/DebugRIL/Plugins/RuntimeImageLoader/Intermediate/Build/Android/UE4/Development/RuntimeImageLoader/RuntimeImageUtils.cppa7.o:(_GLOBAL__sub_I_RuntimeImageUtils.cpp)
UATHelper: Packaging (Android (ASTC)):     clang++: error: linker command failed with exit code 1 (use -v to see invocation)
PackagingResults: Error: undefined symbol: FRuntimeTiffLoadHelper::FRuntimeTiffLoadHelper()
PackagingResults: Error: undefined symbol: FRuntimeTiffLoadHelper::~FRuntimeTiffLoadHelper()
PackagingResults: Error: linker command failed with exit code 1 (use -v to see invocation)

How to Recreate The Issue

Create a new blueprint project from 4.27.2 (Launcher)
Close the Editor
Import RuntimeImageLoader to the Plugins folder (from commit 3bb5ed5)
Open the project and build the binaries for RuntimeImageLoader
Disable the OculusVR plugin and restart the editor
Attempt to package for Android (ASTC), but it fails
To verify, enable the OculusVR plugin and repackage and it will succeed.

I have a separate project and enabling OculusVR did not resolve the error, but so far this was how I found out that I could recreate the error from a new project.

Attachments

Complete Log

Investigate UMG support for gray scale images

Support Android

https://forums.unrealengine.com/t/how-can-i-load-external-images-at-runtime/316140/11

Texture is not displayed in UMG

This feedback is from Unreal marketplace.

Texture is not displayed properly because it required correctly set up TextureResource2D, which does not happen currently.

Solution: Replace TextureResource2D with custom TextureResource class

Add support for HDRI images

Generate cubemap texture.

Google request "unreal create cubemap runtime"

Add example map for textures and cubemaps

Support scaling option (from 0% to 100%) to transform images

Marketplace request

Allow to set texture filtering mode

Add cache layer for regular images

Request from Marketplace

VR application crashes using Async loading (5.1.1)

In my VR app I have a button that downloads the bytes array of an image and uses the plugin's function "LoadImageFromBytesAsync()" (from C++) to load the texture asynchronously.
The problem is that if I spam the button, my app crashes with the following error:

[...]
[2023.04.26-13.43.34:262][126]LogRuntimeImageReader: Reading image from byte array. First few bytes: 255 216 255
[2023.04.26-13.43.34:529][143]LogOutputDevice: Warning: 

Script Stack (0 frames) :

[2023.04.26-13.43.34:664][143]LogAndroid: Error: === Critical error: ===
[2023.04.26-13.43.34:664][143]LogAndroid: Error: 
[2023.04.26-13.43.34:664][143]LogAndroid: Error: Fatal error: [File:D:/UnrealEngineOculus/Engine/Source\Runtime/Core/Private/HAL/MallocBinned2.cpp] [Line: 1175] 
[2023.04.26-13.43.34:664][143]LogAndroid: Error: FMallocBinned2 Attempt to GetAllocationSizeExternal an unrecognized block 0x3fc0000000000000
[2023.04.26-13.43.34:664][143]LogAndroid: Error: [Callstack] 0x0000007BB832C8AC libUnreal.so(0x000000000D82B8AC)![Unknown]()  []
[2023.04.26-13.43.34:664][143]LogAndroid: Error: [Callstack] 0x0000007BB832C758 libUnreal.so(0x000000000D82B758)!FMallocBinned2::GetAllocationSizeExternal(void*, unsigned long long&)  []
[2023.04.26-13.43.34:664][143]LogAndroid: Error: [Callstack] 0x0000007BB839D76C libUnreal.so(0x000000000D89C76C)!FMallocPoisonProxy::Realloc(void*, unsigned long long, unsigned int)  []
[2023.04.26-13.43.34:664][143]LogAndroid: Error: [Callstack] 0x0000007BB837B600 libUnreal.so(0x000000000D87A600)!FMemory::Realloc(void*, unsigned long long, unsigned int)  []
[2023.04.26-13.43.34:664][143]LogAndroid: Error: [Callstack] 0x0000007BB569511C libUnreal.so(0x000000000AB9411C)!TArray<char16_t, TSizedDefaultAllocator<32> >::ResizeForCopy(int, int)  []
[2023.04.26-13.43.34:664][143]LogAndroid: Error: [Callstack] 0x0000007BB618D3A4 libUnreal.so(0x000000000B68C3A4)![Unknown]()  []
[2023.04.26-13.43.34:664][143]LogAndroid: Error: [Callstack] 0x0000007BB618C2E0 libUnreal.so(0x000000000B68B2E0)!URuntimeImageLoader::Tick(float)  []
[2023.04.26-13.43.34:664][143]LogAndroid: Error: [Callstack] 0x0000007BBDC6D5B0 libUnreal.so(0x000000001316C5B0)!FTickableGameObject::TickObjects(UWorld*, int, bool, float)  []
[2023.04.26-13.43.34:664][143]LogAndroid: Error: [Callstack] 0x0000007BBCFD50AC libUnreal.so(0x00000000124D40AC)!UGameEngine::Tick(float, bool)  []
[2023.04.26-13.43.34:664][143]LogAndroid: Error: [Callstack] 0x0000007BB5677F74 libUnreal.so(0x000000000AB76F74)!FEngineLoop::Tick()  []
[2023.04.26-13.43.34:664][143]LogAndroid: Error: [Callstack] 0x0000007BB566F724 libUnreal.so(0x000000000AB6E724)!AndroidMain(android_app*)  []
[2023.04.26-13.43.34:664][143]LogAndroid: Error: [Callstack] 0x0000007BB567E468 libUnreal.so(0x000000000AB7D468)!android_main()  []
[2023.04.26-13.43.34:664][143]LogAndroid: Error: [Callstack] 0x0000007BB56B2808 libUnreal.so(0x000000000ABB1808)![Unknown]()  []
[2023.04.26-13.43.34:664][143]LogAndroid: Error: [Callstack] 0x0000007CB0B97C48 libc.so(0x00000000000D5C48)![Unknown]()  []
[2023.04.26-13.43.34:664][143]LogAndroid: Error: [Callstack] 0x0000007CB0B44FE8 libc.so(0x0000000000082FE8)![Unknown]()  []

It occurs 100% times when I spam the button and sometimes it crashes even if I start the app and spawn just one image.
If I use the Sync version of that function, the problem goes away, but the app hitches again.
This problem doesn't occur in PIE (so when using Windows build).

I post below my code:

void UImageDownloader::ManageTextureBytes(TArray<uint8> Data)
{
	FLatentActionInfo LatentInfo;
	LatentInfo.CallbackTarget = this;
	LatentInfo.ExecutionFunction = TEXT("OnImageLoaded");
	LatentInfo.UUID = 123;
	LatentInfo.Linkage = 0;

	URuntimeImageLoader* Loader = GetOuter()->GetWorld()->GetSubsystem<URuntimeImageLoader>();

	FString Error;
	bool bSuccess;

	Loader->LoadImageFromBytesAsync(Data, FTransformImageParams(), OutTexture, bSuccess, Error, LatentInfo, GetOuter()->GetWorld());

}

Support Quite OK Image Format”

Details:
https://github.com/phoboslab/qoi

in level BP , After Load Image Async , texture size is 1x1

what's the problem?

Runtime GIF loading & decoding support

Loading GIFs (and webp) is possible at runtime but requires some work around loading and decoding data.

16bit PNG file is not supported

Output from "Out Error" and PrintString in node "Load Image Async"

Exit PIE during loading will freeze editor

This problem happens in 1.2.2.
1.2.1 seems no problem, which can exit back to edit time normally.

Memory leak

Hello I create a system of replicated graffity with the help of your plugin to create a cache system for each graff, but I found a memoryleak in your plugin, because when I load many png then close the editor the vram is not flush so you can simply code this:

To reproduce the memory leak, so you start the game then you stop you restart.. And you can see the vram increasing without flushing. Let me know if you need more information or if I simply need to do something to handle this myself thank in advance !