r00tman / eventhands Goto Github PK

I could not grasp the meaning of the third instruction in LIVE_DEMO.md.
I have two questions.

1. Does "Compile the native module for the live prediction code." mean to compile live_cython.pyx with setup.py?

2. What .md file does "the corresponding README.md" in "More info is in the corresponding README.md." refer to?

Great Job

Is there a readme t install the whole c++ project.

I read all readme but these is no readme how to make/install the whole project or each module

when i use "./build/evsim -p ../model/predictions_filteredfast.txt -r 1000 -j joints.txt -w 240 -h 180 -v" to check the evsim result, it shows the error about
“
1
1
1
1
1
1
loading replay
loaded replay
terminate called after throwing an instance of 'thrust::system::system_error'
what(): parallel_for failed: cudaErrorUnknown: unknown error
”
is the error about my cuda version?

Hello,

i think the evaluation script of synthetic data is missing in this repository.

According to https://github.com/r00tman/EventHands/blob/main/EVAL_SYNTH.md, there should be a predict_synth.py file. However, i cannot find it here. Can you please point it our where to find that script?

I run the step 3 in readme EVAL_REAL.md, try to generate the visualized video1000.mp4:

./build/evsim -o -p ../filter/predictions_filteredfast.txt -r 60 -j joints.txt -w 240 -h 180 -v | ffmpeg -y -s 240x180 -f rawvideo -pix_fmt rgb24 -framerate 60 -i pipe:0 -crf 1 -pix_fmt yuv444p video1000.mp4

but got some trouble with output below:

ffmpeg version 4.2.2 Copyright (c) 2000-2019 the FFmpeg developers
built with gcc 7.3.0 (crosstool-NG 1.23.0.449-a04d0)
configuration: --prefix=/home/ai1/anaconda3 --cc=/tmp/build/80754af9/ffmpeg_1587154242452/_build_env/bin/x86_64-conda_cos6-linux-gnu-cc --disable-doc --enable-avresample --enable-gmp --enable-hardcoded-tables --enable-libfreetype --enable-libvpx --enable-pthreads --enable-libopus --enable-postproc --enable-pic --enable-pthreads --enable-shared --enable-static --enable-version3 --enable-zlib --enable-libmp3lame --disable-nonfree --enable-gpl --enable-gnutls --disable-openssl --enable-libopenh264 --enable-libx264
libavutil 56. 31.100 / 56. 31.100
libavcodec 58. 54.100 / 58. 54.100
libavformat 58. 29.100 / 58. 29.100
libavdevice 58. 8.100 / 58. 8.100
libavfilter 7. 57.100 / 7. 57.100
libavresample 4. 0. 0 / 4. 0. 0
libswscale 5. 5.100 / 5. 5.100
libswresample 3. 5.100 / 3. 5.100
libpostproc 55. 5.100 / 55. 5.100
1
1
1
1
1
1
loading replay
loaded replay
time=955ms frames=100 fps=104.71 c=0.50 t=1.65 1/dt=60.00
time=1331ms frames=200 fps=150.26 c=0.50 t=3.32 1/dt=60.00
Input #0, rawvideo, from 'pipe:0':
Duration: N/A, bitrate: 62208 kb/s
Stream #0:0: Video: rawvideo (RGB[24] / 0x18424752), rgb24, 240x180, 62208 kb/s, 60 tbr, 60 tbn, 60 tbc
Stream mapping:
Stream #0:0 -> #0:0 (rawvideo (native) -> h264 (libx264))
[libx264 @ 0x559e729f1dc0] using cpu capabilities: MMX2 SSE2Fast SSSE3 SSE4.2 AVX FMA3 BMI2 AVX2
[libx264 @ 0x559e729f1dc0] profile High 4:4:4 Predictive, level 1.3, 4:4:4, 8-bit
[libx264 @ 0x559e729f1dc0] 264 - core 157 - H.264/MPEG-4 AVC codec - Copyleft 2003-2018 - http://www.videolan.org/x264.html - options: cabac=1 ref=3 deblock=1:0:0 analyse=0x1:0x111 me=hex subme=7 psy=1 psy_rd=1.00:0.00 mixed_ref=1 me_range=16 chroma_me=1 trellis=1 8x8dct=0 cqm=0 deadzone=21,11 fast_pskip=1 chroma_qp_offset=4 threads=6 lookahead_threads=1 sliced_threads=0 nr=0 decimate=1 interlaced=0 bluray_compat=0 constrained_intra=0 bframes=3 b_pyramid=2 b_adapt=1 b_bias=0 direct=1 weightb=1 open_gop=0 weightp=2 keyint=250 keyint_min=25 scenecut=40 intra_refresh=0 rc_lookahead=40 rc=crf mbtree=1 crf=1.0 qcomp=0.60 qpmin=0 qpmax=69 qpstep=4 ip_ratio=1.40 aq=1:1.00
Output #0, mp4, to 'video1000.mp4':
Metadata:
encoder : Lavf58.29.100
Stream #0:0: Video: h264 (libx264) (avc1 / 0x31637661), yuv444p, 240x180, q=-1--1, 60 fps, 15360 tbn, 60 tbc
Metadata:
encoder : Lavc58.54.100 libx264
Side data:
cpb: bitrate max/min/avg: 0/0/0 buffer size: 0 vbv_delay: -1
frame= 0 fps=0.0 q=0.0 Lsize= 0kB time=00:00:00.00 bitrate=N/A speed= 0x
video:0kB audio:0kB subtitle:0kB other streams:0kB global headers:0kB muxing overhead: unknown`

The video after output is not playable, is there any advice to solve the problem ??

I had tried to use command
/build/evsim -p ../filter/predictions_filteredfast.txt -r 60 -j joints.txt -w 240 -h 180 -v
which let the executable reder on the screen, and it seems works fine.

Thanks for your excellent work! But I met some problem when compiling the c++ code.

$ cmake .. -DCMAKE_CXX_COMPILER=g++-8 -DCMAKE_C_COMPILER=gcc-8
-- The CXX compiler identification is GNU 8.4.0
-- The CUDA compiler identification is NVIDIA 10.1.105
-- Detecting CXX compiler ABI info
-- Detecting CXX compiler ABI info - done
-- Check for working CXX compiler: /usr/bin/g++-8 - skipped
-- Detecting CXX compile features
-- Detecting CXX compile features - done
-- Detecting CUDA compiler ABI info
-- Detecting CUDA compiler ABI info - done
-- Check for working CUDA compiler: /usr/local/cuda/bin/nvcc - skipped
-- Detecting CUDA compile features
-- Detecting CUDA compile features - done
-- Found SDL2: /usr/lib/x86_64-linux-gnu/libSDL2.so (found version "2.0.10")
CMake Warning (dev) at /usr/local/share/cmake-3.23/Modules/FindPackageHandleStandardArgs.cmake:438 (message):
The package name passed to find_package_handle_standard_args (SDL2main)
does not match the name of the calling package (SDL2). This can lead to
problems in calling code that expects find_package result variables
(e.g., _FOUND) to follow a certain pattern.
Call Stack (most recent call first):
cmake/sdl2/FindSDL2.cmake:318 (FIND_PACKAGE_HANDLE_STANDARD_ARGS)
CMakeLists.txt:37 (find_package)
This warning is for project developers. Use -Wno-dev to suppress it.

-- Found SDL2main: /usr/lib/x86_64-linux-gnu/libSDL2main.a (found version "2.0.10")
CMake Warning (dev) at /usr/local/share/cmake-3.23/Modules/FindPackageHandleStandardArgs.cmake:438 (message):
The package name passed to find_package_handle_standard_args (SDL2main)
does not match the name of the calling package (SDL2). This can lead to
problems in calling code that expects find_package result variables
(e.g., _FOUND) to follow a certain pattern.
Call Stack (most recent call first):
cmake/sdl2/FindSDL2.cmake:318 (FIND_PACKAGE_HANDLE_STANDARD_ARGS)
cmake/sdl2/FindSDL2_image.cmake:114 (find_package)
CMakeLists.txt:42 (find_package)
This warning is for project developers. Use -Wno-dev to suppress it.

-- Found SDL2_image: /usr/lib/x86_64-linux-gnu/libSDL2_image.so (found version "2.0.5")
-- Found GLEW: /usr/include (found version "2.1.0")
-- Found OpenGL: /usr/lib/x86_64-linux-gnu/libOpenGL.so
-- Found GLM: /usr/include
-- Looking for sgemm_
-- Looking for sgemm_ - found
-- Found BLAS: /usr/lib/x86_64-linux-gnu/libopenblas.so
-- Looking for cheev_
-- Looking for cheev_ - found
-- Found LAPACK: /usr/lib/x86_64-linux-gnu/libopenblas.so;/usr/lib/x86_64-linux-gnu/libopenblas.so
-- Found CUDAToolkit: /usr/local/cuda/include (found version "10.1.105")
-- Found Threads: TRUE
-- Configuring done
-- Generating done
-- Build files have been written to: /home/cll/disk/EventHands/evsim_joints/build

$ cmake --build .
[ 6%] Building CXX object CMakeFiles/evsim.dir/main.cpp.o
[ 12%] Building CUDA object CMakeFiles/evsim.dir/evc.cu.o
/usr/lib/gcc/x86_64-linux-gnu/7/include/avx512fintrin.h(11265): error: identifier "__builtin_ia32_scalefsd_round" is undefined

/usr/lib/gcc/x86_64-linux-gnu/7/include/avx512fintrin.h(11274): error: identifier "__builtin_ia32_scalefss_round" is undefined

2 errors detected in the compilation of "/tmp/tmpxft_00001d58_00000000-6_evc.cpp1.ii".
make[2]: *** [CMakeFiles/evsim.dir/build.make:90: CMakeFiles/evsim.dir/evc.cu.o] Error 1
make[1]: *** [CMakeFiles/Makefile2:83: CMakeFiles/evsim.dir/all] Error 2
make: *** [Makefile:91: all] Error 2

Could you please provide any instructions on it? Thank you in advance.