dlpbc / keras-kinetics-i3d Goto Github PK
View Code? Open in Web Editor NEWkeras implementation of inflated 3d from Quo Vardis paper + weights
License: MIT License
keras implementation of inflated 3d from Quo Vardis paper + weights
License: MIT License
Hi dears,
sorry for send email directly,
I'm interested in I3D method for action recognition and i cloned the github project "https://github.com/deepmind/kinetics-i3d"
i want to test the model with my sample recorded video but don't know how to convert my *.mp4 video file (25fps rgb) to *rgb.npz and *flow.npz
could it possible to help or share me a reprocessing script file
best regards.
Hi dlpbc, your i3d keras model is awesome!
I am working on sign language recognition for deaf-mute-people, and need to finetune the provided model/weights on another video-dataset.
In case you have also trained/finetuned with I3D - Could you share a training/finetuning script? I am in particular interested in data_generator needed for fitting with data augmentation.
Thank you! br Frederik
In your opinion, how sensitive is the model to the flow method?
I've tried it with some other flow methods on cuda (for speed) and it gives me absurd results. I also can't seem to re-train it on other flow methods. So I"m wondering if the model is very sensitive to the optical flow method and how would you deal with it if you needed something faster?
Hi, love this work! Just wondering if you're planning to support any models on the updated kinetics 600 dataset?
Hello @dlpbc ,
I just wanted to thank you for porting the I3D network to Keras. I used it to build a Sign Language Recognition prototype: https://github.com/FrederikSchorr/sign-language
Kind regards, Frederik
PS: In https://github.com/FrederikSchorr/sign-language/blob/master/model_i3d.py I added a function add_i3d_top
that creates new top layers depending on the number of output classes.
Have you experimented with the separable version of i3d?
/v_CricketShot_g04_c01_rgb.npy /v_CricketShot_g04_c01_flow.npy is missing
Hello,
Great work, thanks!
I was just curious about how you converted the tf models and weights to Keras. Is there a simple way to do that?
Best,
Florian
I was trying to train on the UCF101 dataset as toy example. Fail to build model.
Following minimalist code snippet fails.
from keras_kinetics_i3d.i3d_inception import Inception_Inflated3d
i3d_model = Inception_Inflated3d(weights='rgb_imagenet_and_kinetics', endpoint_logit=False, classes=102, include_top=False)
Error given
File "/home/hollowgalaxy/Github/experiments/video_extraction_experiments.py", line 76, in <module>
i3d_test()
File "/home/hollowgalaxy/Github/experiments/video_extraction_experiments.py", line 74, in i3d_test
i3d_model = Inception_Inflated3d(weights='rgb_imagenet_and_kinetics', classes=102, include_top=False)
File "/home/hollowgalaxy/Github/keras_kinetics_i3d/i3d_inception.py", line 515, in Inception_Inflated3d
h = int(x.shape[2])
TypeError: __int__ returned non-int (type NoneType)
A declarative, efficient, and flexible JavaScript library for building user interfaces.
๐ Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
An Open Source Machine Learning Framework for Everyone
The Web framework for perfectionists with deadlines.
A PHP framework for web artisans
Bring data to life with SVG, Canvas and HTML. ๐๐๐
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
Some thing interesting about web. New door for the world.
A server is a program made to process requests and deliver data to clients.
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
Some thing interesting about visualization, use data art
Some thing interesting about game, make everyone happy.
We are working to build community through open source technology. NB: members must have two-factor auth.
Open source projects and samples from Microsoft.
Google โค๏ธ Open Source for everyone.
Alibaba Open Source for everyone
Data-Driven Documents codes.
China tencent open source team.