georgesterpu / pyvsr Goto Github PK
View Code? Open in Web Editor NEWPython toolkit for Visual Speech Recognition
License: GNU General Public License v3.0
Python toolkit for Visual Speech Recognition
License: GNU General Public License v3.0
Hello, friend.
I want to use the OuluVS2 dataset, but I don't think the homepage is operating anymore.
So if you don't mind, can you share me the OuluVS2 dataset?
can you provide the dataset when I try to downloading dataset it is asking the license.
Hi, @georgesterpu ,
I'm trying use your code extract aam features from a new dataset, but I got some error:
First is warning from menpo:
PycharmProjects/models/lib/python3.6/site-packages/menpofit/builder.py:338: MenpoFitModelBuilderWarning: The reference shape passed is not a TriMesh or subclass and therefore the reference frame (mask) will be calculated via a Delaunay triangulation. This may cause small triangles and thus suboptimal warps.
MenpoFitModelBuilderWarning)
PycharmProjects/models/lib/python3.6/site-packages/menpo/image/boolean.py:711: FutureWarning: Using a non-tuple sequence for multidimensional indexing is deprecated; use `arr[tuple(seq)]` instead of `arr[seq]`. In the future this will be interpreted as an array index, `arr[np.array(seq)]`, which will result either in an error or a different result.
copy.pixels[slices].flat = point_in_pointcloud(pointcloud, indices)
I want to ask if it is a problem for the later feature extraction?
then after a few times training I got the error like this:
PycharmProjects/models/lib/python3.6/site-packages/menpo/transform/homogeneous/scale.py:307: RuntimeWarning: divide by zero encountered in double_scalars
UniformScale.__init__(self, target.norm() / source.norm(),
Traceback (most recent call last):
File "/snap/pycharm-community/128/helpers/pydev/pydevd.py", line 1758, in <module>
main()
File "/snap/pycharm-community/128/helpers/pydev/pydevd.py", line 1752, in main
globals = debugger.run(setup['file'], None, None, is_module)
File "/snap/pycharm-community/128/helpers/pydev/pydevd.py", line 1147, in run
pydev_imports.execfile(file, globals, locals) # execute the script
File "/snap/pycharm-community/128/helpers/pydev/_pydev_imps/_pydev_execfile.py", line 18, in execfile
exec(compile(contents+"\n", file, 'exec'), glob, loc)
File "/media/wentao/data1/pyVSRaam/example_aam.py", line 88, in <module>
main()
File "/media/wentao/data1/pyVSRaam/example_aam.py", line 59, in main
output_dir='./features/aam_model/'
File "/media/wentao/data1/pyVSRaam/pyVSR/avsr.py", line 47, in extract_save_features
extractor.extract_save_features(files)
File "/media/wentao/data1/pyVSRaam/pyVSR/Features/aam.py", line 286, in extract_save_features
batch_size=None)
File "PycharmProjects/models/lib/python3.6/site-packages/menpofit/aam/base.py", line 318, in increment
batch_size=batch_size)
File "PycharmProjects/models/lib/python3.6/site-packages/menpofit/aam/base.py", line 183, in _train
verbose=verbose)
File "PycharmProjects/models/lib/python3.6/site-packages/menpofit/aam/base.py", line 190, in _train_batch
image_batch, group, self.reference_shape, verbose=verbose)
File "PycharmProjects/models/lib/python3.6/site-packages/menpofit/builder.py", line 89, in rescale_images_to_reference_shape
for i in wrap(images)]
File "PycharmProjects/models/lib/python3.6/site-packages/menpofit/builder.py", line 89, in <listcomp>
for i in wrap(images)]
File "PycharmProjects/models/lib/python3.6/site-packages/menpo/image/base.py", line 2032, in rescale_to_pointcloud
return_transform=return_transform)
File "PycharmProjects/models/lib/python3.6/site-packages/menpo/image/base.py", line 1956, in rescale
return_transform=return_transform)
File "PycharmProjects/models/lib/python3.6/site-packages/menpo/image/base.py", line 1835, in warp_to_shape
mode=mode, cval=cval)
File "PycharmProjects/models/lib/python3.6/site-packages/menpo/image/interpolation.py", line 103, in cython_interpolation
mode=mode, order=order, cval=cval))
File "menpo/external/skimage/_warps_cy.pyx", line 118, in menpo.external.skimage._warps_cy._warp_fast
ValueError: negative dimensions are not allowed
I want to ask how can I deal with this error?
Thank you very much
Hello @georgesterpu ,
I'm trying use your code generate aam features, but I have a problem with memory,
every time when I run example_aam.py, I have this error:OSError: [Errno 12] Cannot allocate memory, I have see each time, there are many ffmpeg progress running at the same time, then this error will come.
python shows the error come from this step:
frame_buffer += frames
if len(frame_buffer) > buffer_len:
# 2. retrain AAM
aam.increment(frame_buffer,
group=self._landmarkGroup,
shape_forgetting_factor=1.0,
appearance_forgetting_factor=1.0,
verbose=False,
batch_size=None)
I want to ask if there is any way to fix this problem, and still run the program?
Thank you so much
A declarative, efficient, and flexible JavaScript library for building user interfaces.
๐ Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
An Open Source Machine Learning Framework for Everyone
The Web framework for perfectionists with deadlines.
A PHP framework for web artisans
Bring data to life with SVG, Canvas and HTML. ๐๐๐
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
Some thing interesting about web. New door for the world.
A server is a program made to process requests and deliver data to clients.
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
Some thing interesting about visualization, use data art
Some thing interesting about game, make everyone happy.
We are working to build community through open source technology. NB: members must have two-factor auth.
Open source projects and samples from Microsoft.
Google โค๏ธ Open Source for everyone.
Alibaba Open Source for everyone
Data-Driven Documents codes.
China tencent open source team.