Stuck when trying run_on_animals.py demo. about smalr_online HOT 16 OPEN

Hi, Your problem seems to be with OpenDR. I cannot reproduce your problem, but I suggest to first check if OpenDR works by running their demo (https://github.com/mattloper/opendr/blob/master/README.txt). Somebody pointed me to this repository: https://github.com/polmorenoc/opendr I have not checked it out, but maybe it can help. Best
…
On 21. May 2021, at 05:30, xiruiYan @.***> wrote: @silviazuffi https://github.com/silviazuffi I find that all the rendering result img of OpenDr in the code are zero. i.e. all the outputs of render_mesh in myrender.py are zero... could you pls help check the problem? thanks!! — You are receiving this because you were mentioned. Reply to this email directly, view it on GitHub <#2 (comment)>, or unsubscribe https://github.com/notifications/unsubscribe-auth/ABNYVFP5GOA6LJJ6WC36SNTTOXHV7ANCNFSM4SU5G76Q.

thanks for your help!
I solve this problem by add these imports at the begin of run_on_animals.py

from opendr.renderer import ColoredRenderer
from opendr.renderer import TexturedRenderer
from opendr.lighting import LambertianPointLight

from smalr_online.

Hi, Is this during the SMAL fitting or the refinement? The nan comes from the term m2s. You should add a breakpoint where the nan is generated, there is a division by the area of the model, it could be that in your case this value is zero. I suggest adding a small value to the denominator ad see if this fixes the problem.
…

Thank you for replying me. I have fixed the problem by removing the denominator if it's zero.
May I ask you one more question, I want to visualize the 3D result mesh but I don't know how to do it and cannot find information in README.md. Could you give me some hint on how to visualize ?

from smalr_online.

from smalr_online.

from smalr_online.

from smalr_online.

from smalr_online.

@silviazuffi
Btw, I have the same issue when running the demo script.

This happens when the rends[0] is a chumpy tensor with zeros everywhere.

See this function:
https://github.com/silviazuffi/smalr_online/blob/master/src/smalr/silhouette_multi_model.py#L216-L227

from smalr_online.

@silviazuffi
I have the same issue with vhvkhoa. Then I added a small value to the denominator, it seems to have been solved.
But now I have a new issue, similar to the previous one.
removing shoulders, often bad annotated Scale 6 Downweighting regularizers 0.9 weights: s2m 2.00 m2s 8.00 free_variables are dv nan | arap: 1.30e+00 | kp_proj_0: 6.66e+00 | kp_proj_1: 3.85e+00 | kp_proj_2: 4.42e+00 | lap: 7.29e+00 | m2s_0: nan | m2s_1: nan | m2s_2: nan | s2m_0: 1.27e+01 | s2m_1: 2.55e+00 | s2m_2: 5.64e+00 | sym_0: 1.95e+02 | sym_1: 1.01e+03 | sym_2: 1.80e+02

from smalr_online.

@silviazuffi,
Thank you for your quick reply. I'll try it right away.
Please don't worry, I promise not to use it for commercial purposes.

from smalr_online.

@silviazuffi

hi, when i run this code directly on your provided data, i met the same problem :
nan | cam_t_pos_0: 0.00e+00 | feq_0: 9.44e+02 | fpos_0: 0.00e+00 | kp_proj_0: 5.48e+07 | m2s_0: nan | pose_limit_0: 4.54e+05 | pose_prior_0: 3.58e+07 | pose_prior_tail_0: 3.58e+05 | s2m_0: 1.88e+06 | shape_prior_0: 1.58e+06 | trans_init_0: 1.80e+06

and if i add the small value to the denominator, there is a new issue:
free_variables are dv
nan | arap: 1.47e-01 | kp_proj_0: 6.43e-02 | lap: 8.10e-01 | m2s_0: nan | s2m_0: 2.32e-01 | sym_0: 2.17e+01 | sym_1: 1.12e+02 | sym_2: 2.00e+01

can you help check what's the problem? thanks

from smalr_online.

@silviazuffi,
Thank you for your quick reply. I'll try it right away.
Please don't worry, I promise not to use it for commercial purposes.

excuse me, i met the same problem with you, could you tell me how to solve this? thank you very much!

from smalr_online.

from smalr_online.

@silviazuffi
i checked all the inputs of coloredRenderer are not zero, while the output 'rends' are all zero. I try what you say but it doesn't work, maybe the use of colorrender is wrong or the version of OpenDR is wrong?
rends = [ColoredRenderer(
vc=np.ones_like(sv[i].r),
v=sv[i],
f=sv[i].f,
camera=cameras[i],
frustum=frustums[i],
bgcolor=ch.array([0, 0, 0])) for i in range(nCameras)]

from smalr_online.

@silviazuffi
I find that all the rendering result img of OpenDr in the code are zero.
i.e. all the outputs of render_mesh in myrender.py are zero... could you pls help check the problem? thanks!!

from smalr_online.

from smalr_online.

@silviazuffi I have the same issue with vhvkhoa. Then I added a small value to the denominator, it seems to have been solved. But now I have a new issue, similar to the previous one. removing shoulders, often bad annotated Scale 6 Downweighting regularizers 0.9 weights: s2m 2.00 m2s 8.00 free_variables are dv nan | arap: 1.30e+00 | kp_proj_0: 6.66e+00 | kp_proj_1: 3.85e+00 | kp_proj_2: 4.42e+00 | lap: 7.29e+00 | m2s_0: nan | m2s_1: nan | m2s_2: nan | s2m_0: 1.27e+01 | s2m_1: 2.55e+00 | s2m_2: 5.64e+00 | sym_0: 1.95e+02 | sym_1: 1.01e+03 | sym_2: 1.80e+02
@Autumnfall-Me

Have you solved the problem? I have met the same problem as you. And I cannot solve it even if I set a small value on render[I] when it == 0.

from smalr_online.