seanchenxy / handavatar Goto Github PK
View Code? Open in Web Editor NEWLicense: MIT License
License: MIT License
When I run the pre-train model I find it is for test_Capture0_ROM04_RT_Occlusion. May I ask what exactly the part is in the Interhand dataset(like partaa partab ...) Cause it is so big and I am not able to load the whole dataset. Another thing is which annotation is used H+M, H or M.
How does one do the editing as found in Figure 1b? Do you have to refit on a new monocular video with a different identity? Or is it possible to more explicitly edit the albedo (for example)?
Hi, thank you for sharing great work.
I have successfully run the segment code and placed the pre-trained model in the correct location.But when I run the command './handavatar/scripts/run_hand.sh' to get the result, I get an error saying 'No module named 'leap.tools'. Could you help me solve this problem? Thank you!
Not sure if my INSTALL is wrong, but I get this error currently. It seems to occur while rendering, so it may be a problem with leap?
(base) ➜ HandAvatar git:(main) ✗ CUDA_LAUNCH_BLOCKING=1 ./handavatar/scripts/run_hand.sh
------------------ GPU Configurations ------------------
Primary GPUs: [0]
Secondary GPUs: [0]
--------------------------------------------------------
------------------ GPU Configurations ------------------
Primary GPUs: [0]
Secondary GPUs: [0]
--------------------------------------------------------
MANO-HD in Model
upsample mano to 3093
upsample mano to 12337
load network from handavatar/out/handavatar/interhand/test_Capture0_ROM04_RT_Occlusion/pretrained_model/latest.tar
[Dataset Path] data/InterHand/5
Load annotation data/InterHand/5/InterHand2.6M_5fps_batch1/preprocess/test/Capture0/ROM03_RT_No_Occlusion/anno_cam.pkl
-- Total Frames: 194
The rendering is saved in handavatar/out/handavatar/interhand/test_Capture0_ROM04_RT_Occlusion/pretrained_model/latest/5/test/Capture0/ROM03_RT_No_Occlusion/ori
0 194
Traceback (most recent call last):
File "/private/home/relh/HandAvatar/handavatar/run_interhand.py", line 239, in <module>
run()
File "/private/home/relh/mambaforge/lib/python3.10/site-packages/torch/autograd/grad_mode.py", line 27, in decorate_context
return func(*args, **kwargs)
File "/private/home/relh/HandAvatar/handavatar/run_interhand.py", line 162, in run
net_output = model(**data,
File "/private/home/relh/mambaforge/lib/python3.10/site-packages/torch/nn/modules/module.py", line 1194, in _call_impl
return forward_call(*input, **kwargs)
File "handavatar/core/nets/handavatar/network.py", line 542, in forward
all_ret = self._batchify_rays(packed_ray_infos, **kwargs)
File "handavatar/core/nets/handavatar/network.py", line 241, in _batchify_rays
ret = self._render_rays(rays_flat[i:i+cfg.chunk], **kwargs)
File "handavatar/core/nets/handavatar/network.py", line 299, in _render_rays
query_result = self._query_mlp(
File "handavatar/core/nets/handavatar/network.py", line 127, in _query_mlp
result = self._apply_mlp_kernals(
File "handavatar/core/nets/handavatar/network.py", line 200, in _apply_mlp_kernals
alpha, part_info = self.smpl_body.coap.query(xyz[None], smpl_output, ret_intermediate=True)
File "handavatar/core/nets/handavatar/pairof/pairof_render.py", line 696, in query
gdists, gindices = (points[:, :, None, :] - global_points[:, None, :, :]).norm(dim=-1).topk(self.neighbor, dim=-1, largest=False)
RuntimeError: CUDA error: an illegal memory access was encountered
A declarative, efficient, and flexible JavaScript library for building user interfaces.
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
An Open Source Machine Learning Framework for Everyone
The Web framework for perfectionists with deadlines.
A PHP framework for web artisans
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
Some thing interesting about web. New door for the world.
A server is a program made to process requests and deliver data to clients.
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
Some thing interesting about visualization, use data art
Some thing interesting about game, make everyone happy.
We are working to build community through open source technology. NB: members must have two-factor auth.
Open source projects and samples from Microsoft.
Google ❤️ Open Source for everyone.
Alibaba Open Source for everyone
Data-Driven Documents codes.
China tencent open source team.