qway / nerfmeshes Goto Github PK

View Code? Open in Web Editor NEW

341.0 341.0 35.0 68.47 MB

A pipeline to reconstruct 3d meshes based on Neural Radiance Fields

License: MIT License

Python 99.63% Shell 0.37%

nerfmeshes's People

Contributors

Stargazers

Watchers

nerfmeshes's Issues

texture of model

hi, thanks for your work.
I get the mesh of lego using mesh_nerf.py

I wonder can I get the color of it, say a .tex file?
Thank you!

Speedup

How much speedup do you get using your ray AABB intersection?

How does it compare to this work, which uses a similar approach?

How to normalize a tensor to [-1,1] in tensorflow???

What is the function of your function? Is this to normalize the tensor to lie between [-1, 1]?How to normalize a tensor to [-1,1] in tensorflow???

frequency_bands = torch.linspace(
2.0 ** 0.0,
2.0 ** (num_encoding_functions - 1),
num_encoding_functions,
dtype=tensor.dtype,
device=tensor.device,
)

Weird errors when training and extracting mesh

Hi, I'm not sure this repo is still maintained, but I'll try. I get two weird errors both when I try to extract the mesh and when I train a new model. More specifically:

The following command: python train_nerf.py --config ../config/nerf-synthetic-lego.yml produces the following output:

Logger initiated...
Current log dir ../logs/nerf-synthetic-lego/default/version_2
Traceback (most recent call last):
  File "/localhome/c-morsingher/nerfmeshes/src/train_nerf.py", line 108, in <module>
    main()
  File "/localhome/c-morsingher/nerfmeshes/src/train_nerf.py", line 62, in main
    model = getattr(models, cfg.experiment.model)(cfg)
  File "/localhome/c-morsingher/nerfmeshes/src/models/model_nerf.py", line 25, in __init__
    super(NeRFModel, self).__init__(cfg, *args, **kwargs)
  File "/localhome/c-morsingher/nerfmeshes/src/models/model_base.py", line 21, in __init__
    self.hparams = flatten_dict(cfg, sep=".")
  File "/localhome/c-morsingher/anaconda3/envs/nerf/lib/python3.9/site-packages/torch/nn/modules/module.py", line 1225, in __setattr__
    object.__setattr__(self, name, value)
AttributeError: can't set attribute

The following command: python mesh_nerf.py --log-checkpoint ../pretrained/colab-lego-nerf-high-res/default/version_0/ --checkpoint model_last.ckpt --save-dir ../data/meshes --limit 1.2 --res 480 --iso-level 32 --view-disparity-max-bound 1e0 produces the following output:

Current log dir ../pretrained/colab-lego-nerf-high-res/default/version_0
Loading model from ../pretrained/colab-lego-nerf-high-res/default/version_0/checkpoints/model_last.ckpt
Traceback (most recent call last):
  File "/localhome/c-morsingher/nerfmeshes/src/mesh_nerf.py", line 278, in <module>
    model = getattr(models, cfg.experiment.model).load_from_checkpoint(path_parser.checkpoint_path)
  File "/localhome/c-morsingher/anaconda3/envs/nerf/lib/python3.9/site-packages/pytorch_lightning/core/saving.py", line 156, in load_from_checkpoint
    model = cls._load_model_state(checkpoint, strict=strict, **kwargs)
  File "/localhome/c-morsingher/anaconda3/envs/nerf/lib/python3.9/site-packages/pytorch_lightning/core/saving.py", line 198, in _load_model_state
    model = cls(**_cls_kwargs)
TypeError: __init__() missing 1 required positional argument: 'cfg'

Any idea on why this happens and how to solve? Thank you in advance.

Is there a way to visualise the Axis-Aligned Bounding Boxes?

Hello,

I was curious if I could see the AABB's while training, similar to the way it's shown in this projects readme

PS: This is an amazing work. Thank you for sharing.

instead of your function 'torch.linspace()

Can I use the function 'inputs_normal = inputs/tf.reduce_max(tf.abs(inputs))' to instead of your'torch.linspace() '? Because they can all normalize tensor to [-1,1].

Extracted fern mesh with appearance

hi,thank you very much for your work, but I have encountered a problem here, when I generate the mesh of fern, I get this kind of graph, what is this situation, I would appreciate your advic!!!

e

Recommend Projects

React

A declarative, efficient, and flexible JavaScript library for building user interfaces.
Vue.js

🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
Typescript

TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
TensorFlow

An Open Source Machine Learning Framework for Everyone
Django

The Web framework for perfectionists with deadlines.
Laravel

A PHP framework for web artisans
D3

Bring data to life with SVG, Canvas and HTML. 📊📈🎉

Recommend Topics

javascript

JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
web

Some thing interesting about web. New door for the world.
server

A server is a program made to process requests and deliver data to clients.
Machine learning

Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
Visualization

Some thing interesting about visualization, use data art
Game

Some thing interesting about game, make everyone happy.

Recommend Org

Facebook

We are working to build community through open source technology. NB: members must have two-factor auth.
Microsoft

Open source projects and samples from Microsoft.
Google

Google ❤️ Open Source for everyone.
Alibaba

Alibaba Open Source for everyone
D3

Data-Driven Documents codes.
Tencent

China tencent open source team.