Comments (2)
These are both dataset-dependent.
How they're computed in the typical Nerfstudio pipeline might be helpful:
nerfstudio/nerfstudio/pipelines/base_pipeline.py
Lines 271 to 272 in 3e2271a
If you want to instantiate the model without the full pipeline, perhaps you could save these values at the start of training?
For example, you could add a few lines below where the dataparser_transforms.json
is saved:
nerfstudio/nerfstudio/engine/trainer.py
Lines 227 to 233 in 3e2271a
from nerfstudio.
Hi @brentyi ,
Thank you for your prompt and insightful response! Your suggestion about saving the necessary arguments at the beginning of training seems like a viable approach to me. However, I have a few concerns regarding its implementation:
- I'm currently utilizing the Docker image of Nerfstudio, and while cloning/forking and modifying the Nerfstudio repository is feasible, it's not the most convenient option for me.
- Considering the cost of software development, both in terms of initial feature development and ongoing maintenance, keeping a private copy of this repository with modified file nerfstudio/engine/trainer.py might be challenging. This is especially true if Nerfstudio undergoes significant updates later, and it could also pose difficulties in sharing my work with others.
Given these considerations, I’m leaning towards alternative strategies that might better suit a collaborative engineering environment. Here are my thoughts:
- Integration with MLflow's Experiment Tracking: Instead of utilizing MLflow’s model registry, I'm considering integrating Nerfstudio with MLflow’s experiment tracking feature. This would involve wrapping the entire Nerfstudio pipeline in an MLflow experiment run and logging the complete training dataset and outputs directory as artifacts of MLflow experiment run. Organizing and tagging runs, rather than models in the model registry, could be a more effective strategy.
- Potential Pull Request: Another option could be for either of us to create a Pull Request to implement your suggested change, saving the required arguments in the outputs directory at the start of training. However, I'm concerned about whether the feature of allowing users to instantiate a trained model outside of a pipeline would be broadly useful or if it might lead to unintended complexities in the repository.
- PyTorch Lightning Integration: A more labor-intensive solution could involve rewriting the PyTorch models in the repository to use PyTorch Lightning trainers (here is a link to the PyTorch Lightning docs in case you are unfamiliar with this tool). This would allow users to leverage MLflow’s auto-logging feature for PyTorch Lightning, but it represents a significant overhaul of the current system.
For now, I plan to proceed with the first option and integrate Nerfstudio with MLflow’s experiment tracking. I'll be closing this issue, but your feedback has been invaluable. Please feel free to share any further thoughts you have on this matter. You're also welcome to reopen this issue and tag me if you’d like to discuss the possibility of a Pull Request in more detail.
Thanks again for your valuable input! 🙏 👏
from nerfstudio.
Related Issues (20)
- Adding a New Method: Different (bad) Results than nerfacto while trying to inherit from nerfacto HOT 6
- Nerfstudio release v1.1.3 for breaking bugs HOT 2
- Can you introduce the new methods used by Splatfacto
- @torch_compile() for function get_viewmat() cause the bad training results. HOT 1
- ns-export gaussian-splat bug HOT 2
- How does nerfstudio obtain explicit output
- Error when using get_viewmat with @torch_compile() on Nvidia Orin NX HOT 3
- Integrate SAM model with Nerfstudio HOT 2
- Prefilter the invisible 3DGS before splatting on images
- "Downloading and Processing Data" section in Collab Notebook doesn't work HOT 1
- Splatfacto fails due to the model being train mode instead of eval mode HOT 1
- Georeferenced datasets processed on Metashape are loaded incorrectly/can't be loaded using splatfacto.
- Ability to disable Viser during training a nerf HOT 3
- ns-render BUG HOT 1
- Calling viewer from VS code HOT 2
- Question Regarding Image Downscaling Method HOT 1
- Rotation not applied when exporting with gaussina-splatting --obb-rotation
- Make `awscli` an optional dependency HOT 7
- zip nerf is not working 360.gin file is missing HOT 9
- Issues training pynerf (standard and synthetic)
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from nerfstudio.