r00tman / eventnerf Goto Github PK
View Code? Open in Web Editor NEWNeural Radiance Fields from a Single Colour Event Camera [CVPR 2023]
Home Page: https://4dqv.mpi-inf.mpg.de/EventNeRF/
Neural Radiance Fields from a Single Colour Event Camera [CVPR 2023]
Home Page: https://4dqv.mpi-inf.mpg.de/EventNeRF/
How to use other event camera datasets (like https://daniilidis-group.github.io/mvsec/ and https://dsec.ifi.uzh.ch/) as model input?
could you provide "genevents_color_altbg.py"? I want to create my own event data to test
Hi, I have two questions regarding the real sequences.
data/real/legocube/train
for example, events and RGB are not aligned.r_00000.png
= 0sec, r_00001.png
= 0.001sec),(Please ignore the wrong color of the RGB, it's basically because of my visualizer. What I want to ask is the alignment between frame data and event data.)
plant
, chick
, mic
) look like just legocube. Can you double check if you upload image data correctly?Or am I doing anything wrongly?
Best,
Shintaro
Nice work, I have a question about the training.
In your paper, you train the model for 5 * 10^5 iterations. However, N_iters in config.txt is set to 5000001. What is the correct number of parameters?
This is a awesome work! But I meet some trouble that I can't resolve.
Collecting package metadata (repodata.json): done
Solving environment: failedResolvePackageNotFound:
- ipython==7.30.0=py39hf3d152e_0
Hi, thank you for the dataset.
When I load the event npz file, the timestamp looks strange (all integers). What's the actual unit of the timestamp?
import numpy as np
fname = '/home/ubuntu/slocal/ssd_data/EventNeRF/data/lego/test1_events/test/events/out.npz'
with np.load(fname) as data:
ts = data['t']
ts[:10] # returns array([0, 0, 0, 0, 0, 0, 0, 0, 0, 0])
ts[-10:] # returns array([999, 999, 999, 999, 999, 999, 999, 999, 999, 999])
len(np.unique(ts)) # returns 1000
ts.max() # returns 999
I suspect that this integers [0-999] corresponds to the number of frames.
If that is the case, this dataset does not contain accurate event timestamps, but rather has the ones quantized to the frame IDs?
Hi, thanks for the great work.
I have noticed that the real-world data file that has been released does not include the paired RGB data, which was utilized in the paper to assess deblur-nerf. Is it feasible to make this portion of the data available? It would be immensely beneficial for evaluating other nerf-based techniques on this dataset.
Hello, I reproduced your experiment, currently testing on the lego dataset, all the parameters have not been touched, but I found that even if I iterate to 1 million times, I can't achieve the effect of PSNR25 in the paper, in fact it is only about 17, why is that? The parameters are kept the same as in your github repository.
Hi
I tried scripts: job_nerf_lego.sh and job_nerf_drums.sh with V100 GPU, after 6 hours the psnr was still around 10 I wondered did I do anything wrong. How can I get the number from the table on paper?
Best
A declarative, efficient, and flexible JavaScript library for building user interfaces.
๐ Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
An Open Source Machine Learning Framework for Everyone
The Web framework for perfectionists with deadlines.
A PHP framework for web artisans
Bring data to life with SVG, Canvas and HTML. ๐๐๐
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
Some thing interesting about web. New door for the world.
A server is a program made to process requests and deliver data to clients.
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
Some thing interesting about visualization, use data art
Some thing interesting about game, make everyone happy.
We are working to build community through open source technology. NB: members must have two-factor auth.
Open source projects and samples from Microsoft.
Google โค๏ธ Open Source for everyone.
Alibaba Open Source for everyone
Data-Driven Documents codes.
China tencent open source team.