Comments (8)
The Problem
While doing a customized run with
python main.py --video_file {...} --path {...} --batch_size 2 --make_video
, I'm getting the following error in terminal:************************************ **** Compute per-frame scales **** ************************************ Traceback (most recent call last): File "main.py", line 13, in <module> dp.process(params) File "/home/aeverless/Desktop/content/consistent_depth/process.py", line 117, in process return self.pipeline(params) File "/home/aeverless/Desktop/content/consistent_depth/process.py", line 62, in pipeline valid_frames = calibrate_scale(self.video, self.out_dir, frame_range, params) File "/home/aeverless/Desktop/content/consistent_depth/scale_calibration.py", line 242, in calibrate_scale os.path.dirname(scaled_depth_fmt), ".raw" File "/home/aeverless/Desktop/content/consistent_depth/scale_calibration.py", line 142, in check_frames assert frame_names is not None AssertionError
Setup
I'm running Pop!_OS 20.10 with the following setup:
- CPU: i5-8400
- GPU: GTX 1660 Super
- RAM: 16GB DDR4
- CUDA: 11.2.0
- Graphic Driver: Nvidia 460.32.03
Context
I have followed the steps in Readme and Google Colab, successfully reproducing the result (although with lowered batch size) as shown in the demo — thus I think that the issue lies in Colmap or the way that I have it installed, which I installed by running
install_colmap_ubuntu.sh
.Installing it was painful, however, when I tried to reinstall it by a different method — my system seemed to hang forever on the
make -j
step (the same was for building ceres-solver) and I had to cold reboot (REISUB
) my system. At that point I had to scrap this method, and I stuck with the script provided with this repository.I have also ran the
setup
/install
shells in flownet2, and even recloned it from the flownet2-pytorch repo afterwards, trying to fix this problem I'm having.Right now I am at the point that Colmap is installed and it seems to work fine (at least it does respond to the
-h
andgui
opens the GUI), butframe_names
still seems to beNone
. I have reviewed some of the code to try and figure out what the problem was in, and I figured out that it checks theframe_names
from the givenframe_range
(which is unspecified in my case) to not beNone
, and based on the result of this check it then creates several folders in thehierarchical
directory and proceeds the work. My current result folder looks like this:
colmap_dense color_down color_down_png color_flow color_full depth_mc frames.txt R_hierarchical2_mc
R_hierarchical2_mc
containsB0.1_R1.0_PL1-0_LR0.0004_BS2_Oadam
folder, inside which is an emptycheckpoints
directory.
I'm having this same issue @aeverless, did you find a solution?
from consistent_depth.
@mattbev no I didn't. I still believe that the issues lies in Colmap or the way I installed it (because the demo was successfully done) and I'll try something else but as for now I'm hoping that the devs will answer. If I do lay my hands on the solution I'll of course post it here
Edit: clarifications
from consistent_depth.
@mattbev what are you running though? It might be apt to specify your setup, since it is conceivable that we just happen to be unlucky with our hardware or software choice
from consistent_depth.
@aeverless I left an issue here that describes my specific setup and error. Thanks for the update!
from consistent_depth.
@aeverless I found a workaround to this issue... for me I believe the error is a result of a colmap gpu threading issue. So my workaround is explicitly disallowing gpu threading.
if you edit the dense()
function in tools/colmap_processor.py
and insert:
cmd.extend(['--PatchMatchStereo.gpu_index', '0'])
before the final run(cmd)
, it resolves my issue. this addition adds the argument to colmap's patch_match_stereo
operation
Hope this helps!
Edit: however, I now get a seg fault during the later Fine-Tuning
step but I assume this is unrelated.
from consistent_depth.
@aeverless I found a workaround to this issue... for me I believe the error is a result of a colmap gpu threading issue. So my workaround is explicitly disallowing gpu threading.
if you edit the
dense()
function intools/colmap_processor.py
and insert:cmd.extend(['--PatchMatchStereo.gpu_index', '0'])before the final
run(cmd)
, it resolves my issue. this addition adds the argument to colmap'spatch_match_stereo
operationHope this helps!
Edit: however, I now get a seg fault during the later
Fine-Tuning
step but I assume this is unrelated.
The later error in the Fine-Tuning
step is an issue with the Mannequin Challenge (mc
) model. If I specify --model_type "monodepth2"
I don't encounter this issue
from consistent_depth.
@aeverless I found a workaround to this issue... for me I believe the error is a result of a colmap gpu threading issue. So my workaround is explicitly disallowing gpu threading.
if you edit thedense()
function intools/colmap_processor.py
and insert:cmd.extend(['--PatchMatchStereo.gpu_index', '0'])before the final
run(cmd)
, it resolves my issue. this addition adds the argument to colmap'spatch_match_stereo
operation
Hope this helps!
Edit: however, I now get a seg fault during the laterFine-Tuning
step but I assume this is unrelated.The later error in the
Fine-Tuning
step is an issue with the Mannequin Challenge (mc
) model. If I specify--model_type "monodepth2"
I don't encounter this issue
I'm glad that you've found the solution for your problem, but after trying it out I found that it doesn't work for me — the error persists as specified in the issue
from consistent_depth.
Hello, I would like to ask whether this problem has been solved. I have encountered the same problem. "Cmd.extend (['-- PatchmatchSTEReo.gpu_index ', '0'])" does not work.
from consistent_depth.
Related Issues (20)
- No module named 'networks' HOT 2
- Error : no kernel image is available for execution on the device HOT 1
- How fast is the inference? HOT 1
- Readme spelling error
- PatchMatch Problem and flownet errors HOT 1
- ERROR: 500 frames extracted, but 0 PTS entries. HOT 6
- ERROR: Could not find a version that satisfies the requirement project (from versions: none) ERROR: No matching distribution found for project
- what is the depth scale? or how do i get point clouds?
- performing dense reconstruction?
- Can U share ScanNet video format ?
- Headless mode? HOT 1
- High resolution information is not recovered HOT 1
- About Fig.5
- Precompiled colmap-packages HOT 2
- Dropbox HOT 3
- Error when running colab demo: "This algorithm is patented and is excluded in this configuration"
- FileNotFoundError: [WinError 2]
- how can i get the "depth_colmap_dense" using my own data
- Colab notebook in gone
- no access to data dropbox links
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from consistent_depth.