Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

When use the VOLDOR on a new dataset,i have a question #28

Closed
betterCZ101 opened this issue Apr 11, 2023 · 7 comments
Closed

When use the VOLDOR on a new dataset,i have a question #28

betterCZ101 opened this issue Apr 11, 2023 · 7 comments

Comments

@betterCZ101
Copy link

when use the VOLDOR on a drone dataset,i could work, but when mapping, there are some frames track lost,and the mapping
result is below.
Could you please help me analyse the question or just give some advice to solve the question?

79d31ec4-b3f7-47f6-b2c3-52c044c51598

@htkseason
Copy link
Owner

I assume the dataset is monocular. Some ideas you may try:

  1. Make sure the first two frames have sufficient baseline, since the world scale is initialized from there.
  2. Check calibration. When resizing input size, optical flow vectors and intrinsics need to be scaled accordingly. Also try to adjust [basefocal], see README [How to pick basefocal].
  3. When estimating optical flows, skip those frames with very small changes.

If you see the depth map gradually truns from a reasonable one to all white/black, it is the scale drift. In this case, you may want to try COLMAP, which is very good at monocular, although not real-time.

@betterCZ101
Copy link
Author

Hi, Thanks for your advice, we found that the PWCNet we used have some problem leading to the poor performance of the results. So for the better and easier understanding of your excellent work, we just use the mono pattern using the demo data you provided. considering the advice you provided, we got the results below:
1280X1280 (2)
1280X1280 (2)

We elaborately to adjust the "basefocal", but the results is disappointing.
By the way, we meet the same question as the #23 "Error: Loop closure not available. Cannot load pyDBoW3 module."
Thus, if the disappointing result is caused by the lack of the loop closure or just there need some auxiliary information to improve the performance of the mono.

Any another two questions:
1.we just change the parameter "basefocal" 182 to 181 the results have changed a lot.
1280X1280 (1)

7d9d556a-bdf0-431a-9144-580ada0796cc

2.according to the first advice, the "sufficient baseline" if is the parameter "basefocal" or it is another?

@htkseason
Copy link
Owner

Thank you for reporting the results!

The results you shown are reasonable w/o loop closure. The monocular setup has scale drift, which needs loop closure to enforce the global consistency. While changing the basefocal could also affect the drift pattern.

In our CVPR submission, we enforce the scale consistency with ground plane estimation. (detailed in first section in appendix) I kept the function "estimate_kitti_ground_plane" in geometry.cpp, but not using it anymore. Running our system under stereo mode and providing disparity estimations can also eliminate the drift.

Please let me know if you have more questions.

@betterCZ101
Copy link
Author

So, with respect to the the iusse#23 "Cannot load pyDBoW3 module. this problem: I have put pyDBoW3 in my workspace, but pyDBoW3 cannot be loaded" is there any solution ?

@htkseason
Copy link
Owner

Maybe try 1) put it under different paths (e.g. current path / path of demo.py / path of voldor_slam.py) or 2) use "pip install" to install it into python libs.

@betterCZ101
Copy link
Author

hi, it doesn't work, and i infer that it the libboost is not compatible. I install the ubuntu 18.04 from scratch. When i use the command"python setup_win_vo.py build_ext -i", it has the error"gcc: error:/wd4819: No such file or directory", if the gcc version is not suitable? i use the gcc5.5 and gcc7.0 ,both have the problem.

@betterCZ101
Copy link
Author

the problem above i have finished. And i have make the whole process successfully. and i have other questions.
1.In the stereo pattern with loop closure, the squence 03 is just a trajectory can't meet the condition of the loop closure, namely the car did not come back around the same place, why the result had improved compared to that without the loop closure?
89664ac5-d156-4fb7-bd8c-a6dbd8051919

16b1e4ee-593a-4dc9-986e-b8c31a424d18

2.In the mono pattern with loop closure, why the result of squence 05 like above, is there any solution?

5780847a-ff7e-40a0-a3d1-4670441fe64c

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants