jack06215
9/30/2016 - 6:42 AM

Research summary note, 20160930

Research summary note, 20160930

Weekly Meeting

Meeting minutes

During the meeting we discussed about the overview of SfM and in our case we can utilised the similar approach to build our own pipeline in order to realise the tracking component of our AR project. An interested discussion during the meeting is that we agreed on how traditional tracking algorithm is not exactly what we are looking for. Instead, our tracking needs to deal with geometric transform up to "prespective" level. Also, majority of state-of-art on camera motion estimation rely on finding the optimal solution for correspondance matching. Our argument point, or perhaps our thought is that, for a given correspondance result we can ramdomly extract 4 lines and deduce a homography, "Is there anyway to pick up the most highest confidence score 4 lines from the correspondance pool"?

Things to do

  • Take a short street view footage, and use this video to the demo programs (TLD, fern and optical-flow based) to see the overall result.
  • Ingestigate in "Ranking the best correspondance". The concept behind it is to deduce a homography using those with "highest" score so the result could be improved compared to the tradidional "using all points" especially in case there are false inliers matches.
  • Investigate in "Fast Keypoint, 2010", especially for the training part.

Tutorial resources

Useful Resources

Programming Library Resources

  • Theia Lirary

    A C++ library to provide SfM implementation, haven't personally try it yet but sounds interesting.

  • Matlab Computer Vision tool

    A set of useful computer vision functions by Peter Kovesi.

  • Dlib

    Lightweight library that provide machine learning and computer vision functions. I am currently using this as part of C++ implementation for master project.

Previous record

20160906