Skip to content

Ideas page for MRPT Google Summer of Code 2018

Jump to bottom Edit New page
Hunter Laux edited this page Jan 15, 2018 · 21 revisions

Table of contents

Important information for Students

  • GSoC website. It is fundamental to read all rules and documents from Google before writing a proposal.
  • GSoC mailing list: You can ask general questions here.
  • GSoC timeline
  • TBD: Students can apply in this period only!

Being accepted as a GSoC student is a quite competitive process. Please, if you wish to submit a proposal, consider becoming familiar with the involved technologies first. Simply copying and pasting from this page will not be accepted.

How you will be evaluated if you are an accepted student

Student projects will be paid only if:

  • 1st phase (TBD): A pull request is requested that...
    • Builds, ideally in travis-ci
    • Has, at least, stubbed out new functionality
  • 2nd phase (TBD): A pull request is requested that...
    • Same as above, plus:
    • Code has appropriate Doxygen documentation
    • Has a stubbed out example/tutorial/ROS launch file that builds/runs without errors
    • It observes the recommendations in "How to contribute", which include C++ style suggestions.
  • Final phase (TBD):
    • A complete pull request that builds, full Doxygen documentation, unit test if applicable, complete functionality.
    • A video (e.g. on YouTube) demonstrating your code.

Students interested in applying

  • You must already be proficient in C++.
  • Take your time to learn about MRPT. Try watching some YouTube videos, reading tutorials, downloading it and launching demo applications, for example. Getting familiar with ROS and MRPT ROS packages would be a plus.
  • Take a look at the projects in the "GSoC ideas page". Discuss those of your interest, or your own ideas, in the MRPT forum/mailing list.
  • Read carefully about Google's student eligibility rules.
  • # in GSoC and post your project proposal to the MRPT Organization. Your proposal should include:
    • A coding portfolio of past/current projects.
    • Your GitHub/GitLab/... username.
    • A detailed description of your project proposal, including initial plans for research directions and a list of key and optional features to be coded as time permits.
    • Will you be working full-time on the project during the summer? Will you have other commitments too (a second job, classes, etc)?
    • Why do you feel motivated to undertake this particular project? :-)

Rules say that all communications between students and mentors should happen in public: please, use the MRPT mailing list or GitHub comments in pull-requests or commits whenever possible, before and during GSoC.

Update: We have created a slack channel for answering questions and providing feedback during the GSoC period. You can # using https://mrpt-gsoc.herokuapp.com/

Ideas list for GSoC

MRPT provides developers with portable and well-tested applications and C++ libraries covering data structures and algorithms employed in common robotics research areas. ROS (Robot Operating System), supported by the OSRF, provides libraries and tools to help software developers create robot applications. It provides hardware abstraction, device drivers, libraries, visualizers, message-passing, package management, and more.

List of potential mentors (pairing of projects to mentors will be done when Google decides the number of slots assigned to MRPT):

Project #1: Web-based UI

  • Brief description: Robots are quickly becoming part of the Internet of Things. Naturally, a web-based UI is ideal for an Internet connected robot. The additional mrpt-web library will be developed as a separate library to compliment the current mrpt-2.0 libraries. It will provide additional functionality for sending MRPT data-structures between the c++ and html5. Boost has recently released beast, which implements http(s) and websockets. The library must utilize boost beast without exposing too many details of boost to the rest of mrpt. Additionally there must include a front-end web application written in VueJS capable of visualizing 3D data in real time over a websocket. Bonus: Make it capable of driving around and controlling a real robot.

  • Expected results: At least two applications. The applications may be web-based clones similar to a current wxwidget applications. At least one application must be able to render robot poses, observations and maps in 3D using real-time data.

  • Knowledge prerequisites: C++, WebSockets, REST, MVC, JavaScript(e.g. VueJS, socket.io), WebGL

  • Difficulty level: Middle

Project #2: Port mrpt::gui GUI classes from wxWidgets to Qt

mrpt_screenshot_example_opengl_objects_demo

  • Brief description: MRPT offers C++ classes under mrpt::gui for easily prototyping command-line apps capable of 2D and 3D rendering, without having to worry about message loops, multithreading, etc. All this runs behind scenes. At present, MRPT classes built upon wxWidgets GUI components. However, there exist other nice Qt alternatives, especially for 2D plots, so porting the code to Qt would be a great improvement.
  • Expected results: mrpt::gui should build with wxWidgets or Qt, and the user API should be unaffected by the underlying GUI library. All existing examples and apps should compile with the new Qt GUI and run without problems.
  • Knowledge prerequisites: C++, Qt.
  • Difficulty level: Easy

Project #3: Implement a state-of-the-art graph-slam solver, SE-Sync

  • Brief description: The goal is writing a novel C++ class for optimizing graph-SLAM maps (a SLAM backend). We in MRPT do our best to bring to life cutting-edge advancements in the field of SLAM. In this case, we seek to implement a state-of-the-art solver, SE-Sync: This is the first SLAM solver providing fast and global convergence. Yes, you read well, global, no need to initialize at all and yet you will reach the best possible solution for your map. The implemented solver should fit into the current graph-slam engine framework, bringing immediately the aforementioned advantages to the resolution of large-scale SLAM problems. Because of this, the output of this project should become an invaluable tool for practical roboticists.

A more or less detailed roadmap for the development of the desired solver follows:

  1. Getting familiar with the theoretical approach. The solver to implement, SE-Sync, is a very recently proposed approach proposed at WAFR16, where it obtained the best paper award. In arxiv you may find the conference paper as well as an extended technical report with the approach. A video recording of the presentation at the conference is available as well. Note the theory behind the solver relies on Riemannian geometry and related techniques, BUT you need not to be scared: The hardest part occurs behind the scenes so you will not need to know to much about the topic of Riemannian optimization (just the basics). In addition, you can find a Matlab implementation to play with.

  2. Once you have a look at the materials above and get an idea of what we are heading for, you should definitely be thrilled about the potential outcome of this project. We are :) So next comes porting this exciting stuff into a clean and efficient C++ implementation the MRPT community can benefit of seamlessly. The main required steps to achieve this are:

  3. Create a novel CPoseSync class that fits the generative model exploited in SE-Sync. Difficulty: Easy

  4. Implement the new optimization method, mrpt::graphslam::optimize_graph_Sync, akin to the current mrpt::graphslam::optimize_graph_spa_levmarq, with the SE-Sync approach. This is where the magic should happen: Given a graph consisting of a mrpt::graphs::CNetworkOfPoses with poses of the newly defined CPoseSync type, the method should follow the SE-Sync algorithm to solve the globally optimal estimate of the map. Some very useful hints are:

    • The Matlab implementation of SE-Sync strongly relies on the Manopt toolbox for applying Riemannian optimization behind the scenes, with a minimal understanding of what's going on.
    • Luckily, the corresponding recent library ROPTLIB provides the same functionality in C++. The most appropriate approach we expect you to take is, then, to adapt the Matlab code of SE-Sync into C++ by means of ROPTLIB, and then the additional dependency on ROPTLIB should be safely introduced into MRPT as a result. This will require you to get a minimal user-level understanding of these two libraries (Manopt and ROPTLIB), which come with plenty of working examples. Additional links with related resources will be given below. Difficulty: Medium/high

  5. To make this solver usable in a practical framework, provide a new specialization of mrpt::graphslam::optimizers::CGraphSlamOptimizer, mrpt::graphslam::optimizers::CSyncGSO, akin to mrpt::graphslam::optimizers::CLevMarqGSO, that interfaces the solver with the graph-slam engine (mrpt::graphslam::CGraphSlamEngine). Difficulty: Easy

Resources: Some useful resources in the different directions of the project follow:

Start studying the "C++ code" section of Graph-SLAM in MRPT, and have a thorough look into mrpt::graphslam::optimize_graph_spa_levmarq to gain insight into the common classes and syntax used by MRPT in the context of Graph-SLAM. Once you get this reference, familiarize yourself with the SE-Sync work and specially with the Matlab implementation of SE-Sync, planning how to port the key ingredients of SE-Sync into the MRPT framework. Finally, once the structure of the new MRPT method has been designed, we will implement the necessary auxiliar classes within MRPT, add the dependency ROPTLIB and put all the pieces together.

  • Expected results: The new method should be able to solve test Graph-SLAM instances by calling the graph-slam application on text graph files (there is plenty of these available on the Internet). The new method should be also eligible from the graph-slam engine aplication, making it useful for more complex and reallistic datsets provided in the MRPT rawlog format.

Note that the code above should be templatized for handling both 2D and 3D cases at once. Also note that, in order to keep the integration within MRPT and dependency issues simpler, the present project should be addressed as a novel repository (within the MRPT organization, such as the SRBA module).

The outcome of the proposed project should constitute the first certifiably globally optimal C++ solver for Graph-Solver, and as such has a high potential for publication of the results in renowned robotics conferences, in case that is a plus for you :)

IMPORTANT NOTE: Given the complexity of this topic, we ask potential candidates to provide some real C++ examples (e.g. via GitHub, GitLab repo) that build cleanly and solve some related but simpler problems involved in this project. Please follow the guidelines in this document.

  • Knowledge prerequisites: C++, graphSLAM
  • Difficulty level: Middle/High

Project #4: GUI app for extrinsic calibration of visual and range sensors:

  • Brief description: Using a combination of several sensors in a robotic platform is a common approach to obtain relevant information of the robot environment. This information is put into a common frame of reference by means of the extrinsic calibration of the sensor system, i.e. the relative 3D poses of the different sensors. The objective of this project is to build a GUI application to estimate the extrinsic calibration of different types of sensor systems from their own readings (the observation of the scene provides useful information to find the extrinsic calibration). In order to obtain the extrinsic calibration, a cost function is usually minimized depending on geometric restrictions using scene features (like lines and planes) or sensor ego-motion (the motion of each sensor is estimated independently and their trajectories are matched to obtain the extrinsic calibration), as described in the papers by Brookshire and Teller and Taylor and Nieto.

  • Expected results: A new GUI application that opens a rawlog file containing a sequence of observations from several sensors (e.g.: a set of range cameras, a set of 2D range sensors (LiDARs), or a RGB and a range camera). The implementation of these examples using both scene features and ego-motion is required in this project. The app must show a 3D reconstruction of the scene using the computed calibration (when possible). The app must also allow the user to switch the calibration method, when several calibration methods can be applied to a particular sensor system, to compare visually their results.

  • Knowledge prerequisites: C++, OpenCV, computer vision, GUI design (Qt or wxWidgets)

  • Difficulty level: Middle

New project template:

  • Brief description:
  • Expected results:
  • Knowledge prerequisites:
  • Difficulty level:
Add a custom footer
Add a custom sidebar
Clone this wiki locally