MoveIt: Indoor Manipulation

Project Specifications

Project Reports:

Project Specifications: Project Specifications

Analysis Report: Analysis Report

Design Report: Design Report

Low Level Design Report: Low Level Design Report

Final Report: Final Report

Project Members: Pınar Ayaz, Barış Can, Faruk Oruç, Ünsal Öztürk, Mert Soydinç

Project MoveIt: Indoor Manipulation aims to develop an application which will semantically reconstruct the geometry of indoor areas, such as a living room or a kitchen, in 3D by using videos, live scans/feed obtained from the camera of a mobile device. The 3D reconstruction process will produce a 3D scene and will label the reconstructed objects and geometry semantically by attaching a semantic label to each object. It will also allow the users of the application to manipulate the scene by allowing the users to move, rotate, scale, and deform the geometry of the objects. Texture obtained from the live feed will also be mapped to the corresponding meshes. The application will store the 3D reconstruction information along with the texture, label, and mesh information of a given object on a database for later data analytics and machine learning purposes, and will be open to the public as a labelled set of 3D objects, which may be suitable for supervised learning purposes.