Learning through experience (AR-Faszinaturen)

The aim of the project is to clearly convey a basic understanding of topics such as size, mass, gravity, stability, distances and much more. The basis is formed by haptic models that represent the actual proportional mass of their “originals” (Eiffel Tower 12cm=1g; Earth 13cm=6kg). By expanding into augmented reality (AR), the aim is to create a learning experience that combines the haptic and digital worlds.

Users should interact with content via the AR application and thus explore the knowledge in a playful way and learn independently. This includes not only overlays directly on the models, but also virtual objects and content next to the mass models in free space. This is a challenge, especially when there is a large distance between the mass model and the virtual content, as it must be assumed that the mass model is not permanently in the camera image of the output device.

The aim of the project is to develop an AR application that recognizes the haptic models robustly, without delay and thus stably and can display content on the haptic model via a tablet and/or a smartphone. A particular challenge is the development of a real-time tracking system that robustly enables all 6 degrees of freedom in space by capturing the mass model in combination with spatial tracking.