AI-powered Motion Interaction for 3D Cultural Heritage

Abstract

Museums and cultural institutions, in general, are in a constant challenge of adding more value to their collections. The attractiveness of assets is practically tightly related to their value obeying the offer and demand law. New digital visualization technologies are found to give more excitements, especially to the younger generation as it is proven by multiple studies. Nowadays, museums around the world are currently trying to promote their collections through new multimedia and digital technologies such as 3D modeling, Virtual Reality (VR), Augmented Reality (AR), serious games, etc. However, the difficulty and the resources required to implement such technologies present a real challenge. Through this poster, we propose a 3D acquisition and visualization framework aiming mostly at increasing the value of cultural collections. This framework preserves cost-effectiveness and time constraints while still introducing new ways of visualization and interaction with high-quality 3D models of cultural objects. Our framework leverages a new acquisition setup to simplify the visual capturing process by using consumer-level hardware. The acquired images are enhanced using frame interpolation and super-resolution. A photogrammetry tool is then used to generate the asset 3D model. This model is displayed in a screen attached to the leap motion controller which allows hand interaction without having to deal with sophisticated controllers or headgear allowing almost natural interaction.