Do you remember the first time you took a virtual tour of a museum or historical building? The excitement, the curiosity, the feeling of almost being there yourself? Unfortunately, those days are over.
Traditional virtual tours with panoramic images strung together seem outdated and boring today. They offer no real immersion, no emotion and no interactivity. Users click from one point of view to the next without having the feeling that they are really moving around the room.
Matterport is a widely used platform for virtual tours, but the technology is proprietary and comes with significant limitations. The data created with Matterport cannot be further processed or used for other applications such as WebGL or Unity, as it remains in a closed system.
The system is based on a low-end 3D scanning technology that works with structured light and depth cameras. This creates a rough point cloud of the room, which is overlaid with panoramic photos to create an apparent 3D representation. However, movement remains severely restricted as Matterport only supports predefined viewpoints.
This is where a new technology comes into play that has the potential to revolutionize virtual tours: Gaussian splatting. This technology enables highly realistic 3D models of rooms and buildings that can not only be viewed statically, but can also be freely explored.
Gaussian splatting is based on the representation of 3D objects using a large number of tiny particles, so-called "Gaussians". These particles are arranged in such a way that they perfectly reproduce the surface of the object. The combination of millions of such Gaussians creates a photorealistic 3D model that can be rendered in real time.
Gaussian Splatting is an advanced 3D rendering technology based on a point cloud-based representation with Gaussian filters. Millions of tiny "Gaussians" are used to create a realistic surface reconstruction. This technology makes it possible to create photorealistic 3D models of environments or objects that can be rendered in real time and viewed from any perspective.
In contrast to Matterport, which is based on panoramic photos with a superimposed depth map, Gaussian Splatting works with a complete volumetric 3D reconstruction. While Matterport only allows discrete viewpoints, Gaussian Splatting allows continuous movement in space. In addition, Matterport is a closed system with proprietary data formats, while Gaussian Splatting offers open export options in standard 3D formats that are compatible with applications such as Unity, Unreal Engine or WebGL.
To create a Gaussian splatting model, a high resolution camera is required, preferably with a combination of RGB and depth capture. In many cases, photogrammetry techniques or LIDAR scanners are used to capture a precise point cloud of the object or environment. Rendering is usually done on a powerful GPU, as the calculation and real-time visualization of millions of Gaussian-based points requires high computing power.
Gaussian splatting data can be exported in open formats such as PLY. This enables further processing in 3D engines such as Unity and Unreal Engine or use in WebGL-based applications such as Playcanvas. In addition, special algorithms and machine learning approaches can be used to make further improvements to textures, lighting and performance optimization for various platforms.
Gaussian splatting is suitable for a wide range of industries. In the architecture and real estate sector, it enables realistic building inspections and detailed digital twins. In the tourism sector, historical sites or natural wonders can be realistically reconstructed. Museums and educational institutions benefit from interactive experiences, while precise 3D models are used in industry for maintenance, planning and simulation. The technology is also used in virtual production and the film industry to create photorealistic environments quickly and efficiently.
Are you interested in developing a virtual reality or 360° application? You may still have questions about budget and implementation. Feel free to contact me.
I am looking forward to you
Clarence Dadson CEO Design4real
