Volumetric video: Capturing digital twins

• Author:
• Author name

  Quantumrun Foresight
• September 15, 2022

Insight summary

Volumetric video technology is transforming our online experiences by creating more immersive and realistic digital environments. This technology captures and streams three-dimensional representations of objects and environments, allowing users to view them from every angle. Volumetric video's potential extends to creating lifelike online interactions and digital twins, promising significant changes in how we engage with digital content and each other.

Volumetric video context

Virtual and augmented reality (VR/AR) technologies, combined with volumetric video technology, open doors to online experiences that could surpass what we currently perceive as realistic. Volumetric video captures three-dimensional (3D) footage of objects and environments in real-time, creating a comprehensive and interactive digital representation. These representations can then be streamed to the internet or VR platforms, offering users a more immersive experience. A practical example of this was in March 2022 when the National Basketball Association utilized volumetric video to transform a game between the Brooklyn Nets and Dallas Mavericks into a three-dimensional experience, termed the "Netaverse."

The process of creating volumetric videos involves the use of multiple cameras to record scenes from different angles. After recording, these scenes undergo a sophisticated processing technique to construct a series of three-dimensional models. Unlike 360-degree videos, which only allow viewers to look around in all directions without depth, volumetric videos provide a full 3D representation, enabling viewers to see objects and environments from every conceivable angle.

Volumetric video technology has significant implications for various industries and sectors. In sports training and analysis, volumetric video technology can provide athletes and coaches with advanced tools for performance enhancement. By capturing detailed three-dimensional footage of athletes in action, coaches can analyze movements, techniques, and strategies more effectively. 

Disruptive impact

Volumetric video technology offers businesses the ability to accurately replicate human movements and emotions in a three-dimensional format, enhancing the realism of digital portrayals. This capability is particularly beneficial for large-scale companies, where direct interaction between top management and employees is challenging due to the company size. Through volumetric videos, employees can have a virtual one-on-one experience with their CEOs and management teams, fostering a sense of connection and understanding despite physical distances. Furthermore, these technologies enable companies to develop immersive training programs. Tailored specifically to their operational needs, these programs can utilize real-life scenarios and examples, making the training process more effective and engaging.

In customer engagement, volumetric video technology is poised to transform how businesses interact with their clientele. For example, in the hospitality industry, companies can employ volumetric videos in conjunction with VR/AR to showcase their services and amenities in a more immersive and engaging manner. This approach is particularly effective for digital tours, where potential customers, regardless of their physical location, can enjoy realistic and tactile experiences. 

In education, this technology can provide students with highly interactive and lifelike educational content, enhancing their learning experiences. Similarly, in healthcare, volumetric video could revolutionize patient care and medical training by offering detailed, three-dimensional representations of medical conditions and procedures. Moreover, as this technology becomes more accessible and widespread, its impact on entertainment, communication, and even social interactions is likely to be significant, offering new and exciting ways for people to connect and share experiences.

Implications of volumetric video

Wider implications of volumetric video may include: 

• Its use in the Metaverse to build hyper-realistic online experiences, such as virtual concerts, museums, and group gaming.
• Its combination with holographic technology to generate more lifelike holograms for entertainment or business communications purposes.
• The entertainment industry expanding to 4D experiences by capturing tactile, audiovisual experiences and advanced emotional and sensual realism.
• Future consumer-grade volumetric cameras that enable new forms of photography and video content.
• Companies creating digital twins of products and locations that allow customers to inspect products or tour facilities (and real estate) remotely.
• Increasing pressure for governments and organizations to regulate digital twins that will be used in volumetric videos, particularly regarding individual consent and privacy.

Questions to consider

• What happens if a person, place, or thing is recorded by volumetric video without permission?
• What are other potential challenges and opportunities in using volumetric videos?