Help Your Embedded Systems Perceive, Navigate, and Comprehend

Table of Contents

1. Introduction
2. Intel RealSense Technology: Mimicking the Human Perceptual System
   • Visual Cortex and Scene Understanding
   • Acquiring My Videos: Vision Processing Unit (VPU)
   • Main Focus Areas: 3D Cameras, Tracking Modules, and Middleware
3. Advancements in Depth Sensors: The Realsense 400 Series
   • Introduction to DS5: Realsense 400 Series
   • ASIC Inside DS5: Improvements in Depth Perception
   • Benefits of Passive Depth Sensing
4. Overview of Depth Sensing Technologies
   • Structured Light Technology (PrimeSense)
   • Longer Range Technologies (Belly Dine LIDAR)
   • Intel's Acquisition of PrimeSense and Physics
5. Evolution of Intel's Depth Sensors
   • From LR200 to DS2/DS4
   • Increase in Compute Power: 20x Improvement
   • Resolution Enhancement: Up to 1280x720
6. Applications of Intel's Depth Sensors
   • Potential Markets for Depth Sensors
   • Embedding Depth Sensors in Various Systems
   • Focus on VR and MR (Mixed Reality)
7. Intel's Project Alloy: Innovations in VR
   • Reference Platform for VR Development
   • Inside-Out Tracking and Six Degrees of Freedom (6DOF)
   • Natural Interaction and Controllers
   • Democratizing World Creation and Content Generation
   • Collision Avoidance and Mapping
   • Social Elements in VR: Facial Expression Recognition
8. Capturing Real-World Objects in 3D
   • Scanning and Creating High-Resolution 3D Content
   • Facilitating Online Shopping and Interaction
9. Form Factors and SKUs of Depth Sensors
   • Available SKUs and their Specifications
   • Preview of a Compact and Versatile Depth Sensor
10. Conclusion and Resources
    • Contacting Intel's Marketing Team
    • Additional Resources and Links

Introduction

In this article, we will delve into the fascinating world of Intel RealSense Technology, specifically focusing on their advancements in depth sensor technology. The aim of Intel RealSense is to mimic the human perceptual system, encompassing everything from the visual cortex to scene understanding. In this rapidly evolving field, Intel has made significant progress in 3D cameras, tracking modules, and middleware. We will explore the latest developments and applications of Intel's depth sensors, with a particular emphasis on their role in Virtual Reality (VR) and Mixed Reality (MR).

Intel RealSense Technology: Mimicking the Human Perceptual System

The human perceptual system is a complex and sophisticated mechanism. Intel RealSense aims to replicate this system, enabling machines to perceive and understand the world in a similar manner. By combining advancements in hardware and software, Intel is pushing the boundaries of what is possible in computer vision.

Visual Cortex and Scene Understanding

At the core of Intel's RealSense Technology is the concept of scene understanding. Humans naturally process visual information using the visual cortex. Intel aims to replicate this by developing computational models that enable machines to deduce distance and volume from visual input. By doing so, Intel's depth sensors can provide a more accurate representation of the world.

Acquiring My Videos: Vision Processing Unit (VPU)

To facilitate the processing of visual information, Intel acquired Myriad Vision Processing Unit (VPU). The VPU plays a crucial role in enhancing the capabilities of their depth sensors, enabling faster and more efficient depth perception.

Main Focus Areas: 3D Cameras, Tracking Modules, and Middleware

Intel's focus areas include 3D cameras, tracking modules, and middleware. These components are integral to achieving seamless depth sensing and tracking in various applications. With an emphasis on hardware, Intel is constantly pushing the boundaries of what is possible in the field of computer vision.

Advancements in Depth Sensors: The Realsense 400 Series

Intel's latest advancement in depth sensor technology is the Realsense 400 Series, specifically the DS5. This advanced depth sensor leverages a specialized ASIC (Application-Specific Integrated Circuit) to deliver groundbreaking improvements in depth perception.

Introduction to DS5: Realsense 400 Series

The DS5, part of the Realsense 400 Series, is the result of Intel's continuous efforts to enhance their depth sensing capabilities. This sensor boasts significant improvements over its predecessors in terms of depth perception and processing power.

ASIC Inside DS5: Improvements in Depth Perception

The DS5's ASIC is the powerhouse that drives its enhanced depth perception capabilities. With 20 times more compute power than previous models, the DS5 is capable of perceiving intricate details and accurately mapping the surrounding environment.

Benefits of Passive Depth Sensing

One of the key advantages of Intel's depth sensors is their ability to work passively. Unlike other depth sensing technologies that rely on active light projection, Intel's sensors can perceive depth without the need for external light sources. This passive sensing enables longer range perception while minimizing power consumption.

Overview of Depth Sensing Technologies

Depth sensing technologies have evolved significantly in recent years. Alongside Intel RealSense, various methods are employed to achieve accurate depth perception and mapping.

Structured Light Technology (PrimeSense)

The PrimeSense technology, based on structured light, gained prominence with the introduction of the Kinect gaming console. This technology enabled precise depth perception by projecting a pattern of light and analyzing its deformation. While effective, structured light technology had limitations in terms of size and applicability to VR and MR headsets.

Longer Range Technologies (Belly Dine LIDAR)

To achieve longer range depth perception, technologies like Belly Dine LIDAR have been developed. These devices emit a laser Beam and measure the time it takes for the light to bounce back, enabling accurate calculations of distance. While effective for long-range perception, these systems are more expensive and less dense in terms of capturing detailed 3D information.

Intel's Acquisition of PrimeSense and Physics

In their pursuit of advancing depth sensing technologies, Intel acquired PrimeSense and Physics. These acquisitions allowed Intel to explore and incorporate different technologies into their depth sensors. By leveraging both structured light and stereo vision, Intel developed robust and versatile depth sensing solutions.

Evolution of Intel's Depth Sensors

Intel has made significant strides in the evolution of their depth sensors. From the LR200 to the DS2/DS4, Intel's depth sensors have undergone substantial improvements in compute power and resolution.

From LR200 to DS2/DS4

The LR200 marked Intel's first foray into depth sensors, showcasing their early advancements in 3D perception. However, with the introduction of the DS2 and DS4, Intel made even greater strides in terms of depth sensing capabilities.

Increase in Compute Power: 20x Improvement

One of the standout improvements in Intel's depth sensors is the significant increase in compute power. Over a span of two years, Intel has managed to enhance compute power by a staggering 20 times. This enhanced compute power enables more accurate and detailed depth perception.

Resolution Enhancement: Up to 1280x720

Alongside compute power improvements, Intel has focused on enhancing resolution. The latest DS5 sensor boasts a resolution of up to 1280x720 at 30 frames per Second, or higher frame rates at lower resolutions. This increase in resolution allows for more detailed and nuanced depth sensing.

Applications of Intel's Depth Sensors

Intel's depth sensors find application in a wide range of fields and industries. Their versatility and affordability make them ideal for integration into various systems, including vacuum cleaners, drones, tablets, and smartphones.

Potential Markets for Depth Sensors

With the aim of making depth sensors accessible to a wider audience, Intel envisions their incorporation in diverse markets. These markets include VR, MR, gaming, robotics, logistics, and more. Intel aims to provide the necessary hardware and software solutions to cater to these markets' unique requirements.

Embedding Depth Sensors in Various Systems

Intel's focus on affordability and flexibility allows for embedding depth sensors into various systems. Whether it be VR headsets, drones, or even smartphones, Intel seeks to provide depth sensing capabilities to a wide range of devices.

Focus on VR and MR (Mixed Reality)

One area where Intel's depth sensors excel is in the realm of Virtual Reality (VR) and Mixed Reality (MR). With their inside-out tracking and six degrees of freedom (6DOF), Intel's sensors enable users to move freely and interact more naturally with the virtual world. Their depth sensors, coupled with controllers, enhance immersion and enable precise interaction within the VR/MR environment.

Intel's Project Alloy: Innovations in VR

Intel's Project Alloy is a groundbreaking initiative aimed at pushing the boundaries of VR technology. Acting as a reference platform, Project Alloy serves as a testing ground for Intel's VR developments and the integration of various components.

Reference Platform for VR Development

Project Alloy acts as a reference platform, allowing developers to experiment with Intel's VR technologies. This collaboration ensures a robust ecosystem of VR devices and software, enabling seamless integration between different components.

Inside-Out Tracking and Six Degrees of Freedom (6DOF)

Inside-out tracking and 6DOF play a crucial role in providing an immersive VR experience. By accurately tracking the user's movements and interactions, Project Alloy enhances the sense of presence and realism within the virtual environment.

Natural Interaction and Controllers

While hands are an essential aspect of natural interaction in VR, controllers also play a vital role. Project Alloy ensures that both hands and controllers can be tracked precisely in 6DOF, allowing for a more immersive and interactive experience.

Democratizing World Creation and Content Generation

Project Alloy aims to democratize world creation in VR. Users can create their virtual worlds by simply scanning their surroundings or using handheld scanners. The goal is to make world creation accessible and intuitive, eliminating the need for complex modeling software.

Collision Avoidance and Mapping

To enhance user safety and prevent collisions in VR environments, Intel's depth sensors offer collision-avoidance capabilities. By mapping the real world and blending it with the virtual world, users can navigate their surroundings without the risk of accidents.

Social Elements in VR: Facial Expression Recognition

A critical aspect of social interaction in VR is facial expression recognition. Intel explores the integration of facial tracking through sensors mounted on headsets, enabling users to convey emotions and expressions within the virtual space.

Capturing Real-World Objects in 3D

Intel's depth sensors excel in capturing real-world objects in stunning 3D detail. Through scanning and reconstruction, users can create high-resolution 3D models of real objects and scenes. This feature has significant implications in fields such as e-commerce, where buyers can inspect products virtually before making a purchase.

Scanning and Creating High-Resolution 3D Content

Intel's depth sensors, coupled with advanced scanning techniques, allow for the creation of detailed and realistic 3D content. This ability opens up avenues for content creators, allowing them to capture and share immersive experiences.

Facilitating Online Shopping and Interaction

By enabling users to capture and view real objects in 3D, Intel's depth sensors have the potential to revolutionize online shopping. Buyers can inspect products from all angles, leading to informed purchasing decisions. Additionally, the ability to interact with virtual objects enriches the overall shopping experience.

Form Factors and SKUs of Depth Sensors

Intel offers a range of form factors and Stock Keeping Units (SKUs) for their depth sensors. These options cater to different applications and budgets, allowing developers and OEMs to choose the most suitable sensor for their requirements.

Available SKUs and their Specifications

Intel's depth sensors come in various SKUs, each with specific specifications. These SKUs differ in their field of view, resolution, power consumption, and other parameters. OEMs and developers can select the ideal sensor based on their specific needs.

Preview of a Compact and Versatile Depth Sensor

Intel provides a sneak peek into an experimental depth sensor, showcasing their commitment to continuous innovation. This compact sensor exemplifies the versatility and potential form factors that Intel is exploring in their Quest to advance depth sensing technologies.

Conclusion and Resources

In conclusion, Intel RealSense Technology has made significant strides in pushing the boundaries of depth sensing. Their advancements in compute power, resolution, and versatility have expanded the possibilities of VR and MR applications. As Intel continues to innovate, the potential applications of depth sensors in fields such as gaming, robotics, e-commerce, and communication are vast.

For more information and resources on Intel's RealSense Technology and their range of depth sensors, please refer to the following resources:

• Contact Intel's Marketing Team
• Additional Resources and Links

By continuously driving advancements in depth sensor technology, Intel is paving the way for immersive and interactive experiences in the virtual world.