03-18-2025 - News
Introducing OCELLUS Camera Tracking System
By: SonyCine Team
SAN DIEGO (March 18, 2025) – Sony Electronics Inc. is launching its first camera tracking system, OCELLUS (ASR-CT1), designed to simplify and facilitate augmented reality (AR) and virtual production applications in broadcast and cinema by providing marker-free camera tracking through multiple sensors. OCELLUS is camera agnostic and can be used with both cinema and broadcast cameras.
“The growing market for virtual production and augmented reality demands simpler, more efficient workflows. Metadata like camera position, orientation, and lens values are crucial throughout the production lifecycle,” said Theresa Alesso, President of Imaging Products and Solutions Americas, Sony Electronics. “Our new camera tracking system, OCELLUS, delivers valuable, real-time data, enhancing efficiency based on insights from professionals worldwide.”
OCELLUS, perfectly suited for virtual production such as In-Camera VFX and AR, sends the camera position and orientation data while the camera is shooting. The system comprises a sensor unit, a processing box, and three lens encoders, and can be used with Sony Cinema Line cameras, system cameras, and non-Sony cameras.
With the five image sensors and Sony's Visual SLAM (Simultaneous Localization and Mapping) technology, the system creates a reference map1, enabling stable marker-free tracking both indoors and outdoors.
When using Sony cameras,2 metadata regarding focus, iris, and zoom values from the camera and lens3 can be obtained via the camera's SDI4 output and transmitted in real-time to external devices via Ethernet cable5. If the lens does not support metadata acquisition through the camera, lens encoders can be attached to the lens to obtain this metadata. The acquired metadata can then be used for virtual production and AR. The system also supports the recording of tracking data, camera/lens metadata, timecode and file name, which can be used for the post-production workflow.
Sony continues its unwavering support for creators in the virtual production and AR space, with tools ranging from acquisition to display screens, such as the Crystal LED VERONA, and software-based solutions, such as the Virtual Production Tool Set.
Key Features
Compact and lightweight sensor unit with five image sensors:
- Five image sensors provide stable marker-free tracking and high occlusion resistance, critical for operations
- If at least one image sensor in use captures valid feature points, tracking data can be extracted
- Infrared Light-Emitting Diodes (IR LEDs) on both sides of each image sensor help tracking in low-light environments
- Visible Light Cut Unit included for stable tracking in environments with flashing lights or frequent lighting changes, such as during a live concert
- Sensor unit dimensions: approx. 86 mm × 60 mm × 43 mm (W × H × D), weight: approx. 250g6 (3.39" × 2.36" × 1.69", weight: approx. 0.56lbs)
- Easy installation and position adjustment using the NATO rail mounting parts (included)
- Connection to the processing box via a single USB Type-C® cable with a lock mechanism, powered by the processing box via same USB Type-C® cable
Processing Box:
- Real-time transmission of tracking data and camera2/lens3 metadata to CG rendering software like Unreal Engine via Ethernet cable7 in free-d format
- Equipped with Genlock input, Timecode input, SDI input/output terminals, and lens encoder connection terminals
- Supports recording tracking data and camera/lens metadata as FBX files on SDXC memory cards (UHS-II/UHS-I) synchronized with video files of main camera
- OLED display for checking IP address, tracking information, lens data, and more
Lens Encoder:
- Detects precise rotation angles and position of lens focus, iris, and zoom using built-in rotary encoder
- Transmits lens data to the processing box via LEMO 7-pin cable
- Enables metadata acquisition for lenses and cameras that do not support lens data embedding via SDI output
- Includes five different types of gears for various lenses
The camera tracking system OCELLUS (ASR-CT1) will be exhibited at the NAB (National Associations of Broadcasters) Show 2025 in Las Vegas, USA, starting April 6, 2025, in the Sony booth. Further information available at: https://pro.sony/products/camera-adaptors/ocellus
____________________
1 There are limitations to the size of the map
2 Lens metadata support depends on the camera model
3 Supports Cooke /i lenses, B4 lenses, and E-mount lenses
4 The camera must support metadata embedding on SDI output
5 Compatible with 1000BASE-T, 100BASE-TX, 10BASE-T
6 Please note that the final specifications may differ
7 Compatible with 1000BASE-T, 100BASE-TX, 10BASE-T
