The development of image sensors for video production has traditionally focused on improving resolution in horizontal formats such as the 16:9 aspect ratio. However, the growing demand for wide field-of-view content for large cinema screens, dome theaters, and head-mounted displays necessitates a greater vertical imaging coverage that exceeds the capabilities of conventional sensors. In the broadcasting industry, it is important to explore ways for conventional framing and immersive content production to coexist effectively.
To address this challenge, we developed a compact 8K×8K image sensor with a square 1:1 aspect ratio. This sensor incorporates backside-illuminated stacked pixels and a proprietary high-speed readout circuit, achieving an optimal balance between compact size (5/6-type) and high throughput (59 megapixels, 60 fps, 14-bit). Compared to recent large-format high-resolution sensors, our sensor enables a more compact camera design that performs superiorly in high-mobility immersive shooting scenarios.
Utilizing this technology, we developed an 8K×8K camera system and conducted multiple shooting experiments and field trials. This report outlines the camera system and introduces three novel applications:
1) IMAX Production: Wide-angle footage captured with a fisheye lens is reframed to generate full-size IMAX content (1.43:1 aspect ratio), incorporating pan, tilt, and zoom effects from any desired viewpoints during post-processing.
2) Immersive Content Production: Single or multiple fisheye images are converted into 180 or 360-degree VR (virtual reality) videos at 15K resolution, enabling highly detailed immersive experiences for virtual tours, flying theaters, and educational applications. This production leveraged the camera’s compact form to enable videos to be shot using drones and electric bicycles.
3) ROI Switching for Broadcast: Wide-angle studio footage is segmented into multiple ROIs (regions of interest) and output in real time, allowing dynamic video switching with a single camera setup in conventional broadcasting workflows.
These advancements demonstrate that compact, square-format, high-resolution sensors open up new possibilities for producing broadcast content through greater flexibility in multi-platform deployment and improved workflow efficiency.
Parent Session
Tuesday, April 21 | 11 a.m. – noon | N256
Work with NAB Show’s Sales Team to explore how your brand can power the pros shaping what’s next.