VESA Standards People Open-Source Some 28,000 High-Rez Image And Video Files For Display R&D Work

December 2, 2021 by Dave Haynes

Hat Tip Display Daily for finding this …

The Video Electronics Standards Association – aka VESA- has taken the interesting step of making more than 28,000 high-resolution, high dynamic range (HDR) image and video content files available for unrestricted public use and free to download.

The move is positioned as a way of getting much more high-resolution HDR content into the hands of people doing R&D work in display, notably for emerging areas like augmented/virtual/extended reality (AR/VR/XR) applications.

VESA, for people who aren’t display nerds, is an international, non-profit standards association that represents more than 300 hardware, software, computer, display and component manufacturers active in the electronics industry. The association’s standards include DisplayPort, and if you have ever had to source displays or mounts, you will have come across the VESA standards for the little mounting holes on the backs of everything from desktop monitors to giant flat panel displays.

VESA, in announcing the release of the files, says the “content comes courtesy of a multi-year, multi-phase research contract that VESA initiated with York University (Toronto, Canada) led by professors Robert Allison and Laurie Wilcox. The research encompassed the validation and improvement of the visually lossless performance of VESA’s Display Stream Compression (DSC) and VESA Display Compression-M (VDC-M) video compression codecs for stereoscopic 3D use cases, including for AR/VR/XR applications.”

Warning: Nerd language ahead …

“Until now, there has been very little high-resolution HDR 3D content in uncompressed format available to the public or the research community,” stated Professor Allison, director of the Centre for Vision Research at York University. “We believe these images and image sequences will be useful for those working on image compression, image quality and other applications. VESA’s decision to make this content available to the public after commissioning York University to test and validate their own compression standards reflects their commitment and leadership in developing future display-related standards, and will benefit vision researchers and companies developing stereoscopic 3D products.”

Video compression has become increasingly popular in enabling improved performance of consumer display products by addressing bandwidth and power limitations associated with streaming video content at higher resolutions (4K and beyond), higher refresh rates and higher picture quality. However, for compression to be acceptable to the consumer, it must be visually lossless, meaning that it must be indistinguishable from uncompressed video. Over the past several years, VESA has aggressively supported research in assessing the visually lossless performance of video compression, which has played an important role in the development and refinement of VESA’s DSC and VDC-M standards.

“For the past several years, VESA’s display compression standards have helped hardware developers provide a high-quality visual experience and add new capabilities in monitors and televisions,” stated Greg Stewart, director of system architecture at Analogix Semiconductor and chair of the AR/VR Task Group at VESA. “This recent work between VESA and York University has fine-tuned VESA codecs even more. Now it’s possible to use these compression standards for the more demanding AR, VR and XR display applications without creating visible artifacts. These test images and videos were a critical part of this work, and enabled VESA member companies to perform their own tests and validate their own products. With these test images and videos now out in the public, this should benefit the entire display industry and ultimately the end-user experience.”

The first two phases of the York University research project, which were completed in November 2019, focused on the subjective validation of stereoscopic 3D image compression performance targeting AR/VR/XR head mounted display (HMD) use cases. Areas investigated included to what extent compression artifacts, such as flicker, that are visible in a 2D image would still be visible in a stereoscopic 3D image.

The third phase of the project, completed in March 2020, extended this research by examining the impact of bypassing the color transform for images that have undergone chromatic aberration pre-correction. In stereoscopic HMDs, powerful lenses placed in front of the displays can cause significant image distortion. The traditional way of addressing this image distortion is by pre-distorting the image so that the image looks perfect after the lens distortion. However, this pre-distortion can disrupt the spatial correlation of the red, green and blue pixels in the displays, and thus impact compression performance and overall display quality. The third phase of the York University research examined whether adjusting the color processing in the codecs by turning off the color transform could improve the performance of DSC and VDC-M for these use cases. The research also examined how well VESA’s video compression codecs worked in managing chromatic aberration in 3D imaging in general.

The results of the York University research project indicated that DSC and VDC-M performed very well in testing during all three phases. The research also led to refinements in the codecs to further improve their performance. A fourth phase of the research project is currently underway to evaluate the performance of the compression codecs for motion sequences, including camera tracking of stationary objects and the rotation and movement of objects.

According to Bill Lempesis, executive director of VESA, “York University is a world-class institution dedicated to research training in visual science and its applications. This multi-year research study that VESA commissioned with them is an important undertaking to address the industry’s need for solutions to overcome the increasing bandwidth and power demands of mobile AR and VR devices. Through rigorous testing, this research has enabled us to verify the visually lossless performance of our DSC and VDC-M compression codecs – giving product developers and researchers the confidence that adopting VESA’s compression standards will give them high-quality results for their head mounted display products.”

Most of that is over my head, but I do know there are lots of technology companies that are very good at developing displays and supporting technologies, but terrible at thinking through marketing and what to show in everything from demos to trade show appearances. There is an open source animated video in 4K, called Big Buck Bunny, that continues to show up on trade show displays – almost 14 years after it first came out.

So material that’s free and allows for testing and demos at least seems a good thing. This is the download page …

Leave a comment