Viewport-adaptive navigable 360-degree video delivery
By Xavier Corbillon, G. Simon, A. Devlic, Jacob Chakareski. 2017 IEEE International Conference on Communications (ICC), 2016
337 citations recorded by the source corpus.
The delivery and display of 360-degree videos on Head-Mounted Displays (HMDs) presents many technical challenges. 360-degree videos are ultra high resolution spherical videos, which contain an omnidirectional view of the scene. However only a portion of this scene is displayed on the HMD. Moreover, HMD need to respond in 10 ms to head movements, which prevents the server to send only the displayed video part based on client feedback. To reduce the bandwidth waste, while still providing an immersive experience, a viewport-adaptive 360-degree video streaming system is proposed. The server prepares multiple video representations, which differ not only by their bit-rate, but also by the qualities of different scene regions. The client chooses a representation for the next segment such that its bit-rate fits the available throughput and a full quality region matches its viewing. We investigate the impact of various spherical-to-plane projections and quality arrangements on the video quality displayed to the user, showing that the cube map layout offers the best quality for the given bit-rate budget. An evaluation with a dataset of users navigating 360-degree videos demonstrates that segments need to be short enough to enable frequent view switches.
Subfields: Computer Vision and Pattern Recognition, Signal Processing
View Paper: https://www.semanticscholar.org/paper/381e75c7ee607a23bf0b053804dacee788599801
How researchers see this paper
The researchers whose trusted networks rank it highest, strongest advocate first. Every researcher gets a different order.
In Computer Vision and Pattern Recognition
- Roger Zimmermann
- Ali C. Begen
- Feng Qian
- Hwann-Tzong Chen
- Qingyang Xiao
- Yu-Sheng Chen
- Wei Wei
- Vijay Gopalakrishnan
In Signal Processing
Citations in the corpus
- COCO-GAN: Generation by Parts via Conditional Coordinating (2019, background): “Some recent VR studies on omnidirectional view rendering and streaming [6, 21, 5] focus on reducing computational cost or network bandwidth by adapting to the user’s viewport.”
- Flare: Practical Viewport-Adaptive 360-Degree Video Streaming for Mobile Devices (2018, methodology): “Within different viewport-adaptive approaches [23, 26, 42, 47, 48, 52, 62], we adopt the tile-based solution [42, 48] due to its conceptual simplicity and potential benefits.”
- A Survey on Bitrate Adaptation Schemes for Streaming Media Over HTTP (2019, background): “Viewport-adaptive [177] and tilebased adaptive streaming techniques [178], [179] are currently suggested in the literature to overcome this disadvantage.”