Awesome 360 Vision

Awesome works and resources relevant to 360 vision. Suggestions or pull requests are welcome. Inspired by awesome-deep-vision, awesome-adversarial-machine-learning, awesome-deep-learning-papers, and awesome-architecture-search.

Paper

A Deep Ranking Model for Spatio-Temporal Highlight Detection from a 360 Video [PDF]
- Youngjae Yu et al., AAAI, 2018.
SaltiNet: Scan-path Prediction on 360 Degree Images using Saliency Volumes [PDF] [Project]
- Assens M et al., ICCVW, 2017.
SalNet360: Saliency Maps for omni-directional images with CNN [PDF]
- Rafael Monroy et al., arXiv, 2017.
Deep 360 Pilot: Learning a Deep Agent for Piloting through 360° Sports Video [PDF] [Project]
- Hou-Ning Hu et al., CVPR, 2017.
Making 360° Video Watchable in 2D: Learning Videography for Click Free Viewing [PDF] [Project]
- Yu-Chuan Su et al., CVPR, 2017.
Semantic-driven Generation of Hyperlapse from 360° Video [PDF] [Project]
- Wei-Sheng Lai et al., TVCG, 2017.
Viewport-aware adaptive 360° video streaming using tiles for virtual reality [PDF]
- Cagri Ozcinar et al., ICIP, 2017.
Visual Attention in Omnidirectional Video for Virtual Reality Applications [PDF] [Project]
- Cagri Ozcinar and Aljosa Smolic, QoMEX, 2018.
Look around you: Saliency maps for omnidirectional images in VR applications [PDF]
- Ana De Abreu et al., QoMEX, 2017.
Viewport-adaptive navigable 360-degree video delivery [PDF]
- Xavier Corbillon et al., ICC, 2017.
Pano2vid: Automatic cinematography for watching 360° videos [PDF] [Project]
- Yu-Chuan Su et al., ACCV, 2016.

Omnidirectional CNN for Visual Place Recognition and Navigation [PDF]
- Tsun-Hsuan Wang et al. arXiv, 2018.
Structure-From-Motion in Spherical Video Usingthe von Mises-Fisher Distribution [PDF]
- HaoGua et al., TIP, 2017.
6-DOF VR videos with a single 360-camera [PDF]
- Jingwei Huang et al., IEEE VR, 2017.
Depth augmented stereo panorama for cinematic virtual reality with head-motion parallax [PDF]
- Jayant Thatte et al., ICME, 2016.
3D reconstruction of structures using spherical cameras with small motion [PDF]
- Sarthak Pathak et al., ICCAS, 2016.
Large-scale direct slam for omnidirectional cameras [PDF]
- David Caruso et al., IROS, 2015.
Omnidirectional 3D reconstruction in augmented Manhattan worlds [PDF]
- Miriam Sch ̈onbein et al., IROS, 2014.
Moving object detection, tracking and following using an omnidirectional camera on a mobile robot [PDF]
- Ivan Markovic et al., ICRA, 2014.
Structure from Motion using full spherical panoramic cameras [PDF]
- Alain Pagani et al., ICCVW, 2011.

Self-view Grounding Given a Narrated 360 Video [PDF]
- Shih-Han Chou et al., AAAI, 2017.

Spherical CNNs [PDF]
- Taco S. Cohen et al., ICLR, 2018.
Learning Spherical Convolution for Fast Features from 360° Imagery [PDF]
- Yu-Chuan Su et al., NIPS, 2017.

Tell Me Where to Look: Investigating Ways for Assisting Focus in 360° Video [PDF] [Project]
- Yen-Chen Lin et al., CHI, 2017.
Outside-In: Visualizing Out-of-Sight Regions-of-Interest in a 360 Video Using Spatial Picture-in-Picture Previews [PDF]
- Yung-Ta Lin et al., UIST, 2017.

A Multi-View Stereo Benchmark with High-Resolution Images and Multi-Camera Videos in Unstructured Scenes [PDF]
- T. Schöps et al., CVPR, 2017.
3D Visual Perception for Self-Driving Cars using a Multi-Camera System: Calibration, Mapping, Localization, and Obstacle Detection [PDF]
- C. Häne et al., IMAVIS, 2017.

Visual Attention in Omnidirectional Video for Virtual Reality Applications [Website]
synthia-dataset [Website]
- 8 RGB cameras forming a binocular 360º camera, 8 depth sensors -> RGB & Depth in 360º
- 2018
SALIENT 360! [Website]
- A Dataset of Head and Eye Movements for 360 Degree Images, Rai et al., MMSys, 2017.
360-Degree Videos Head Movements Dataset [Website]
- 360-Degree Video Head Movement Dataset, Corbillon et al., MMSys, 2017.
SUN360 [Website]
- Recognizing Scene Viewpoint using Panoramic Place Representation, Xiao et al., CVPR, 2012.