Skip to content

Latest commit

 

History

History
110 lines (95 loc) · 7.59 KB

README.md

File metadata and controls

110 lines (95 loc) · 7.59 KB
Raw

Awesome 360 Vision Awesome

Awesome works and resources relevant to 360 vision. Suggestions or pull requests are welcome. Inspired by awesome-deep-vision, awesome-adversarial-machine-learning, awesome-deep-learning-papers, and awesome-architecture-search.

Table of Contents

Paper

Field of View Piloting & Saliency View Detection

  • A Deep Ranking Model for Spatio-Temporal Highlight Detection from a 360 Video [PDF]
    • Youngjae Yu et al., AAAI, 2018.
  • SaltiNet: Scan-path Prediction on 360 Degree Images using Saliency Volumes [PDF] [Project]
    • Assens M et al., ICCVW, 2017.
  • SalNet360: Saliency Maps for omni-directional images with CNN [PDF]
    • Rafael Monroy et al., arXiv, 2017.
  • Deep 360 Pilot: Learning a Deep Agent for Piloting through 360° Sports Video [PDF] [Project]
    • Hou-Ning Hu et al., CVPR, 2017.
  • Making 360° Video Watchable in 2D: Learning Videography for Click Free Viewing [PDF] [Project]
    • Yu-Chuan Su et al., CVPR, 2017.
  • Semantic-driven Generation of Hyperlapse from 360° Video [PDF] [Project]
    • Wei-Sheng Lai et al., TVCG, 2017.
  • Viewport-aware adaptive 360° video streaming using tiles for virtual reality [PDF]
    • Cagri Ozcinar et al., ICIP, 2017.
  • Visual Attention in Omnidirectional Video for Virtual Reality Applications [PDF] [Project]
    • Cagri Ozcinar and Aljosa Smolic, QoMEX, 2018.
  • Look around you: Saliency maps for omnidirectional images in VR applications [PDF]
    • Ana De Abreu et al., QoMEX, 2017.
  • Viewport-adaptive navigable 360-degree video delivery [PDF]
    • Xavier Corbillon et al., ICC, 2017.
  • Pano2vid: Automatic cinematography for watching 360° videos [PDF] [Project]
    • Yu-Chuan Su et al., ACCV, 2016.

6DOF, 3D, SLAM, Navigation

  • Omnidirectional CNN for Visual Place Recognition and Navigation [PDF]
    • Tsun-Hsuan Wang et al. arXiv, 2018.
  • Structure-From-Motion in Spherical Video Usingthe von Mises-Fisher Distribution [PDF]
    • HaoGua et al., TIP, 2017.
  • 6-DOF VR videos with a single 360-camera [PDF]
    • Jingwei Huang et al., IEEE VR, 2017.
  • Depth augmented stereo panorama for cinematic virtual reality with head-motion parallax [PDF]
    • Jayant Thatte et al., ICME, 2016.
  • 3D reconstruction of structures using spherical cameras with small motion [PDF]
    • Sarthak Pathak et al., ICCAS, 2016.
  • Large-scale direct slam for omnidirectional cameras [PDF]
    • David Caruso et al., IROS, 2015.
  • Omnidirectional 3D reconstruction in augmented Manhattan worlds [PDF]
    • Miriam Sch ̈onbein et al., IROS, 2014.
  • Moving object detection, tracking and following using an omnidirectional camera on a mobile robot [PDF]
    • Ivan Markovic et al., ICRA, 2014.
  • Structure from Motion using full spherical panoramic cameras [PDF]
    • Alain Pagani et al., ICCVW, 2011.

Stabilization

  • 360° video stabilization [PDF]
    • Johannes Kopf et al., TOG, 2016

Natural Language

  • Self-view Grounding Given a Narrated 360 Video [PDF]
    • Shih-Han Chou et al., AAAI, 2017.

Spherical DNN

  • Spherical CNNs [PDF]
    • Taco S. Cohen et al., ICLR, 2018.
  • Learning Spherical Convolution for Fast Features from 360° Imagery [PDF]
    • Yu-Chuan Su et al., NIPS, 2017.

Human Interaction

  • Tell Me Where to Look: Investigating Ways for Assisting Focus in 360° Video [PDF] [Project]
    • Yen-Chen Lin et al., CHI, 2017.
  • Outside-In: Visualizing Out-of-Sight Regions-of-Interest in a 360 Video Using Spatial Picture-in-Picture Previews [PDF]
    • Yung-Ta Lin et al., UIST, 2017.

Multi-camera

  • A Multi-View Stereo Benchmark with High-Resolution Images and Multi-Camera Videos in Unstructured Scenes [PDF]
    • T. Schöps et al., CVPR, 2017.
  • 3D Visual Perception for Self-Driving Cars using a Multi-Camera System: Calibration, Mapping, Localization, and Obstacle Detection [PDF]
    • C. Häne et al., IMAVIS, 2017.

Dataset

  • Visual Attention in Omnidirectional Video for Virtual Reality Applications [Website]
  • synthia-dataset [Website]
    • 8 RGB cameras forming a binocular 360º camera, 8 depth sensors -> RGB & Depth in 360º
    • 2018
  • SALIENT 360! [Website]
    • A Dataset of Head and Eye Movements for 360 Degree Images, Rai et al., MMSys, 2017.
  • 360-Degree Videos Head Movements Dataset [Website]
    • 360-Degree Video Head Movement Dataset, Corbillon et al., MMSys, 2017.
  • SUN360 [Website]
    • Recognizing Scene Viewpoint using Panoramic Place Representation, Xiao et al., CVPR, 2012.

Media