Augmented and Virtual Realities

Augmented Reality for Cryoablation Procedures

Poster Session: 12 August, 1:05 pm

A method for providing an estimation of the outcome of a cryoablation procedure. Based on a physics-based model implemented on GPU, the method computes heat transfer occurring within the targeted organ and offers an augmented visualization in order to guide the surgeon in planning the operation.

Hugo Talbot
INRIA

Frederick Roy
INRIA

Stéphane Cotin
INRIA

CHILDHOOD: Wearable Suit for Augmented Child Experience

Poster Session: 9 August, 12:40 pm

CHILDHOOD is a novel wearable suit that transforms users to a child's embodiment, where they perceive the largeness of objects in the world, enhanced manipulability of small objects, and an excitement for adventure. The physically limited body is virtually realized by a viewpoint translator and hand exoskeletons.

Jun Nishida
University of Tsukuba

Hikaru Takatori
University of Tsukuba

Kosuke Sato
University of Tsukuba

Kenji Suzuki
University of Tsukuba

Creating Near-Field VR Using Stop-Motion Characters and a Touch of Light-Field Rendering

Poster Session: 12 August, 1:05 pm

This new type of VR experience and pipeline was created using light-field techniques to provide a rich immersive visual quality for near-field VR. The pipeline was integrated with Unity3D and hand-crafted stop-motion puppets were introduced to the VR medium for surrealistically compelling experiences.

Mark Bolas
USC School of Cinematic Arts and Institute for Creative Technologies

Ashok Kuruvilla
USC Viterbi School of Engineering

Shravani Chintalapudi
USC Viterbi School of Engineering

Fernando Rabelo
USC School of Cinematic Arts

Vangelis Lympouridis
USC School of Cinematic Arts and Institute for Creative Technologies

Evan Suma
USC Institute for Creative Technolgies

Christine Barron
USC School of Cinematic Arts

Catalina Matamoros
USC School of Cinematic Arts

Cristina Brous
USC School of Cinematic Arts

Alicja Jasina
USC School of Cinematic Arts

Yawen Zheng
USC School of Cinematic Arts

Andrew Jones
USC Institute for Creative Technolgies

Paul Debevec
USC Institute for Creative Technolgies

Daivd Krum
USC Institute for Creative Technologies

First-Person-View Animation Editing Utilizing Video See-Through Augmented Reality

Poster Session: 13 August, 12:15 pm

This system combines a stereo-camera image, head posture, and hand gestures in real time to create a first-person-view augmented reality animation-editing experience. Operations generated by users can be adopted by third-party animation software using a specially designed pipeline.

Liang-Chen Wu
National Taiwan University

Jia-Ye Li
National Taiwan University

Yu-Hsuan Huang
National Taiwan University

Ming Ouhyoung
National Taiwan University

Flex AR: Anatomy Education Through Kinetic Tangible Augmented Reality

Poster Session: 9 August, 12:40 pm

An augmented reality application that uses a tangible user interface to allow users to better visualize muscles in motion.
Student Research Competition Semi-Finalist

Michael Saenz
Texas A & M University

Joshua Strunk
Texas A&M University

Kelly Maset
Texas A&M University

Jinsil Seo
Texas A&M University

Erica Malone
Texas A&M University

Fracture in Augmented Reality

Poster Session: 13 August, 12:15 pm

This image-guided mesh cutting method for real-time augmented reality of fractured objects relies on the combination of a visually based fracture tracking algorithm and a physics-based model that is dynamically superimposed on the image.

Nazim Haouchine
INRIA

Alexandre Bilger
Université du Luxembourg, INRIA

Jeremie Dequidt
INRIA

Stéphane Cotin
INRIA

Hands-Free Gesture Operation for Maintenance Work Using a Finger-Mounted Acceleration Sensor

Poster Session: 13 August, 12:15 pm

A novel switch-less assist system for maintenance work with a simple structure that recognizes gesture using only a finger-mounted acceleration sensor.

Toshiaki Nakasu
Toshiba Corporation

Tsukasa Ike
Toshiba Corporation

Kazunori Imoto
Toshiba Corporation

Yasunobu Yamauchi
Toshiba Corporation

Improving Depth Perception During Surgical Augmented Reality

Poster Session: 13 August, 12:15 pm

This study proposes a method to compensate for the loss of depth perception during surgical augmented reality. The method enhances visualization of an organ's vessels and tumors while still ensuring an unobstructed view of the real organ.

Bruno Marques
INRIA

Nazim Haouchine
INRIA

Rosalie Plantefeve
INRIA

Stéphane Cotin
INRIA

Mobile Collaborative AR/VR With Real-Time In-Place Switching

Poster Session: 13 August, 12:15 pm

A lightweight AR/VR app framework for mobile devices that supports stereo, collaborative viewing, and in-place modification of world state. The framework also allows in-place switching between AR and VR while maintaining state.

Prashanth Bollam
SAMSUNG Electronics Co. Ltd.

Eesha Gothwal
SAMSUNG Electronics Co. Ltd.

Soumyajit Deb
SAMSUNG Electronics Co. Ltd.

Shailesh Kumar
SAMSUNG Electronics Co. Ltd.

G B C S Tejaswi Vinnakota
SAMSUNG Electronics Co. Ltd.

Mouth-Gesture-Based Emotion Awareness and Interaction in Virtual Reality

Poster Session: 9 August, 12:40 pm

By automatically locating the user's head and extracting the mouth contours from the 3D point cloud stream in real time, an emotion-aware, hands-free virtual reality experience can be created when the face is heavily occluded by the VR headset.
Student Research Competition Semi-Finalist

Xing Zhang
Binghamton University

Umur Ciftci
Binghamton University

Lijun Yin
Binghamton University

MR Coral Sea Evolved: Mixed-Reality Aquarium With Physical MR Displays

Poster Session: 13 August, 12:15 pm

With this mixed-reality aquarium, a user can play with virtual fish via a physical MR display, which mediates between the real and virtual spaces with multisensory physical feedback.

Toshikazu Ohshima
Ritsumeikan University

Shun Kawaguchi
Ritsumeikan University

Yuma Tanaka
Ritsumeikan University

Chiharu Tanaka
Canon Software Inc.

RiSE: Reflectance Transformation Imaging in Spatial Augmented Reality for Exhibition of Cultural Heritage

Poster Session: 9 August, 12:40 pm

This exhibition system, based on SAR technology, can provide an immersive experience by digitally showcasing cultural heritage measured through the PTM scheme. The proposed system could become a new type of exhibition that will break free of traditional museum paradigms.

Yong Yi Lee
Gwangju Institute of Science and Technology

Junho Choi
Gwangju Institute of Science and Technology

Yong Hwi Kim
Gwangju Institute of Science and Technology

Jong Hun Lee
Gwangju Institute of Science and Technology

Moon Gu Son
Gwangju Institute of Science and Technology

Bilal Ahmed
Gwangju Institute of Science and Technology

Kwan H. Lee
Gwangju Institute of Science and Technology

Shadow Shooter: 360-Degree All-Around Virtual 3D Interactive Content

Poster Session: 13 August, 12:15 pm

Shadow Shooter is a VR shooter game that uses the e-Yumi 3D bow interface and real physical interactive content to change a 360-degree all-around view in a room into virtual game space.

Masasuke Yasumoto
Kanagawa Institute of Technology

Takehiro Teraoka
Tokyo University of Technology

Spherical Light-Field Environment Capture for Virtual Reality Using a Motorized Pan/Tilt Head and Offset Camera

Poster Session: 13 August, 12:15 pm

Using a standard panoramic pan/tilt mount with an offset fisheye lens camera to record outward-looking spherical light fields of real environments, which can then be viewed in virtual reality with full motion parallax.

Paul Debevec
University of Southern California, USC Institute for Creative Technologies

Greg Downing
xRez Studio

Hsuan-Yueh Peng
OTOY Inc.

Tim Hawkins
OTOY Inc.

Jules Urbach
OTOY Inc.

Touch the Virtual Reality: Using the Leap Motion Controller for Hand Tracking and Wearable Tactile Devices for Immersive Haptic Rendering

Poster Session: 13 August, 12:40 pm

An innovative haptic system for immersive virtual reality interaction, composed of a Leap Motion controller and five wearable tactile devices. The Leap Motion controller tracks the fingertips' position in 3D space, while the tactile device provides the user with the compelling sensation of touching the virtual environment.

Stefano Scheggi
Università degli Studi di Siena

Leonardo Meli
Università degli Studi di Siena, Istituto Italiano di Tecnologia

Claudio Pacchierotti
Università degli Studi di Siena, Istituto Italiano di Tecnologia

Domenico Prattichizzo
Istituto Italiano di Tecnologia, Università degli Studi di Siena

WAOH : Virtual Automotive HMI Evaluation Tool

Poster Session: 13 August, 12:40 pm

This study suggests an automotive human-machine interface(HMI) simulation system based on projection to pre-evaluate an HMI through virtual-function implementation prior to making the real product.

Seunghyun Woo
Hyundai Motor Company

Daeyun An
Hyundai Motor Company

Jongmin Oh
Hyundai Motor Company

Gibeom Hong
Hyundai Motor Company