AR/VR with Steve Feiner and Computer Graphics and User Interfaces Lab

By
Parixit Davé
December 01, 2017
Picture of Steve Feiner and Emerging Technologies logo

ETC kick off meeting with Steve Feiner introduced the group to the goals and objectives for the Emerging Technology Consortium.

What are the ways to go forward? Identify and engage forward thinkers. Promote creative thinking and cross-disciplinary collaborations. Publicize new initiatives and projects as an aggressive marketing strategy. Invite industry partners and set up potential collaborations and/or to seek corporate sponsorship.

How can CUIT assist in any needs for new and emerging technologies? Maneesha framed purpose and background including: logistics, frequency of meetings, communication tools, and confluence.

Ideas and resources to leveraged into action and shared knowledge (Facilitated by Parixit):

  • Establish meeting schedule
  • Use Confluence for meeting notes and members
  • Slack channel for communication
  • Use forum to share ideas, plan projects, face challenges (financial, facilities, resources, etc.)
  • Qualtrics survey to be shared with group to gather feedback, encourage demos from CU and/or vendors at future meetings
  • Google to present on Jump camera in summer 2018
  • IBM could demo Watson
  • Colleagues from peer institutions could share current collaborations with CU staff, faculty, researchers, etc.

AR/VR background, demo and Q/A & Highlights of projects over the years (Facilitated by Steve Fainer):

  • AR backpack for navigation - travel and tourism around Manhattan (2001)
  • Information Workspaces - integrating traditional classroom or workspace resources into 3D space, Entertainment
  • Task Assistance - navigation, maintenance, assembly
  • Remote support for task assistance
  • Orientation Guidance for Small FOV Monoscopic Eyewear (demonstration will consist of stereoscopic viewing with Google Glass) Interaction/Visualization techniques, single axis for rotating an object
  • Animate - user is shown each iteration of object movement progressively
  • Handles - goal is to align handles within target rings by any motion they choose - Handles was shown to be most effective method in user study of lab trials
  • Orientation Guidance for Larger FOV Stereoscopic Eyewear
  • Hybrid UI's - synergistic combinations of displays and devices; sharing coordinate systems, input data, etc.

Demonstrations: Holo-lens diagnosis and repair of smoking storage array can be integrated with note-taking, annotation, etc.

Endovascular Surgery guidance (as an alternative to 2D contrast dyes and CT scans), and use of 3D heart and vascular models

Discussion: Application of AR/VR: Who's using it/wants to use it, use cases, technology hurdles

Group potential: Collaboration, promoting events, connection, internal recognition, greater institutional support for areas of interest/involvement, resources (current), resources (desired), vendor involvement

Invitation for group to meet at CUMC and experience holo-lens simulations currently in use (PT, OT, Orthopedics, Dental)

Group to focus on tangible, actionable items and strategy going forward

Other items:

  • Summary of experience at OLC Conference, presentation shared by Case Western Univ. and their use of holo-lens
  • Join us for our monthly Friday lunch meeting