Exploring Virtual Reality as a Forensic Tool

Screen Shot 2019-02-13 at 2.38.38 PM.png

Virtual reality (VR) offers unparalleled capabilities to support and facilitate forensic activities. VR is especially well suited for supporting use-cases where spatial information is critical, like accidents and crime scene reconstruction. When used appropriately, this emerging technology will be able to easily leapfrog over current alternatives.

VR is designed to trick human senses and immerse the user into a computer-generated world in a way that makes the user perceive, interact and feel like actually being there. This is referred as the sense of “presence.” In addition, the VR environment can be shared over the internet and users can interact remotely—therefore the term presence in the VR context is also referred to as telepresence. Long story short, a VR environment will make the user “feel” that he or she is at the scene.

Current needs in forensics 

The administration of justice and the overall judicial process requires significant preparatory work. In general, this is a time-consuming and expensive process. Processing a crime scene is a long, tedious ordeal that involves purposeful recording and documentation of the conditions at the scene, and the collection of any physical evidence that could provide clues and help determine what happened. The most logical explanations that investigators can recreate, in many cases, can still be very confusing for most people who didn’t have the possibility of being at the scene to comprehend easily.

The current “pain points" relate to the costs and difficulties associated with replicating a scene as an investigative and demonstrative working environment. Another area where improvement offers significant value is the collaboration and communication between investigators and prosecutors.


Value of VR in forensics

To improve justice and support a fair judicial process, society needs the most powerful and cost-effective tools investigators can use across multiple types of scenes. The time is right to leverage these capabilities and provide the best tool possible for investigators and others involved in criminal justice, including prosecutors, defenders, judges and eventually jurors. It is time to allow all of them to "teleport" to a virtual crime or accident scene as needed.

Nowadays, many agencies already capture crime scenes with highly sophisticated 3D laser scanners. They not only have this 3-D raw data readily available, but they are constantly forced to translate, reproduce and communicate such abundant and relevant 3-D/spatial information into a 2-D metaphor (such as diagrams, blueprints, pictures, videos, etc.)

Early conversations and demonstrations with recognized experts in the use of forensic 3-D metrology in the private and public sector have provided very interesting and positive feedback. One expert user said: “There is a distinct need for an intuitive method for the visualization of these rich, 3-D evidence data sets. VR provides this method and does it with little additional effort.”

VR could offer investigators, prosecutors, defenders, and other stakeholders’ multiple key benefits:

  • Revisit the crime scene: Users would be able to quickly and cost-effectively "teleport" to the crime or accident scene, walk through the scene as many times as needed, assess as many points of view as needed, perceiving the scene as close as possible to the original incident.

  • Collaboration: Users would be presented with the same virtual scene and share the same collaborative space—participants from multiple specialties and from multiple locations could be given access to a virtual scene as soon as it is digitalized. Users would be able to share annotations and knowledge contributed by individuals.

  • Knowledge acquisition: Increased capabilities for prosecutors to learn the facts around the scene being investigated, and to become more proficient about investigative techniques, increasing capacity to communicate with other stakeholders in a more compelling and cost-efficient manner, reducing the amount of back and forth and rework.

  • Compliance: VR environments could enable agencies to better observe, control and report on users as they perform their investigative tasks. The immersive nature of the VR environment could facilitate the verification of required procedures. Successful completion of the required investigative tasks could be tracked and reported.

A future article will elaborate in the potential risks of VR in Forensics, as well as what we expect to be the changes in the near future.

Eduardo Neeter is the Founder and CEO of FactualVR, a startup developing a virtual reality platform to help law enforcement and prosecutors accurately replicate and communicate the facts around a crime scene. Eduardo first began working in the field of virtual reality in a Japan-based research lab 22 years ago. Eduardo is also the co-chair of the VRARA (VR/AR Association) Criminal Justice Committee.

Webinar expert panel: "Next generation HMDs and the killer app for VR"

Register here

This Friday, the 15th of February at 10am EST / 4pm CET, the European Photonics Industry Consortium will be moderating this VR/AR Association Location-Based Entertainment Committee Panel Discussion that intends to tackle the tough questions of hardware and software for immersive technology.

Both groups have invited key members to discuss the optics and displays that make VR possible in the first place and what it will look in the next generation headsets to come.

Moderated by Jose Pozo, the CTO at EPIC, his guest include:

  • Leland Hedges, Commercial Director at Pico Interactive

  • Marek Polčák, Co-founder at VRgineers

  • Dr. Zine Bouhamri, Market & Technology Analyst at Yole Développement

This webinar highlights not only the future market trends, but also the challenges and successes for the Photonics Industry developing for Virtual Reality headsets. You will also come out with more clearer understanding of the nuts and bolts behind VR. Register for free here (click on Upcoming).

You asked the questions, and here are the answers from our Training Webinar Expert Panel

Our Training Committee held a very successful webinar on “The Impact and ROI of VR/AR in Training” on 16th January 2019.

You can watch the Webinar recording here

You can also watch the solution demos here

It proved a popular event, with over 300 people registering to watch four enlightening presentations on very different Virtual Reality and Augmented Reality training applications. During the lively question-and-answer session it became clear that the number of great questions was larger than the time available to answer them all! This post allows the presenters to respond the questions that couldn’t be answered during the webinar.


Presenter 1 : David Trainor, Sentireal

Presentation Theme

David presented the “AppUccino” software, which delivers AR experiences for special-needs trainees to learn how to be a barista and work successfully in a commercial coffee shop. AppUccino directs trainees through the process of making americano, espresso, latte and cappuccino drinks. It generates AR overlays on the physical coffee-making equipment, including the industrial coffee machine itself, the separate coffee bean grinder and the separate water heater. A short video of part of the AppUccino AR experience can be seen here. Trainee performance measurements are taken as they prepare the drink using AppUccino and these measurements are uploaded to a cloud application, which analyzes them and presents training progress information to authorized training managers. An initial pilot with AppUccino indicated that trainees retained twice the amount of information and developed their skills 50% faster using AppUccino.

Webinar Questions for David Trainor

You said it took ~9 months of definition and dev, how many people were working on your team in which roles in order to accomplish this?

We used one media/content creator and one software developer. The work was carried out over the course of 9 months, but neither the content creation nor the software development role was full-time.

How were the analyses done? Observation? Performance against criteria on task?

The analyses were done based on (i) time taken for the trainee to perform certain tasks (ii) measurements of how accurately the trainee performed certain tasks and (iii) estimates of where the trainee’s attention and focus was at specific points in the procedure.

How many users has Appuccino had? What has been the impact? In how many months after development did you achieve that impact?

We’ve just completed an initial evaluation/pilot involving 15-20 trainees within a coffee shop managed by a partner training organization. At some point in February 2019 we intend to expand this to all barista trainees within that training organization.

How long did it take to create AR content for training?

The 3D models for the AR overlays were completed in approximately 1 week. The media is actually quite simple. Strong, simple content proved to be the best way to present the required information to special needs trainees who are affected by autism, Downs Syndrome or general learning difficulties. However we needed to spend much more time - about 4 months - on the instructional design and the directions, animations and transitions within the AR scenarios.

How did you already go about gathering data on ROI prior to the development (and also launch) of the app?

The data was gathered from a pilot study at one location. This was after the app was developed but before it was publicly released.

Very exciting project! Curious why you selected that small, unique demographic to start? Unique requirements? Expect to scale up to other populations?

We picked barista training as it’s an area where there is expected to be a lack of qualified employees in the future. In the UK, where I’m from, it is estimated that there is a shortfall of 40000 trained baristas. We selected special-needs barista trainees because there is a high degree of underemployment in that group and if we can create a good intuitive solution for special-needs trainees then it should scale up well to other groups and other types of catering or hospitality training applications.

Are these analytics published somewhere?

Not yet - the small pilot study that we’ve carried out gave us some indications on the training improvements and return on investment from AppUccino but we’re starting a larger evaluation in February 2019, when more trainees start to use the app at our partner training organization. We plan to publish the detailed outputs from this larger study.

Presenter 2 : Jeff Meador, Portico

Presentation Theme

Jeff presented Portico’s Diversity and Inclusion VR Seminar, which provides learners the opportunity to practice and master their skills with inclusive language. This program was designed to complement traditional classroom learning by preparing learners with practical applications of the skills discussed during classroom sessions. With Portico’s software, learners speak directly to AI-powered digital avatars and engage in simulated conversations that put their skills to test. Learners also get real-time feedback on their performance through a virtual trainer, who uses AI to guide users towards better language choices.

Webinar Questions for Jeff Meador

How did you factor in orientation to the VR experience to overcome novelty or unfamiliarity with the technology to get straight to the experience?
We didn’t want to rely on the learner having any previous experience with VR. We give users time to look around and explore prior to beginning the scenario. This gives them a chance to understand the parameters and boundaries of the exercise. We also engage in some light chit-chat (“how’s the weather” sort of stuff) to let the learner know that they are expected to talk and that the AI is listening and will respond.

Do you need a quiet room?

A quiet room certainly helps. Current speech-to-text technology is very strong, but having a quiet place for the training is very helpful. It also helps the learner concentrate on the task at hand.

Is Portico looking at including body language (proximity to client gestures, etc.)?

Yes; we’ve done some preliminary work with this and have set some behaviors that change based on the learner’s position and/ or focal point during the training.

How is the real time interaction happening? is it a sort of multiplayer training and a mentor is interacting with you? or the AI is giving you feedback?

Everything within our scenarios is driven by AI, including the feedback. Our goal is to have these role playing experiences run without the need for actors or facilitators.


Presenter 3 : Marlo Brooke, AVATAR Partners

Marlo presented a Mixed Reality Training System for aircraft and aircraft subsystem maintenance. Primarily an Augmented Reality / Mixed Reality solution, this high-fidelity, industrial-grade maintenance training system scales from a tabletop model design, to a full-sized aircraft, allowing the maintainer to train on the job, hands free, at the point of need, without any jitter or drift. The system utilizes object tracking (as opposed to stickers or markers) to ensure highly accurate lock on target, even as the user moves around the aircraft. It also  integrates to any backend system to both retrieve and record/send information about the maintenance task. It supports collaborative tasks and remote assistance.

Webinar Questions for Marlo Brooke

How did you come up with your pricing for your offerings?

Pricing is based on the specific requirement of the customer. AVATAR Partners can develop the application in its entirety, and/or the customer can purchase SimplifyXR to build/extend all or some of the functionality. Furthermore, because we use open source products such as Unity, the customer does not need to purchase SimplifyXR to extend any AVATAR Partners built XR solutions.

Is SimplifyXR proprietary to you or is it 3rd party?

SimplifyXR is is developed by AVATAR Partners using open source development tools, and can integrate to any backend system through APIs. It is licensed and sold through AVATAR Partners and its certified resellers. SimplifyXR is not required to extend any AVATAR Partner XR applications.

Could you please clarify how 97% reduction was calculated? Does it mean that instead of 100 hours of training without glasses only 3 hours with glasses are required?

You are correct. The training task was calculated based on the current training method for that particular wire failure, which involved an experienced maintainer gathering information from 3 different source materials (ETM, Wire Illuminator, and 2D schematics) to trace and identify the wire failure. The current training method is documented as taking 4 hours on average. The AR training experience is 7 minutes in duration, which is a 97% reduction in time to train.

Marlo, you said you have offices around the country.  I didn't hear if Portico has the same, but do either of your companies look to establish satellite offices in more remote locations? If so, what type of environments do you look for? Developed workforce, local colleges, etc?

AVATAR Partners has regional offices in Huntington Beach CA, Arlington (Crystal City) VA, Virginia Beach VA, and Patuxent River MD, with personnel working in 8 different states within the USA. AVATAR has teaming partners with offices in Atlanta GA, Orlando FL, San DIego CA, Dayton OH, and Fort Worth, TX. We are expanding based on a variety of factors including the locations of teaming partners, certified resellers, and universities both within the USA and Allied Nations.

Marlo, how did you measure those analytics?

The performance metrics were derived from test results by AVATAR Partners based on the comparison of the current methodology versus the use of XR. These tests included accuracy,  time to train, and time to complete the task. Cost savings were derived based on an assumed reduction of errors based on increased accuracy, and will vary depending on the application and cost of parts. We also discussed other studies such as the Boeing/Iowa State Study on wing assembly (Interservice/Industry Training, Simulation, and Education Conference (I/ITSEC) 2014).

I’m not familiar with SimplifyXR -- can you describe what that is and whether that is proprietary to AVATAR?

SimplifyXR is a software product developed by AVATAR Partners that allows non-programmers to develop their own Augmented Reality, Mixed Reality, and Virtual Reality experiences. It also speeds development time by tenfold by using a user-friendly interface. The product also evaluates the user’s desired XR application and notifies the user whether or not the application is well suited for XR, or if a different training media (e.g. video training) would be more effective. SimplifyXR is owned and licensed by AVATAR Partners, and is developed using open-source tools and industry standards, and also integrates to any backend system using APIs. The product is available directly through AVATAR Partners or certified resellers.

Was there a problem using AR on an object as large as an aircraft?

We overcame several challenges to make the solution commercially usable. Using the basic development tools and markers didn’t work - it caused significant drift, jitter and an inability to accurately track the object as the maintainer walked around the aircraft. AVATAR Partners was able to overcome all of these issues by developing algorithms to lock on target without any drift or jitter to the user. Our solution being hardware agnostic, we found the Microsoft Hololens and android tablet supported higher fidelity. Also, we used Mantis Vision 3D scanners to scan the aircraft, gaining an accurate 3D model so that we could use object tracking (instead of markers). This along with our programming algorithms provides the maintainer with absolute precision as they walk around the aircraft, regardless of the unit’s size (from 1:6 the model size, to full aircraft).

Presenter 4 : Carlos Ochoa, ONE digital consulting

Presentation Theme

Carlos presented XR platform for immersive training, operation and maintenance of industry plant services, eolic farms, which includes advanced reality technologies in 3d interactive environments (extended reality, 360º video and digital data integration), methodologies in a modular architecture (on/off line). Innvestion deploy an intelligent XR ecosystem with the specialized know-how to turn unstructured data into value-adding information, for specific subject when providing services such as preventive maintenance, security management or operational management. Simulation-based training, prefaced with traditional training methods on process fundamentals, is the most efficient and fastest way to train new employees and prepare them for their daily work providing huge added value and benefits.

ONE digital consulting has been working for more than 20 years in the eLearning and Training arena, and with our selected partners network in Europe, Saudi, India, Africa and Latam.

Webinar Questions for Carlos Ochoa

What hardware configurations are everyone on the panel currently using for their XR applications?

For a full INNVESTION experience, the user only needs a mobile device and VR glasses that fit the device. The training centre will need an internet connection to download different modules.

INNVESTION can be used in a single “low cost” VR environment based on Samsung Gear Mobile VR, through the most advanced VR Oculus Rift, HTC Vive configuration. The key issue of INNVESTION is data integration in one device. From reality to virtual reality or vice versa.

INNVESTION can be used in a multi window spheric environment, for multiuser training environments.

What are KPI’s?

The acronym KPI sounds for Key Performance Indicator. This is a general business term referring to any metric used in understanding how an organization is doing. While the term can be tossed around the business world ostentatiously or irrelevantly, the fundamental rationale derives from the simple concept that if you don’t know how you did in the past, you don’t know if you have improved in the future. Because every business has its own economic niche, customer acquisition models, geographic localities, production methods, etc., each business must define for themselves what makes them successful. Therefore, the “key” in KPI, should be a metric key to your enterprise. These indicators are as varied as your imagination, but a number of familiar indicators include monthly recurring revenue (MRR), cost to acquire a customer (CAC) and the term used in this webinar’s title, Return on Investment (ROI).

When you are looking to improve your ROI in your training strategy, you need to understand clearly the training savings metrics, saved commute hours, lifelong expense of your LMS solution, overall productivity and revenue increase, other factors specific to your business and training model.

In conclusion, we can see selected companies  transforming their business opportunities for the XR technology and adopt it regardless of cost and ‘clunkiness.’ Today we see leader enterprises utilizing XR for training, maintenance, engineering, and marketing purposes. These companies eventually pull everyone else in their direction as the industry caters to their operational needs and chases enterprise benefits.

Join 200+ Attendees Online Next Week for our Enterprise Webinar Expert Panel

RSVP here

Our Enterprise Industry Committee will present the latest case studies, best practices, and ROI for applying VR/AR in the enterprise. Join executives from Accenture, Atheer, Fieldbit, Intel, Motive, Nielsen. We expect 200+ attending live. Join us for the Q&A! RSVP here

Foreword by Jay Fraser, Global Head of VR for Training at HP, to our VR/AR Training Industry Sector Report

** If you are interested in being featured in this report or want to receive a copy, email info@thevrara.com **

Come see Jay Fraser speak at our VRARA Enterprise Summit at LiveWorx on June 10th

First off, thanks to the folks at the VR/AR Association for moving the industry needle and serving as the connecting file for companies across the ecosystem. Before you get cracking on this wonderful report, allow me to share some perspective on training and how VR/AR disrupts the norm.

Training Overall

There is a head scratching data point that I have been referencing lately: corporations collectively spend $350 billion on training each year. To put that in perspective, corporations spend more annually on training than the Gross Domestic Product of 83% of the countries in the world. And what are the results? Before we get there, think about the last time you experienced company training. Was it effective? Were you engaged? Did you remember anything? Answers are probably overwhelmingly no. And you aren’t alone. Most executives think that their company learning and development is ineffective and many employees do not think they are effectively trained to do their job and/or find their training useless.

So what’s the problem?

In a word, practice. To be effectively trained, employees must be afforded the opportunity to practice what they learn. Ask any athlete, first responder, or military service member how often they practice. One of my favorite quotes is from Olympic Gold Medal Swimmer Rowdy Gaines: “I swam around the world for a race that lasted 49 seconds.” I came across this quote in a book analyzing the characteristics of top performers. Practice is not easy, both physically, but also, and more importantly for the purpose of this audience, financially. Think of the economic cost of delivering effective training to a workforce: the logistics, facilities, content, instructors, and employee “downtime”. It’s tough to scale good training but training is crucial to having productive employees. Add to the mix an aging workforce, a skills gap, fleeting employees and we are bordering on a training crisis!

Why should you care?

As an employee, you should want a safe, productive work environment and well-trained, capable teammates. Safety shouldn’t be overlooked. In the US alone, 14 people per day die at work in preventable accidents. As a member of society, you should want humans to stay sharp, adaptable, and relevant, particularly with the onset of artificial intelligence and the employment implications. A recent McKinsey Global Institute Report purported that over the next decade, as many as 375 million workers may need to switch occupations.  As an executive, you need to balance two objectives: 1) taking care of employees and 2) hitting profit goals (not mutually exclusive). Better training results in more effective employees who can make better decisions and ultimately boost productivity.

What to do about it?

Innovate or die! Embrace immersive technologies. VR/AR provide a unique ability to enable deliberate practice on a mass scale. Because it’s a virtual rendered world, any scenario can be replicated and practiced over and over again with randomization injected to throw multiple scenarios at the trainee. Randomization is a key variable as it avoids “teaching to the test” and exposes trainees to an infinite number of scenarios. Think of a pilot. How many times do they get to experience an actual crisis? Hopefully, never. Yet, they are expected to be able to make split second decisions when placed in that situation.

Who is using VR/AR for training?

To quote the great Jim Collins, “the flywheel is in motion.” Companies across just about every industry are either testing, piloting, or deploying VR/AR for training; the momentum is real. Let’s focus on only a few. Retail: Walmart recently announced that it will deliver VR Training to all stores in the United States and train more than a million employees (thanks STRIVR for making this happen!). Aerospace: several major airlines are leveraging VR to familiarize its flight attendants with the aircraft and the proper protocol in getting underway. Energy: Siemens has started to implement VR to train personnel on the maintenance and operations of its large gas turbine engines within its Energy division. Technology: look no further than my own company, HP! Our learning and development organization is developing inclusion training in VR. Also, our print global services business is piloting a VR procedural trainer on one of our large printing presses. Military: at least one large country in the Middle East is deploying squad sized dismounted troop trainers and the US Army recently announced a $480M deal with Microsoft. Law enforcement: Netherlands police department is testing VR for crime scene investigation, domestic violence, and presentation skills. The list goes on and on.

It's time to reinvent training

Another favorite quote of mine from my time as a Marine Corps officer: “we don’t rise the occasion; we sink to the level of our training” – Archilochus. HP and the many companies featured in this report are committed to enabling effective training (i.e. practice) on a mass scale. Our founders Bill and Dave believed in reinventing themselves and their company. To mark HP’s 80th anniversary this year, let’s work together to reinvent training. Enjoy the report and the creative and innovative means by which companies are doing just that.

If you are interested in being featured in this report or want to receive a copy, email info@thevrara.com



VRARA Training Committee Achievements and Plans for 2019

Screen Shot 2019-01-13 at 12.16.09 PM.png

Register for our upcoming webinar expert panel with Intel, Sentireal, and others here

Join us at our upcoming Summits, see here


A New Year is a good time for reflection on past achievements and setting new goals for the incoming year. The VRARA Training Committee is pleased to highlight the various activities that we completed in 2018 and give a preview of what we hope to achieve in 2019.

During 2018 we significantly increased the number of VRARA members contributing to the work of the Training Committee. We now have over 100 representatives making contributions via our conference calls and team collaboration tools. The Committee compiled and released a comprehensive white paper on best practices for VR/AR based training. We also released an extensive survey on how the training ecosystem is using and will use VR/AR devices, software and media to deliver enterprise training in a variety of market sectors. The outcomes and results of these two initiatives were presented to the wider VRARA community at the previous VR/AR Global Summit. Training Committee members also contributed to a training-specific panel session held as part of the same event.

In 2018 our Committee also shared and showcased several training-related projects, use cases and applications developed by our member organisations through the VRARA news channel and blog posts. We also delivered several presentations in the Training track of the previous VRARA Online Symposium.

Overall, we’re incredibly pleased with the achievements made by our Committee over the previous 12 months. We feel that we’ve made great progress in sharing and promoting best practices, new applications, experiences, projects and products related to VR/AR based training. In 2019 we have a series of goals that we want to realise. Our next VR/AR Training Webinar is coming up on 16th January 2019 and we are determined to make that our most successful online event yet. We are working on gathering together a library of VR/AR training app demos that can be showcased at VRARA-sponsored events. New and updated white papers on VR/AR training best practices and how to maximise return-on-investment from VR/AR training are in the pipeline. We also have an ongoing initiative with our colleagues in the Education Committee on areas of common interest.

We look forward to 2019 and would encourage you to join the VRARA Training Committee to build a stronger and wider ecosystem that delivers higher-quality and more-engaging training through the power of VR and AR.

We plan on growing and expanding the work we’ve done to help build resources, information, and the community for XR training applications. We are looking to host a series of Webinars, starting January 16th, to help introduce key concepts of XR training and to give companies the tools and information they need to begin successful projects in this field.  We continue to build upon some great partnerships with training conferences, allowing us the opportunity to showcase XR training applications to an eager audience of corporate trainers, educators, and decision makers. The Training Committee is excited to begin a partnership with the Education Committee to identify areas of commonality and to co-author useful guides and white papers.

Another goal for 2019 is to bring together a library of member demos. Our hope is that a centralized repository of demos will give the Association and its members the opportunity to choose industry or application-specific demos that can spark a much more targeted conversation about how XR training applies to any given field. Over the past years, we have understood the power and necessity of showing quality, relevant demos, and this collaboration will help members and the community at large in understanding the impact that XR can have on enterprise training.

Participate in our VR/AR Industry Report on the Training Sector, sponsored by HP (Last Call!)

If you are interested in being featured in this report or sponsor it, email info@thevrara.com for details!

Screen Shot 2019-01-09 at 3.17.07 PM.png

The VR/AR Association Training Committee is working on this industry report that will feature companies specializing in VR/AR for Training solutions. This report will be published in Q1 of 2019 and promoted to the industry globally.

Thank to our Sponsor!

HP creates new possibilities for technology to have a meaningful impact on people, businesses, governments and society. With the broadest technology portfolio, HP delivers solutions for customers’ most complex challenges in every region of the world and gives businesses new ways to create, design, experience, and train with VR. Learn more here

Register for our upcoming webinar, “The Impact and ROI of VR/AR in Training” here

Join us at our upcoming Summits! Sign up here

Call for Speakers! VRARA Enterprise Summit at LiveWorx Taking Place on June 10th in Boston

More info about the Summit and sign up to Speak here

The VRARA Enterprise Summit will take place on June 10th at LiveWorx in Boston. The full-day event will bring together the best thought-leaders in VR/AR from across the globe. Presentations from industry leaders will include VR/AR in the Enterprise, Training, 5G, and much more.

VRARA is the VR/AR Association, an international organization designed to foster collaboration between innovative companies and people in the VR and AR ecosystem that accelerates growth, research and education, and develops best practices and guidelines. VRARA has over 4200 companies and 25,000 professionals registered, over 50 chapters globally, and 20 industry committees. VRARA programs & initiatives are designed to accelerate anyone’s growth, knowledge, and connections.

LiveWorx is the world's most respected digital transformation conference for the enterprise. Experience the most innovative and disruptive technologies — VR/AR, IoT, machine learning, blockchain, robotics and more. 6500+ technologists are expected. LiveWorx is June 10-13.

More info about the Summit and sign up to Speak here

Call for Participation: VR/AR in Universities and Colleges

The VRARA Universities and Colleges Committee is currently putting together a Sector Report that will highlight what postsecondary education institutions are doing in the VR/AR space. The report will provide an overview of:

  • what VR/AR courses and programs are being offered by each institution;

  • how VR/AR technologies are being used to support learning and teaching in other courses and programs;

  • VR/AR-related research and/or development activity occurring at the institutions;

  • applications of VR/AR to other areas, such as recruitment, marketing, outreach, the library, and student services;

  • the institutions’ future plans in the VR/AR space.

Participation is open to postsecondary education institutions worldwide. If your institution would like to have it featured in the report, please contact info@thevrara.com as soon as possible, but no later than Friday, December 21, 2018.

Want to Sponsor this report? Email info@thevrara.com for details!

(Note: While K-12 education does not fall within the scope of this report, plans are also underway for a cross-sector effort on VR/AR curricula that will include K-12, which will be undertaken by jointly the Universities and Colleges Committee and the Education Committee)

New Examples of VR/AR Training Solutions

RSVP for our next webinar with a live Q&A!

“The Impact and ROI of VR/AR in Training”

Expert Panel Moderated by Raj Puran, Intel

Jan 16, 2019
RSVP
here



Participate in our Training Committee
here

Co-Authors:

Examples featured in this publication include:

  1. INNVESTION is a VR/AR Platform for Industry Base Training Simulation by ONE Digital

  2. Electrical Safety Certification In Virtual Reality by SkillReal

  3. Hotel Customer Service Training by Portico

  4. Augmented Reality Maintenance Aid (ARMA) by AVATAR Partners

Introduction

“The world as we have created it is a process of our thinking. It cannot be changed without changing our thinking.” Albert Einstein

Screen Shot 2018-12-04 at 10.49.36 AM.png

New technologies such as robotics and artificial intelligence are rapidly changing people's jobs and lives. Technology will likely change many of the existing jobs, requiring workers and companies to adjust. While maybe only one in seven jobs may be lost to automation, many others will change significantly. OECD suggests in their study (2018), that around 14% of all jobs across 32 countries analyzed have a high risk of automation, 32% of existing jobs may experiment significant changes to how they are carried out.

In the other hand, and according the OECD study, It is now essential to ensure that schools prepare students for a world in which they will constantly be adjusting to new technologies, new business models, and new ways of working. People, including young people, need to be equipped with the type of skills that will allow on average 25 job changes throughout their lives.

Therefore, learning systems will need to adapt to the changes brought about by automation and teach students that allow them to take full advantage of the current wave of technology adoption. This includes skills such as cognitive and social intelligence but also extends to the skills needed to work effectively in a digital context, both as specialists and users of digital technologies.

INNVESTION is a VR/AR Platform for Industry Base Training Simulation.

Carlos J. Ochoa (ONE Digital Consulting) carlos.ochoa@onedigitalconsulting.eu

The Problem

Screen Shot 2018-12-04 at 10.50.42 AM.png

New technologies are an emerging industry creating employment opportunities and entrepreneurial possibilities. According to projections set out by the European Commission, market demands for qualified information and communications technology (ICT) specialists will not be met, seeing a shortfall of up to 500,000 ICT professionals in 2020. Virtual and augmented reality solutions are amongst those with some of the highest market demand in the ICT sector.

Skills, and skills development, are an essential component of all efforts in this challenging society. Too many workers are simply unprepared to meet the needs of firms, particularly in more competitive economic environments.

New skills development for more complex jobs. Technicians need to be proficient and continue to change rapidly as tasks become more complex. Find the right info at the right moment. Technicians need fast access to all info to take fast and complex decisions.

  • High Training cost. Time, resources, maintaining and quality standards.

  • High Digitalization cost (paper, no automatization processes, decisión taking.

  • Data integration and maintenance. Manuals, documents, files…

  • Data visualization. Format, devices, availability, usability

  • Risk and performance. New complex and unpredictable situations. Actions based training methodology.

  • Quality, standards and sustainability

  • Expensive or difficult hand on practice (no experimental, no real world scenarios…)

  • Difficult assessment process.

  • Most of existing solutions are isolated, expensive and not VRAR designed. Also have a gap about learning processes, methodology and instructional approach.

Industry 4.0 Demands

Industry 4.0 is the of automation information and data exchange in manufacturing technologies.

  • Enhanced productivity through optimization and automation

  • Provide real-time data and information for real-time decision makers

  • Business continuity through advanced maintenance and monitoring possibilities

  • Higher quality products as a result of real-time monitoring and technology convergence

  • Better working conditions and superior sustainability

The Solution

Screen Shot 2018-12-04 at 10.52.54 AM.png

Engineers with the right skills, with excellent experience and experimental training, are the demands in the industry worldwide has become acute.

The need for efficient and effective workforce training and operation in the industry worldwide has become acute. VR/AR technology is the most efficient and fastest way to educate new employees and prepare them for their daily work. In the other hand, thanks to VR/AR and digital information, technicians can focus in operation & maintenance task enables them to cut down on time spent on administrative tasks, significantly increasing productivity.

VR/AR and Simulation-based training also helps increase professionals confidence because they can practice procedures until they master them. Further, trainees become more aware of safety procedures because they have to follow them in the simulations.

  • Reducing Training cost. Experiential training based on VRAR give real-time feedback and improve the efficiency of skills transfer, increased knowledge retention.

  • Reducing delays & mistakes. Using collaborative VR/AR and digital documentation, we can integrate “all in one”. Minimizing time to action in decisión taking providing technicians the complete background on an asset, detailing all historical data and repairs to quickly perform the task in hand.

  • Improving Safety. Dangerous or difficult to replicate scenarios can be safely simulated with VRAR. This allows monitors to repeatedly practice critical or unpredictable scenarios while preventing damage to equipment and persons.

  • Improving quality, and standards. Experiential Training through VRAR actively participation in the activities obtaining higher retention rates. VRAR training allows employees to receive hands on training, in a virtual environment. This prevents expensive down time and disruptions in normal operations

  • Improving assessment process. Monitors can create specific complex situations to be resolved, where Technicians will deal with different task according their role or responsibility. They will be evaluated based on their performance on the relevant work items. This information can be integrated with the company’s internal record keeping systems for certification and/or administrative action.

  • Improving preventive maintenance. Integrating applications such as electronic job sheets and work orders, on-site workers are now able to focus on the task in hand while using VRAR with tablets or smartphones. This enables them to cut down on time spent at the end of each day on administrative tasks, significantly increasing productive-time.

  • Faster and better decisions. Decision-making processes are shortened and problems, as well as defects, can be resolved quickly and efficiently

Imagine a solution, that deploy an intelligent VR/AR ecosystem with the specialized know-how to turn unstructured data into value-adding information, e.g. when providing services such as preventive maintenance, security management or operational management.

INNVESTION is an innovative platform for training, operation and maintenance of plant services, which includes advanced reality technologies in immersive environments (extened reality, 360º video), methodologies in a modular architecture (on/off line).

A cloud platform will allow users to download the different modules. For a full INNVESTION experience, the user only needs a mobile device and VR glasses that fit the device. The training centre will need an internet connection to download modules, and these can be accessed offline, only needing a connection to update new content.

INNVESTION can be used from a single “low cost” VR device based on Samsung Gear Mobile VR, through the most advanced VR Oculus Rift, HTC Vive configuration.

The Results

Simulation-based training, prefaced with traditional training methods on process fundamentals, is the most efficient and fastest way to train new employees and prepare them for their daily work providing huge added value and benefits:

  • Faster project execution, commissioning and ”time to market“ through improved collaboration

  • Cost savings through consistent plant information available at all times

  • Higher plant availability, integrating real time data and 3d visualization

  • Safe and efficient plant operations

Electrical Safety Certification In Virtual Reality (by SkillReal)

The Problem

Creating a lasting impact on people’s behavior:
A fortune 100 company has asked SkillReal to provide a Virtual Reality experience to certify and drive thousands of employees around the world to safe conduct in a critical electrical work.

The Solution

The solution was built on the foundation of the SkillReal Virtual Reality for Training platform. It’s major components are:

  1. Four detailed scenarios: Introduction to the Virtual Reality environment; Standard Electrical Safety procedure scenario; Advanced “what-if” scenario; Infrared scanning scenario.

  2. Effective user feedback: real-time feedback to trainees during the mission, and detailed personalized feedback with key critical error highlighting at the end of each scenario.

  3. Integration: with client pre-test and post-test activities – to analyze and measure the impact of the practice scenarios.

  4. Valuable Analytics: Detailed user performance tracking and analytics, recording all user actions, time taken to perform task and mission, interactions with objects and more.

The Results

Together with the client, we were able to create an unparalleled authentic user experience in Virtual Reality, with a strong sense of realism – changing a standard regulatory training requirement into a game-changing and powerful practice.

Based on SkillReal’s powerful Virtual Reality platform, the project was delivered in a very quick turn-around, with two first content packages being released with just 10 weeks, and two more released 10 weeks later.

The project leveraged SkillReal’s multi-disciplinary capabilities of Instructional Design, UX and UI in Virtual Reality expertise, a world-class 3D studio, and a creative and dedicated team of developers, QA and project management people.

“It’s super exciting work. Breaking new ground is never easy and it’s great to be partnering with you. I have endless respect for your team’s attention to detail and dedication to quality.” Senior client expert on the project

Image from SkillReal’s Electrical Safety Certification in Virtual Reality

Image from SkillReal’s Electrical Safety Certification in Virtual Reality

Hotel Customer Service Training (Portico)

The Challenge

A major hotel brand didn’t have the bandwidth to provide consistent training for new employees in many customer-focused areas. They wanted to ensure that new employees interacted with guests in way that not only followed correct procedure but also adhered to brand standards. They wanted to provide more interactivity and practice than a mere shadowing experience for new hires, but could not rely on having trainers or senior staff available.

The Solution

Portico recreated select hotel experiences inside Virtual Reality.  Learners spoke directly to digital avatars of hotel guests in order to practice and master their conversational skills. These virtual guests were powered by Portico’s TrueTalk AI, allowing them to respond with natural conversation, creating a truly immersive and realistic experience that was immediately transferrable to the workplace. Furthermore, a Virtual Trainer (also powered by AI) listened in on the conversation, providing immediate feedback if the learner deviated from established procedures or brand messaging.

The Result

The training was considered a success by both the hotel and its employees. Employees were able to practice their skills without the need for any supervision. The hotel noticed a decrease in training time along with an increase of confidence for new hires. As a result, new hires were able to enter the shift rotation faster and did so with fewer hiccups along the way.

One other added benefit was the general level of excitement from the new hires. They exhibited a genuine enthusiasm towards trying the training; the training itself became a fun “water cooler” topic for people to discuss. Some of the existing staff insisted on trying it to see what they were missing out on!

The full results can be seen here:

Coffee Service

Hotel Check In

Screen Shot 2018-12-04 at 10.56.09 AM.png
Screen Shot 2018-12-04 at 10.56.16 AM.png

Augmented Reality Maintenance Aid (ARMA) by AVATAR Partners

Marlo Brooke, President and CEO, Avatar Partners (mbrooke@avatarpartners.com)

The Challenge

Aircraft Readiness is a number one priority for both military and commercial aviation. Maintenance task troubleshooting and execution time and error rates are significant aircraft readiness degraders.

An additional stressor occurs when an organization must extend the life of its equipment; in some cases, 10-20 years beyond an aircraft’s expected life.  This puts unanticipated strain on systems and structures, resulting in excessive down time for repairs. In some cases, 40%-50% of the inventory of a platform are unusable at any point in time.

Maintenance errors are a leading cause of inventory down time. For example, a mistake made on a fuel cell replacement can result in an aircraft being down for 6 months or longer, driving enormous cost, and risk to global safety. Even the best training tools can reduce errors down to 75%, but today’s economic and global situation require something better. Aerospace needs a training solution that can be used on the job, and produce zero errors.

AVATAR Partners was approached by a community of maintainers to address a common issue in one fixed wing aircraft, which was a Wiring issue (specifically, the Left Main Landing Gear Planing Link Proximity Switch Fail).

Screen Shot 2018-12-04 at 10.57.22 AM.png

The problem was complex:

  • •          The task required 3 non-integrated sources (IETM, Wire Illuminator, Schematic)

  • •          Tasks to gain access to test points was not identified

  • •          Wire Illuminator visuals did not include installed components

  • •          Poor wire illuminator visuals cause confusion in wiring orientation

  • •          Visuals did not show necessary connection points

  • •          Time intensive testing and strict time constraints

The Solution

To address the issue, AVATAR Partners used a standard Criticality, Difficulty, Frequency (CDF) analysis model to identify the optimal training solution; clearly, an advanced solution that would allow the maintainer to get assistance without leaving the job itself, was critical.

AVATAR researched all training technologies available, and designed a Mixed Reality solution, which combines both Augmented Reality and Virtual Reality. At the time, most Augmented Reality solutions relied on the use of markers or codes to identify the object. AVATAR joined the Vuforia VIP program and developed the Augmented Reality Maintenance Aid (ARMA), and worked with the vendor to develop an advanced object tracking system that would lock on target based on the shape of the object itself (using CAD data). Furthermore, most AR solutions had the issue of drift or jitter when dealing with a large object, such as an aircraft. The maintainer must be able to walk around the aircraft without any shift or jitter; if not, the maintainer loses all confidence in the solution. AVATAR Partners was able to eliminate shift and jitter entirely, regardless of the object size.

The Result

ARMA is a Mixed Reality industrial-grade training and job performance aid, useable under unpredictable environmental conditions. The results are as follows:

  • ARMA Reduces Time to Troubleshoot by 75%

  • With lock-on Object Tracking and elimination of drift/jitter, ARMA gains 100% confidence of the maintainer

  • Because ARMA is configurable, it can be designed to support any aircraft platform type

  • ARMA is scalable, allowing the maintainer to train in any environment, with or without the aircraft, or with a scaled down model, through the use of object tracking

  • ARMA is “Two for the price of One” - can be used in both training and on the job

  • ARMA is a hardware-agnostic and integrates with flight-ready glasses today

  • Increases the number of Ready Aircraft

  • Modular, extensible, integrates with any backend system, and allows multi-user collaboration

  • ARMA offers remote assistance which allows remote Subject Matter Experts to view, guide and record  users remotely through steps and processes.

The AVATAR Team has developed other MR solutions that reduce cost and errors throughout the manufacturing process. Another example is the assembly of large, complex ships, where our team developed a Mixed Reality solution that Quality Assurance Time on Task by 90% while Eliminating Errors to Zero. Our ever-present objective, Simplifying Complex Systems™, is a success story that keeps growing.

AVATAR on Youtube

Screen Shot 2018-12-04 at 10.58.36 AM.png



Participate in our Training Committee here

Best Practices for VR & AR in Education (White Paper)

Our Education Committee has published this best practices white paper. To access the white paper, enter your email here:

Screen Shot 2018-11-27 at 11.58.56 AM.png

Authors:

Carlos J. Ochoa, ONE Digital Consulting

Contributors:

Alan Smithson, MetaVRse

Chad Lewis, Tampa Preparatory School

Dave Room, BALANCE Edutainment

Dave Ternent, HumanEyes

Julie Smithson, MetaVRse

Kris Kolo, VRARA

Mike McCready, Lethbridge College

Mfon Akpan, National Louis University

Steve Bambury, JESS Dubai

Table of Contents

Preface

Opportunity

Introduction

Introduction to the VR/AR Association (VRARA)

The VRARA Education Committee

CHAPTER 1 Future Work Skills, Reimagining Digital Education

CHAPTER 2 VR/AR Educational Ecosystem

2.1 Disruptive Innovation in Education

2.2 VR & AR Definitions

2.4 VR/AR Educational Platforms for Beginners

CHAPTER 3 VR/AR in Education

3.1 Innovation in Education

3.2 Barriers to entry

3.3 Benefits and Values of VR/AR in Education

Chapter 4 VR/AR Educational Content

4.1 Types of VR Content

4.2 Instructional Design and Storytelling in VR Digital Content

4.3 Video 360º as VR Digital Education Content

CHAPTER 5 VR/AR Educational Resources

CHAPTER 6 Case Studies VR/AR in Education

Case Study 1 Learning Resource Centers in MOE Schools (United Arab Emirates).

Case Study 2 How teacher´s use VR to enhance students’ Learning Experience. Stow-Munroe Falls School District (Stow OH).

Case Study 3 Coding in VR. Toronto (Canada). Julie Smithson partner MetaVRse.

Case Study 4 Incorporating VR in the Accounting Classroom. National Louis University (Chicago)

Case Study 5 JESS Dubai. Steve Bambury, Head of Digital Learning and Innovation across JESS Dubai.

Case Study 6 Rutgers Preparatory School in Somerset, New Jersey, United States.

Case Study 7 Implementing a VR creation lab in high school. Chad Lewis (Tampa Preparatory School).

Case Study 8 The Future of Education. Lethbridge College (Alberta, Canada). Mike McCready.

Case Study 9 Alan Smithson (CEO/Co-founder of MetaVRse) in Rumii

Case Study 10 Pacha’s Pajamas. Dave Room (CEO, BALANCE Edutainment)

Case Study 11 Schools of the Future. Miramadrid School. (Spain) Carlos J. Ochoa (CEO ONE Digital Consulting)

CHAPTER 7 Conclusions

Thank you to ONE Digital Consulting and HumanEyes Technologies Ltd., the maker of Vuze cameras, for sponsoring this White Paper. For more information about the sponsors, visit: www.onedigitalconsulting.com and www.humaneyes.com

If you would like to sponsor a future version of this report, email info@thevrara.com

Best Practices for Advertising + Marketing (White Paper)

To access this White Paper, enter your email here:

Screen Shot 2018-11-20 at 8.43.31 AM.png



Our Advertising Committee has published these best practices white paper for Advertising & Marketing.

Co-Authors:

  • Deborah Worrell, EscapeVR

  • Sophia Moshasha, Brightline Interactive, VP VRARA DC Chapter

Contributors:

  • Alban Denoyel, Sketchfab

  • Jamison Tilsner, Sketchfab

  • Reekita Shah Alias Gala

  • Roy Rodenhaeuser, Oath (Verizon)

  • Tyler Gates, Brightline Interactive, President VRARA DC Chapter

  • Kris Kolo, VRARA


Table of Contents

This white paper is broken into the following parts so you can skip to what is of interest to you:

1 Introduction

Definitions: Virtual Reality, Augmented Reality, Extended Reality

How to Experience Virtual Reality: The VR Spectrum

How to Experience Augmented Reality: The AR Ecosystem

2 Should Virtual Reality and Augmented Reality be Part of Your Marketing and Media Strategy?

VR/AR in Marketing and Advertising

How VR and AR Expand the Opportunity for Brands

Five Easy Ways to Incorporate Virtual Reality

Five Easy Ways to Incorporate Augmented Reality

How Can the Consumer Experience be Measured?

How Brands Should Evaluate VR and AR Opportunities

3 Summary

4 Case Studies

VR: “Insights from Another Reality”, Oath

VR: Toyota Teen Drive 365 Virtual Reality Experience

VR: Cub Cadet- Signature VR Experience

VR: “JEWLR”, Sketchfab

AR: Snapchat AR Ad Campaigns

AR: Yahoo Mail App AR solution (Advertising)

AR: Porsche Augmented Reality (Marketing)

AR: Nike Facebook Messenger AR Campaign

360° Video: Public Service and Advocacy— “The Silent Killer”

360° Video: KFC “Add Hope” Campaign


Screen Shot 2018-11-20 at 8.39.19 AM.png

Thank you to VRARE-VR/AR Experiences for sponsoring this paper. Please see www.ardoneforyou.com www.armasterclass.com If you would like to sponsor a future version of this White Paper, email info@thevrara.com

RSVP for our upcoming Webinar: The ROI for VR/AR in the Enterprise

RSVP here (click on the Upcoming tab)

If you would like to Sponsor this event, email info@thevrara.com

Screen Shot 2018-11-19 at 9.49.12 AM.png

Hear from the best minds in VR/AR including Accenture, SuperData Nielsen, Atheer, Itseez 3D from our Enterprise Industry Committee on the latest use cases, best practices, and ROI in theenterprise. Corporate leaders are tasked with reimagining the experiences they want for their customers in the face of a changing technological landscape. Learn why every enterprise needs aVR/AR strategy now, not later. RSVP here

Watch our Webinar recording on Location-Based VR

Watch it here

To have a look through all the slides, answered and follow-up questions from the webinar please have a look at our Google Slides presentation.

The Location-Based Entertainment Committee hosted another stellar cast of panelists. The ensemble of experts with more than 20 years combined experience running location-based entertainment included Daisy Berns (Exit Reality), Will Stackable (SpringboardVR), Ryan Burningham (Virtual Athletic League), and Sebastian Kreutz (Holocafé).

News reports of experiential location-based virtual reality (LBVR) in shopping arcades, theme parks and movie theaters are taking the world by storm. Companies including FoxNext, Zero Latency and Disney's ILMxLab with Star Wars are demonstrating that LBVR is a viable business for investment, which is clearly enticing mainstream consumers to satisfy their VR curiosity. This is demonstrated by the high levels of growth, with consumer spend expected to reach $809M by 2022.

Our go-to moderator Charlie Fink tackled the difficult issues that venues and virtual reality are facing to see profitable margins in these businesses. The deep dive explored everything from operations and marketing to pricing and throughput. Other hot topics the group examined is infrastructure and real estate. Watch this recording if you are interested in tapping the projected consumer spend of $809M in the next couple years.

Watch it here

Sentireal sponsors upcoming expert panel webinar (with live Q&A) on Training on Jan 16th

RSVP for the Training Webinar here (click on Upcoming)

At Sentireal, we create software and media platforms that turn mobile devices and
headsets into smart assistants. These assistants deliver training and guidance using VR/AR technologies, blended with artificial intelligence (AI). This combination provides "personal immersive learning" - personalised immersive content and continuous background assessment of learning progress.

About Training Webinar

Scheduled for Jan 16th  12pm est

Our Training Committee has organized an expert panel that will present the latest use cases, best practices, and ROI on VR/AR in Training

RSVP for the Training Webinar here (click on Upcoming)

About VRARA Webinars

VRARA Webinars host industry thought-leaders on various topics.  During these live webinars (webcasts/panels/symposiums) we have a live Q&A with the attendees. These Webinars are attended live by 100-800 people, and 1000s watch the recordings.  

In addition, our last Online Conference had 75 speakers and 10,000 viewers. See more info here

See our Webinars page here http://www.thevrara.com/webinars