Lufthansa Aviation Training and 3spin Learning develop AI-backed crew training with Apple Vision Pro

Get to see Lufthansa speak during our Best of Europe: XR, AI, Immersive Tech event on March 21!

• Vision Pro opens a new chapter in digital training design
• Lufthansa Aviation Training (LAT) is investigating the future of AI-backed training for airline crews
• The benefits of physical and virtual environments are combined in realistic scenarios

In close collaboration with Apple and 3spin Learning

Lufthansa Aviation Training (LAT) is taking crew training to a new dimension. While crew training has traditionally been done analogically and without surprises for students, concepts will evolve significantly in the future with the help of Apple's Vision Pro based on its advanced technology. The jointly developed application will initially focus on interpersonal skills training.

Virtual Reality (VR)

has played an important role in LAT's training routine for several years. Currently, 20,000 training sessions per year are carried out in two virtual reality centers in Frankfurt and Munich, contributing to greater training efficiency and cost savings. The fusion of the virtual world and reality has been limited, but Apple's Vision Pro opens up new possibilities based on available technology.

As the world's first application in the field of aeronautical training

Specific de-escalation training has been carried out for Vision Pro. This scenario is particularly suitable because it allows the simulation of variable situational behaviors of passengers using Artificial Intelligence (AI) taking into account the reactions of the crews. Before the official launch in the US in early February, Apple provided the opportunity to extensively test the designed software.

Spatial computing

The training uses Apple's innovative Vision Pro features in "Spatial Computing" to represent realistic situations in an overlay of the virtual cockpit environment and the real world in the training center. By integrating AI algorithms, the learning content is highly individualized and tailored to the needs of the learners and therefore allows for effective and efficient training.

Trainees receive real-time feedback from instructors, who also have the ability to adjust situations and passenger behavior. The ultimate goal is to individually promote the required competencies of the crews. No two training sessions are the same.

Senior Director of Aeronautical Training Development, Lufthansa Group

“We are excited about the new possibilities offered by Apple's Vision Pro. LAT aims to actively unlock the potential of this advanced technology for aviation training.” (Gilad Scherpf)

Co-founder of 3spin Learning

“The combination of AI and Spatial Computing heralds a paradigm shift for the formation of social skills. Since such courses no longer have to be laboriously programmed thanks to our authoring tool, I expect rapid dissemination of this learning method.” (Thomas Hoger)

The ongoing collaboration aims to validate, further optimize and integrate the concept into existing training concepts. In addition to the initial use case, additional scenarios can be developed and implemented based on the customer's needs in the short term.