
Christian Cousquer has worked in digital accessibility for 17 years. He’s an accessibility and immersive technology consultant in his company called Ilargia. He’s an information and communications (ICT) expert at the National Conservatory of Arts and Crafts in Paris. It’s a major public higher education institution specializing in lifelong higher vocational training.
It was founded by Grégoire Abbot. They have a museum in the university where you can find a replica of the Statue of Liberty and splendid rocket engines.
What Is Virtual Twin for Digital Learning?
They have two mottos. The first one is they must enlighten the ignorance that doesn’t know and the poverty that doesn’t have the means to know. And then the Latin one: Teaching everyone everywhere. This is the very heart of the institution. They insist on the two terms “everyone” and “everywhere.”
What is a virtual digital twin for learning? An accessible digital twin in virtual reality (VR) is like sending astronauts to the moon and creating a lunar base. They have a chemistry lab in virtual reality. You can grab everything in the lab. You can do experiments, heating experiments, liquid extractions, rotary operation, and do a lot of training. There are about three and a half hours of different experiments.
You can prepare for danger by learning how to use an eye washer. You also learn the ability to select the right personal protective equipment (PPE), and you do small gestures like a thin layer chromograph.
Virtual reality is a powerful teaching medium. VR can offer a more visceral experience than traditional screen-based media. In a sense, it gives the user a sense of skill and, in many cases, it has an emotional amplifier and a memory of the experience. It taps another brain region, the live experience region of the brain.
You say, “I had an immersive experience.”
You don’t say, “I had an educational video.”
It taps another brain region, the live experience region of the brain. This interactive component has advantages and disadvantages. It strikes a balance between immersion, accessibility, and experience, which is the main challenge of virtual reality design.
You need to differentiate between virtual and immersive practical sessions. A virtual practical session can be a 3D animation on-screen. An immersive practical session uses virtual reality headsets. It’s an active pedagogy.
The learner — or spect-actor — and the virtual reality create a sensation of being transported to another world.
But in immersive learning, there is a hidden word. Immersive refers to immersion plus body-in-action. It gives the learner an active presence. In learning, you have an apprenticeship of skills, know-how, soft skills, plus feedback. It gives you learning trends.
Between the learning action and the feedback, there is the interactivity. It’s because the learner is in action that the computer, the simulation, is answering him with feedback. Because there is feedback, it varies in the learner’s response to feedback by action.
Learning traces give you learning analytics. We have a learning management system for VR. It can evaluate the progression of the learner.
How to Design
How do you design? Focus on your plan. You need to define a strategy. Take a baby steps approach. Each stage of your project must benefit from the previous stage of your project. Both from an educational and a project management point of view.
For example, for the chemistry lab, they have two partners. One company for the development called Mimbus, a virtual reality development company. They also have the Immersive Learning Lab, which is a lab dedicated to immersive learning. They have a partnership with them to acculturate the teacher to VR.
They have a starting phase and a requirement phase. They know we want to have a realistic environment, so they begin very early with the development of a 3D computer graphic. After that, they have an acculturation to VR for the teachers. Then, they have screenwriting of the first virtual reality module.
Every Digital Twin educational project has its pedagogical objective and specificity. Their technical management phase. The focus of Mimbus Chemistry is on learning professional skills, hand gesture skills, and processes involved in chemistry experiments.
The specifications are simple. They want a tutorial for learning how to use the VR controller. The learner needs to learn skills, hand gestures, the processes involving chemistry experiments, and how to use equipment in a chemistry lab. They focus on the teaching scenario followed by the technical.
The interactivity requirement will be fundamental. They want to create a realistic environment with full internationalization in French and English. And of course, they will focus on usability and accessibility whenever possible.
The simulation has three chapters along with a tutorial and virtual tour. The three chapters are Safety, Chemistry Experiment, and Digital Twin. The digital twin chapter will have a sensor on equipment in the lab that will send data to the simulation afterward.
Something important from the project management point of view is not to use a traditional top-down organizational structure. Instead, they organize themselves into “teams of teams.” The team consists of about 25 teachers and engineers, developers, project managers, and structural designers. They want a collective intelligence. The definition of collective intelligence is that it’s a learning organization where they learn from each other.
In a traditional top-down structure or a command of teams, there are problems in communication between those groups and those groups. This kind of organization fits very well with virtual reality development.
You can have the best teacher in the world. It goes without saying that if they don’t put a virtual headset on — if they’re not familiar with virtual reality — they will not be able to produce anything in VR. That’s why a VR project is a writing process.
On the other hand, VR content producers often have no expertise in educational scripting or the profession of knowledge and skill acquisition. That’s why everything must be formalized in writing. As an example, Mimbus Chemistry specification is about 300 pages because it deals with scenarios, scenography, storyboarding, and design-thinking.
A content expert must know a few things. They need to identify the impact of virtual reality in training. They need to understand the nature of the immersive medium well. They need to understand the physiological and psychological mechanisms on which virtual reality is based and which underpin its effectiveness.
Stage one: Defining the virtual environment
A rocket goes through multiple stages. The same applies to a virtual reality project. The first stage is defining the virtual environment. It’s like in a game. You need to let the user discover the lab. This means creating a virtual tour model with tool time and addressing the danger involved with some equipment.
Next is another module for the identification and characterization of the environmental equipment. It’s like a treasure hunt. It’s more difficult. You tell your learners that they have discovered the lab in the first module. Now, they need to go into the lab and identify and characterize some equipment in it. Many teachers make mistakes in this module as it’s a difficult one.
Stage two: Make small reusable modules
The second stage is to make small, reusable modules. We have made a small safety procedures learning module with virtual endangerments. One of the strengths of virtual reality is its ability to reproduce dangerous situations safely.
So, to do that, we break down the procedure into step-by-step scenarios with branches. One scenario could be facing the danger of fire in the lab.
The team consists of developers, structural designers, and chemistry teachers who don’t know development. The project requires finding a common language among everyone for technique, content expertise, and pedagogy. Teachers don’t know development. Developers don’t know chemistry.
The team uses diagrams where there’s a scenario for every action broken down into unit tasks. Then, after the user does that, they need to go into the lab and complete the module. Everyone on the team can read and understand the diagrams. The developer can turn the diagrams into code.
Stage three: Make modules based on reusing previous models
They can make more complex modules of chemical experiments by replaying the small safety procedure modules at any time. For example, a user is doing a liquid extraction, but he is making a mistake. There is a glass that falls on the ground and breaks. You can replay the safety scenario because it’s already been developed.
During these processes, there are interactivity challenges for solving expected problems and addressing accessibility.
However, do not try to reproduce reality. You need to find an interactive reality metaphor while always thinking about usability and accessibility. To do that, you need to work with simple questions. How do you empty your collected content from a container with a spatula when you have VR controllers in your hands? How do you wash a dirty spatula? How do you deal with flexible hoses in VR?
Here’s a tip. When something is done in two seconds in real life, it must be done in two or three seconds in virtual reality. Let me show you how we use the joystick to empty or collect content in the lab very easily and very quickly. Every piece of equipment in the VR is functional.
Accessibility in Virtual Reality
Accessibility means enabling people with disability to fully enjoy their rights and fundamental freedoms by removing any barriers that they may encounter. Digital accessibility in extended reality (XR) is a field of reach and part of this equality approach. It’s a combination of web accessibility and video game accessibility. Each has its specifics.
W3C XR Accessibility User Requirements lists user needs and requirements for people with disabilities when they use immersive environments, virtual reality, augmented reality, mixed reality, and other technologies. The BBC XR Barriers Research documents the barriers in XR environments. XR Access has also done a tremendous amount of work in XR accessibility.
Tutorials
What’s the way to address accessibility? The app provides a tutorial to users to help users learn how to interact with virtual reality. The tutorial teaches commands and the different metaphors used in the application. The tutorial takes place in a neutral and clutter-free environment to prevent distractions.
The tutorial is presented in sequential-themed rooms. The user moves to the next room after completing the activities. They learn how to move around, grab an object, move an object, and interact with an object.
The tutorial should also have different levels of difficulty, such as beginner, advanced, and expert modes. Beginners receive a lot of instruction while experts only get one instruction, such as “Do the experiment.”
Addressing different disabilities
A person who is deaf or hard of hearing can view the voiceover on a wrist-mounted tablet. The user picks up their wrist and puts the tablet in their view. They’re able to see the transcript for the spoken instructions.
The team opted to use a wrist-mounted tablet for two reasons. They wanted to avoid breaking the feeling of being in an immersive virtual environment. They also wanted to ensure color contrast between the background of the text and the color of the text.
For mobility disabilities, it’s important to test all the chemistry modules with someone who uses a wheelchair. For example, if an object falls on the ground, can the person pick it up without bending down? The magic grab laser makes it possible to grab dropped items without bending down.
However, addressing color blindness and dyslexia is more involved. The simulation has three possible actions with the hand controller. One is teleportation, which they associate with purple.
The second is to grab an object, which is associated with blue. And the third is to activate an object that’s associated with yellow. They chose to use blue and yellow because it allows someone with color blindness to distinguish the two colors.
They also found that about 10% of the students confuse their index finger with their middle finger. To help them associate the right color and the action with the right finger, they created “magic rings” to match the purple, blue, and yellow actions.
Color
There’s a parameter window that has slides for adjusting the theme, colorblindness options, and font. Users can filter color based on the type of color blindness, such as protanopia, deuteranopia, and tritanopia. Once they select a type, they can use the slider to change the intensity level. They can also change the font.
The environment avoids identifying anything by color alone. For example, a user selects items to answer a question. The wrong answers will appear in red (or whatever color it is for the colorblindness type) as well as with an “X” symbol. Color is not the only way to know if something is right or wrong. There are symbols to help identify right and wrong answers.
The lab also addresses the Proteus effect. This is a phenomenon in which the behavior of an individual in a virtual world is changed by the characteristics of their avatar. For example, a female user has male hands in virtual reality. The lab allows the user to choose between male and female hands.
Input preferences
The lab also allows users to modify their input preferences. They can remap the keys for controlling movement or interactions in the virtual settings. For example, they could hold down keys for an action. This can be changed to one click to grab and a second click to release.
Adding this type of functionality complicates the development. It requires modifying the entire experience including the tutorial. The main challenge in designing the virtual environment is the balance between immersion and user experience.
These accessibility settings have been built with open source on GitHub. People with disabilities helped build and test the settings.
Usability is also important. They have young kids testing every module. The purpose is to see if the kids can use the module without any help. This allows them to verify the ease of use and the difficulty level of understanding the lab exercises. They tested the lab with a 12-year-old gamer. It was the kid’s first time in virtual reality. They picked it up very quickly.
How Can Virtual Reality Be Used in Learning?
Virtual reality can be used in many disciplines and to develop many skills. If people need to learn professional gestures in technology, sciences, medicine, life sciences, or geology, they can do so in virtual reality with immersive simulations.
If people are learning soft skills in all teaching disciplines, they can do this through interviews and role-playing dealing with avatars. Virtual reality is good for immersive visualization of 3D calculations for math and sciences.
A virtual reality module can be put into virtually any existing curriculum. It can be in autonomy, upstream of a course, support for a course, after the course to reinforce knowledge, and as an evaluation.
Watch the Presentation
Transcript: The Challenges of Implementing Accessibility in a Digital Twin for Learning
CHRISTIAN COUSQUER: So, hello. You can grab the presentation at this address here. If you have my problem in distinguished contrast, feel free to configure the display of this presentation here. You will see it will change.
You can change the font type. You can do lots of things for your accommodation. Challenges of implementing Accessibility in a Digital Twin in VR of a Chemistry Lab, I have a subtitle. Designing an accessible digital twin in virtual reality.
It's like sending astronauts to the moon and creating a lunar base, and you will see why. So the challenge of implementing accessibility in a digital twin and virtual reality of a chemistry lab. An accessible digital twin in virtual reality is like sending astronauts to the moon and creating a lunar base. So, in this presentation, I do hope you will learn strategies for designing and managing Digital Twin and virtual reality for learning, strategy for pedagogically scripting VR content, and I have addressing accessibility challenges.
You will also discover a VR digital twin of the chemistry lab from CAP'VR and JENII Projects to Mimbus Chemistry. Also, improve your skills in Frenglish. I'm French. My name is Christian Cousquer.
I'm working in the field of digital accessibility for 17 years now. I'm an accessibility and immersive technology consultant in my own company called Ilargia. I'm an ICT expert at the National conservatory of arts and crafts in Paris. I'm also a former comedian.
It's a major public higher education institution specializing in lifelong higher vocational training. It was founded by Gr goire Abbot. We also have a museum in our university where you can find a replica of the Liberty statue and splendid rocket engines. And we have two mottos.
The first one is we must enlighten the ignorance that doesn't know and the poverty that doesn't have the means to know. And then the Latin one, Teaching everyone everywhere. This is the very heart of the institution. We're going insist on those two terms "everyone" and "everywhere."
So what is a virtual digital twin for learning? It is this. So this is the chemistry lab in virtual reality. We have a virtual tour.
You can open tool type. You can grab everything in the lab. You can do experiments, heating experiments, liquid extractions, rotary operation also, and you can train a lot. We have about three and a half hours of different experiments.
You can be put in danger and learn how to use an eyewasher, by example. You also learn the ability to select the right personal protective equipment, and you can recognize the risk that deals with inflammation and do small gestures like a thin layer chromograph. So the laboratory occupancy, and you can learn a lot with it. And virtual reality is a powerful teaching medium.
VR can offer a more visceral experience than traditional screen based media. In a sense, it appeals to the user special memory and give them a sense of skill and, in many cases, has an emotional amplifier and a memory of the experience. You said, I had an immersive experience. You don't say, I had an educational video.
It taps another brain region, the live experience region of the brain. So this interactive component has advantages and disadvantages, and striking a balance between immersion, accessibility, and experience is the main challenge of virtual reality design. You have an immersive practical course at the National conservatory of arts and craft on the picture. And you need to differentiate between virtual and immersive practical session.
A virtual practical session can be a 3D animation on screen. An immersive practical session uses virtual reality headsets. It's an active pedagogy. The learner, or spect actor, and the virtual reality creates a sensation of being transported to another world.
But in immersive learning, there is a hidden word. Immersive refers to immersion plus body in action. It gives the learner an active presence. In learning, you have apprenticeship of skills, know how, soft skills, plus feedback.
It gives you learning trends. But between the learning action and the feedback, there is the interactivity. It's because the learner is in action that the computer, the simulation, is answering him with feedback. Because there is feedback, it varies in the learner's response to feedback by action.
Learning traces gives you learning analytics. We have a learning management system for VR. It gives you, as, for the teacher, he can evaluate the progression of the learner. So let's go deeper.
How to design? Focus on your plan. You need to define a strategy. I can give you advice.
Take a baby, step by step strategy. Each stage of your project must benefit from the previous stage of your project. Both from an educational and a project management point of view. For example, for the chemistry lab, we have two partners.
One company for the development called Mimbus. they're a really cool, top development. It's one of the best companies for virtual reality that I know. And then we have the immersive learning lab, which is a lab dedicated to immersive learning.
We have a partnership to them to acculturate the teacher to VR. We have a starting phase, a requirement phase, and we know we want to have a realistic environment, so we begin very early the development of a 3D computer graphic. After that, we have an acculturation to VR for the teachers. After that, we have screenwriting of the first virtual reality module.
So request scoping phase, every educational project has its own pedagogical objective and specificity and, therefore, their own technical management phase. For Mimbus Chemistry, we want to focus on the learning of professional skills, hand gesture skills, and processes involved in chemistry experiments. So our specification are really simple. We want a tutorial for learning how to use the VR controller.
We want the learner to learn skills, hand gestures, the processes involving chemistry experiment, how to use equipment in a chemistry lab. So we need to focus on the teaching scenario. The technical will follow. And the interactivity requirement will be fundamental.
We want a realistic environment. We want full internationalization in French and English, and we want to focus on usability and accessibility whenever possible. So this simulation has, for the moment, three chapters. we have a tutorial.
We have a virtual tour. We have a safety chapter. We have a chemistry experiment chapter. And we'll have a digital twin chapter where there will be a sensor on equipment in the lab, and we will send data to the simulation after.
Let's see also something that's very important in the project management point of view. We do not want to have a traditional top down structure like this. We want to organize ourselves like a team of teams. We want to have in our team, we are about 25 teachers and engineers, developers, project managers, and structural designer on our team, and we want to have collective intelligence.
And so I give you the definition of the collective intelligence. It's a learning organization. We learn a lot from each other. That's very important.
In a traditional top down structure, or a command of teams, there are problems in communication between those groups and those groups. So this kind of organization fits very well to virtual reality development. So the VR acculturation of the teacher is a virtual writing process. You can have the best teacher in the world.
If he doesn't put a virtual headset on, if he or she is not acculturated with virtual reality, they will not be able to produce anything in VR. On the other hand, VR content producers often have no expertise in educational scripting or in the profession of knowledge and skill acquisition. In VR, everything must be formalized in writing. As an example, Mimbus Chemistry specification is about three handwritten pages now because it deals with scenarios scenography and design.
A content expert has to know a few things. He needs to identify the impact of virtual reality in training. He needs, also, to understand very well the nature of immersive medium and the physiological, psychology mechanisms on which virtual reality is based and which underpin its effectiveness. So lift off, let's go deeper.
The first stage of the rocket, you need to define the virtual environment. It's like in a game. You need to let the user discover the lab. And so we create a first virtual tour model with tool time and the danger addressed with some equipment.
Next, a module, another module, for the identification and characterization of the environmental equipment. It's kind of a treasure hunt. It's more difficult. You will say to your learner, Okay.
You have discovered in the first module the lab. Now go in the lab and identify and characterize some equipment in it you have discovered before. Many teachers are making mistakes in this module also. It's pretty difficult.
The second stage of a rocket, make small, reusable modules. We have made small safety procedures learning module with virtual endangerments. One of the strengths of virtual reality is its ability to reproduce dangerous situations in complete safety. So, to do that, we break down the procedure into step by step scenarios with branches.
You can smell poisons. You can face a fire danger in the lab. To do that, we are developers, teachers, chemistry teachers who don't know development. We have structural designer.
We need to find a kind of common language between us. We are doing BBPM diagrams. There's a scenario where every action are decomposed into unit tasks. You need to do that.
Then, after the user needs to do that, he needs to go there and go there and go there to achieve the module. You see? And a chemistry teacher can read this. A developer can understand those diagrams to put those diagrams into code.
So that's very important to have those kind of things. The first stage of the rocket, it's to make modules that can use the previous modules. So we make chemical experiments in which we have replay the small safety previous module at any time. I will give you an example.
A user is doing a liquid extraction, but he is doing a mistake. There is a glass which falls on the ground and who is breaking. You can replay the safety scenario because you have already developed it before. And during all of this process, we have interactivity challenge, and we need to solve an expected problem in addressing accessibility.
So one of the specificity of virtual reality development, it's that it is quite the reality. It's a virtual reality. It's quite reality. So you do not try to reproduce reality at any cost.
You need to find an interactive reality metaphor while always thinking about usability and accessibility. To do that, you need to work with simple questions. How do you empty your collect contents from a container with a spatula when you have VR controllers in your hands. How do you wash a dirty spatula?
How do you deal with VR? I can give you advice. When something is done in two seconds in real life, it must be done in two or three seconds in virtual reality. Let me show you how we use the joystick to empty or collect content in the lab very easily and very quickly.
So I grab the spatula, and then I trig up the joystick or trig down to empty it. You can mix content very easily, like that. You see? It must be very easy.
We do not have to calculate the position of the spatula. We just put the spatula on the top of a container, and we just trig the joystick. You can see that every equipment is functional also. So let's talk about accessibility in virtual reality.
Accessibility means enabling people with disability to fully enjoy their rights and fundamental freedoms by removing any barriers that they may encounter. Digital accessibility is a part of this approach. It's a field of research. It's a combination of where accessibility and video game accessibility and, very important, with emphasis on specificity.
It's not entirely the video game accessibility. It has its own specificity because of the viscerality of the medium. There are documents on the web by the W3C XR Accessibility User Requirements. There's very important research and, most of all, XRAccess that has done a tremendous amount of work also.
So how do we address accessibility? We provide our user tutorial in order to familiarize him with the available interaction. The aim of the tutorial is to teach the user the command of the virtual reality equipment, the different method used in the application in a clear and progressive way. It must take place in a neutral and uncluttered environment so as not to distract the user from the various actions expected.
The tutorial is presented in the form of successive themed rooms, which the user will have to validate, one after the other, moving around, grabbing and object and moving an object, and interacting with an object. You will see the tutorial in two minutes. You need to also provide your use we are a different level of difficulty, a beginning mode, advanced mode, and expert mode. Beginner mode, the user has a lot of information to achieve the exercise.
In the expert mode, he has just one instruction. Do this experiment. He must do it. Addressing hearing, every spoken instruction by a voiceover is reproduced in writing on a wrist mounted tablet.
You can see it on the right. With this, a Deaf student was able to pass all of her exercises in a practical, immersive chemistry session. We choose to have a wrist mounted tablet because of two things. If he needs to have an instruction, he needs to do some things to read.
He needs to do a gesture to read it. We don't want to break the immersive sensation by having text on the virtual environment. We want, also, to have a clear, contrast difference between the background of the text and the color of the text. So we use a wrist mounted tablet.
Addressing motor impairment, all chemistry modules can be completed in a wheelchair. It's very important to have those who are testing things on a chair. When an object falls on the ground, it can be picked up without bending down, thanks to magic grab laser. You will see it here.
You see the laser. We grab very easily without bending down too much. If I take a spatula, you will see now. If I drop it on the ground, I can grab it very easily.
More complicated, addressing color blindness and dyslexia, we have, in our simulation, three possible actions with the hand Controller: Teleportation, which we associated with a purple color, in the first room of the tutorial. Grab an object, what we associate to the blue color, and activate an object which is associated with the color yellow. The choice of these blue and yellow colors was made because a person having color blindness will always distinguish yellow from dark blue.
But we also realize that about 10 percent of our students confuse their index finger with their middle finger on their hands. So we imagine some magic rings that will associate the right color and the action to the right finger. The third option is a filter of color according to the type of color blindness: Protanopia, deuteranopia, and tritanopia, which changes the font completely. You see, at any moment, we can change the parameter.
So here are the magic rings. We can now change the theme of the text. We can use the color filter and, also, there's a slider of intensity. And now, we can change the font.
You will see that the color change, there's a perfect combination with the color filter. It's always understandable for someone who has color blindness. Addressing color blindness, part two, the information must not be given only by color. You will see here, again, the magic ring.
We also have people who are looking at the top of their wrists, on the tablet, and some at the bottom. The tablet is always readable and operable. So let's see if the lab has someone who has tritanopia. I have a quiz.
I will have a mistake and a good answer. So you see, perhaps, the error and the good answers. But, now, if I have the protanopia filter, you will not be able to have a good answer and then miss an answer. You can see that the information is not lost.
Things to come in accessibility in the chemistry lab, we want to address the Proteus effect. It describes a phenomenon in which the behavior of an individual, within virtual words, is changed by the characteristics of their Avatar. I will give you an example. I have an old man hands in virtual reality, I will walk slowly.
And we have a Proteus effect in the lab. Women with virtual male hands have strangely brusquer gesture. So we want them to choose between male and female hands. Also, holding down of two long keys.
We also want to give the user the ability to one click to grab and a second click to release the object. We also want to give the user the ability to modify their input preference. The remapping of keys used to control movement or interaction in virtual environments is more complicated than it seems because it involves modifying the entire experience dynamically, including the tutorial, according to can to the user preferences. And it takes time.
Striking a balance between the immersion and ease of use of experience is the main challenge in design. All of these accessibility settings have been built by, tested with, and for people with disability. There's open source on GitHub. Other things not related with accessibility, it's usability.
We are also testing every module with young kids for usability to see if, without any help, a boy or girl can use them. We're testing the ease of use and the understandability of the lab exercise. Let's see a young kid at 12 years old, a young kid in the lab. It was the first time in virtual reality.
Ten minutes after, he was reacting like this. Also, it's a gamer also. You can see he can do things very quickly. That's cool to see that.
Let's see the users in the classroom. If designing the virtual reality chemistry lab is a project, deploying it in the classroom is another project. So, first of all, VR for which disciplines to develop which skills? If you need to learn professional gestures in technology, hard sciences, medicine, life sciences, geology, in VR, you have to immersive simulations, VR modules.
If you are learning soft skills in all teaching disciplines using role playing dealing with Avatars and interviews. Virtual reality is good for immersive visualization of 3D calculation for mathematics and hard sciences. Where to place a VR module in an existing curriculum? We found that potentially you can put virtual reality everywhere, in autonomy, upstream of a course, as support of a course, after the course as knowledge reinforcement, and, also, as an evaluation.
As an evaluation because we have a learning management, an open source learning management system for VR called Mimbus Vulcan. Also for accessibility, we can say that this user needs to have more time to achieve an exercise, and we can set this parameter into Vulcan, and this user will have more time to achieve his exercise in VR. So, well, I'm finished. Thank you for your attention.
I'm open to your questions.
THOMAS LOGAN: Thank you so much, Christian. We have questions now from YouTube. I'm going to bring those to you, and we'll go through them one by one. First question: Given the chemistry lab has multiple sensory inputs, including olfactory, how are these being integrated to maximize learning experience?
Have there been challenges allowing people to use alternative methods besides controllers?
CHRISTIAN COUSQUER: We're looking to see if, perhaps, we can use other controllers. But it's very difficult because we need to have hand gestures. If I take an Xbox controller, I do not have a gyroscopic center to have position of the hands. It's very delicate for us to use such kind of scrollers.
We need to have VR controllers at the moment. It's a big reflection we have.
THOMAS LOGAN: Another question we have from Oscar. Can you explain the design of the magic rings and just go over that design a little bit more?
CHRISTIAN COUSQUER: Oh, it's very simple. We found that we have learners who were clicking with their index finger and middle finger. We want to help them that when you interact with this object, this is highlighted in blue, so you can grab it. so it's the middle finger.
And he grabbed it. We found it works very well. Perhaps we will add some sound when the very delicate indication that this object is grabbable. This object is activable.
Do you see?
THOMAS LOGAN: Yes. Great. Thank you. Next question.
Have there been any challenges allowing people to use alternative input methods besides the controllers? Just any feedback of what you've learned if they're not using the default controllers?
CHRISTIAN COUSQUER: Again, it's very different than virtual reality controller, to have the position of the hands in the virtual environment. We do not want to click on a button to do a movement of the hands. It should be something done with the hands. I'm not sure if I'm clear with that.
One of the goal of the chemistry lab is to learn hand skills gestures. So the hands need to move in virtual reality. Not to click on the button. It will be a nonsense for us.
THOMAS LOGAN: Right. I think if you can pull that slide up again too. You have a slide with all the different air conditions that can occur.
CHRISTIAN COUSQUER: I can. I need to expand my screen here and see if I go where is it? Is color blindness, yes! It is here.
THOMAS LOGAN: Okay.
CHRISTIAN COUSQUER: So in the tutorial, you see that there is a picture on the wall where we indicate the interactivity. Grab an object. Interact with an object. You see the ring color, the color of the ring, the laser is now yellow or pink.
The ring will be always the same color. Do you see?
THOMAS LOGAN: Yes.
CHRISTIAN COUSQUER: Grab an object. It is green now. The ring is green also. To activate an object, it's pink.
So you need to choose the index finger. Pink. The laser is pink there. And it works.
THOMAS LOGAN: Great. That's perfect. So we'll go to our next question. Thank you.
Next question. How can people outside the experience best see and communicate with the people inside? Any consideration for co piloting or annotation?
CHRISTIAN COUSQUER: I can share something with you. I have, on my computer, a video of an immersive practical course. I will show my screen. Ba, ba, ba, where is it?
It is here in the video. It's this one. We are doing practical works. You have here I will just cut some things.
Let's see. You have a student with a virtual headset. Another student is with him. This student will give clues to this one, and they work together.
He is working in the beginner mode. After that, this one will be in expert mode. He will be helped by the first one with the notes of the second. You see, he is not alone when he is in virtual reality.
A student is not alone. I'm quite sure of that. And you have a teacher here, behind, who is looking to every student and who is doing a feedback session after that. Are those things clear for you?
THOMAS LOGAN: That's great. We're going to go to the next session. The next one: How much work was it to change to work with one handed or think about the control, mapping? Like, how much work was that?
CHRISTIAN COUSQUER: Oh, I don't know how much work it takes. I'm quite sure that in three months, we're have the remapping.
THOMAS LOGAN: Okay. Sorry. That makes sense. It's hard to make it.
CHRISTIAN COUSQUER: We have planning. We need to develop. We have about seven hours of different experiences to develop. So we need to develop modules.
We need to develop accessibility. It's step by step.
THOMAS LOGAN: Yeah. And that will be my last question for tonight's presentation. Thank you so much. Yeah.
I'm curious. Your implementation has so many accessibility features. For me, when I met you, I was like, wow, you're implementing a lot of these features. Can you just talk about how you're able to prioritize that and maybe recommendations to people outside of your environment.
How can you get people to think about this and make progress?
CHRISTIAN COUSQUER: To help the other people to design and develop accessibility in VR, you need to just think that accessibility is not a constraint. It's important to innovative. People have invented smartphones and text screens like this for people with disability. During the first war, there's been tremendous invention with the guys who were wounded by the war.
So it's important to innovate. After all, it's a civil right. You need to do it. You see?
You don't have to ask questions, to wonder if you should do accessibility or not. You need to do it. You have so many people with some disability. It's also a marketplace for you.
I do not know companies who say, well, 20% of our market don't interest me. You need to address accessibility and to fight for that.
Speaker Bio
Christian Cousquer is an ICT Specialist in Web Software Engineering who is interested and passionate about web development languages, immersive technologies (XR), accessibility (a11y), internationalization (i18n), standards, open-source, diversity at the National Conservatory of Arts and Crafts in Paris.
Christian is in favor of a safe, open, diverse, and accessible Web. He’s an IT consultant who specializes in immersive technologies and digital accessibility in his company, Ilargia Inc.
Does Your Website or Technology Need an Accessibility Audit or VPAT?
Equal Entry has a rigorous process for identifying the most important issues your company needs to address. The process will help you address those quickly. We also help companies complete the VPAT to create their conformance reports so they can sell to the government or provide them to potential clients who require them. If you’d like to learn more about our services for auditing and creating VPAT conformance reports, please contact us.