Captions in cross-reality (XR) provide an opportunity for participants with language barriers or hearing and speaking differences to communicate across. This talk covered the captions design and implementation (so far) in AltspaceVR from the perspective of one of the engineers who worked on it. In addition, this talk explores how engineering and design teams might think about designing software for those who experience XR differently from them.
Evan Tice is a Senior Software Engineering Lead for AltspaceVR, within the Mixed Reality organization at Microsoft. He led the integration of captions into AltspaceVR and has worked in the past on Hand interactions with HoloLens, as well as other HoloLens features. Previously, he was an engineer on the Windows team.
Here are some of the highlights from his presentation:
- Get an overview of AltspaceVR
- How captions work in AltspaceVR
- How speech translation works
- Q&A: Could you talk about the two-way translation?
- Makoto Ueki speaks Japanese
