Sponsor Message:
Aviation Technical / Operations Forum
My Starred Topics | Profile | New Topic | Forum Index | Help | Search 
A Question For The Experts: Multimodal Interfaces  
User currently offlineTurin_airport From Italy, joined Oct 2001, 278 posts, RR: 2
Posted (9 years 4 months 5 days 4 hours ago) and read 3359 times:

I would like to have your opinion about the use of a "multimodal" interface in the cockpit during flight or on the ground.

I try to make myself clear: a "multimodal" device is a system that can be activated and controlled both using traditional buttons or by the user's voice: that means that the user can give voice commands, or press buttons to interact with the system and receive spoken and/or visual/acoustic feedback.

An example (purely hypothetical) could be the belt signal: nowadays it's a button with a light to indicate if it's on or off. Its "multimodal" version could be also activated (or deactivated) giving a voice command (for example: "sit belt on"/"sit belt off"), and receive a vocal feedback by the system (along with the visual one).

My question is: in your opinion this interaction modality could be usefull in airplanes to manage secondary devices (for obvious reasons not the main controls) and which devices or controls would benefit by the combined use of the voice and traditional buttons?

Thanks a lot for your replies.


P.s.: such devices are currently been implemented in the automotive field. Few weeks ago Microsoft announced they are working with Ford to sell things like these:


5 replies: All unread, jump to last
User currently offlineAirfoilsguy From , joined Dec 1969, posts, RR:
Reply 1, posted (9 years 4 months 5 days 2 hours ago) and read 3349 times:

My dad has a Mercedes S550 that has this. It does not work so well (at least on the car). For example, he was showing me the car and said something like "change radio 107" and the sunroof opened. I almost died laughing and he was not pleased. I don't think the technology is at the point where they can put it into airplanes. Would be great once all the bugs are worked out though, brings back memories of Firefox.

User currently offlineBAe146QT From United Kingdom, joined Sep 2006, 996 posts, RR: 0
Reply 2, posted (9 years 4 months 5 days 2 hours ago) and read 3348 times:

"Set tranponder to... Oh, hi Jack! How are you?"

This should really be designed by a British company. We do farce better than anyone.

Todos mis dominós son totalmente pegajosos
User currently offlineTurin_airport From Italy, joined Oct 2001, 278 posts, RR: 2
Reply 3, posted (9 years 4 months 4 days 22 hours ago) and read 3320 times:

Like every other technology, a voice interface works as well as the effort you put in designing and making it.

The current systems can reach a reliability of more then 97% of correct catches. All depends by how many memory you have available and by how easy to use is your interface.
So, technically speaking, I think it's not a big deal, the question is: is it useful? Can this kind of interface help the pilot (or the f/o)?

Many secondary commands come into my mind: in theory, using the voice to activate/deactivate a secondary command could let the pilot to be free to concentrate on the most important actions. But, is it true? And which commands could be the candidate?



User currently offlineBrenintw From Taiwan, joined Jul 2006, 2006 posts, RR: 1
Reply 4, posted (9 years 4 months 4 days 14 hours ago) and read 3264 times:

My experience of voice-activated software has been woeful. Personally, I wouldn't trust it in an aircraft until a lot more work has been done on it. VA software is very accent-sensitive -- and it requires a huge amount of work to get the software accustomed to *your* voice.

I remember working on a version of IBM's "ViaVoice" software that we were evaluating for work. It took about two hours to set up the software to recognize my voice (I'm not American, so it really did struggle with my accent) and even after doing all that, it has a success-rate something less than 30%. More recently, Windows XP Tablet PC Edition had similar problems, although it did have a significantly higher success rate.

The biggest problem with VA in an aircraft would be the sheer amount of storage and processing power that would be required to compare voice-prints. The software would need to build up a database of voice-print references for every single pilot that ever flies that particular aircraft and then when the pilot issues a command, cross-reference the command against all the databases to match the voice-prints to guess at the correct command. In a private aircraft, or aircraft that is flown by three or four pilots only, that would be workable, but not a mainline aircraft for a major carrier (how many B744 pilots does BA have?)

User currently offlineTurin_airport From Italy, joined Oct 2001, 278 posts, RR: 2
Reply 5, posted (9 years 4 months 4 days 4 hours ago) and read 3237 times:

Brenintw,, no, the technology used nowadays is called "speaker independent". That means that the recognition engine is capable of understanding commands, no matter the accent or gender of the speaker (the only thing to pay attention to is speaking the same language of the system).

So, given that the technology is not the problem, I would like to know if pilots could find the use of voice (or better, multimodal) interfaces helpful when they are in the cockpit, and which actions could be made using the voice (for example: selecting a new map on the screen, or interrogate the system about flight parameters, or else).

That's the way the multimodal interfaces are used in the automotive field these days: they help the driver to concentrate on the driving, without having to search for buttons to manage secondary devices, like telephones, navigators, mp3 player, and so on.


Top Of Page
Forum Index

Reply To This Topic A Question For The Experts: Multimodal Interfaces
No username? Sign up now!

Forgot Password? Be reminded.
Remember me on this computer (uses cookies)
  • Tech/Ops related posts only!
  • Not Tech/Ops related? Use the other forums
  • No adverts of any kind. This includes web pages.
  • No hostile language or criticizing of others.
  • Do not post copyright protected material.
  • Use relevant and describing topics.
  • Check if your post already been discussed.
  • Check your spelling!
Add Images Add SmiliesPosting Help

Please check your spelling (press "Check Spelling" above)

Similar topics:More similar topics...
Question For The Aeronautical Engineers ... posted Sat Jul 15 2006 01:03:42 by Sesd97
A Question For The Airbus NG Drivers posted Sat May 1 2004 00:40:44 by CPH-R
Slat Question For The 707 Pilots & Mechanics posted Fri Feb 27 2004 22:32:00 by Happy-flier
Question For The Pilots posted Sat Mar 31 2001 00:52:23 by 36r
For The Pilots: Checklist Question posted Mon Jun 7 2004 08:06:07 by Cancidas
For The Pilots, An ATC Question posted Wed Aug 13 2003 05:37:42 by Cancidas
For The A&P's- A Question posted Fri Dec 14 2001 04:45:16 by Sccutler
Reason For The 737 Higher Front Windows? posted Sun Jan 7 2007 20:58:51 by Ps76
Question For Continental Mechanics posted Thu Dec 14 2006 23:32:37 by Charlienorth
Question For Those That Have Heard Sonic Booms posted Mon Oct 23 2006 04:09:55 by FLY2HMO

Sponsor Message:
Printer friendly format