OpenEars: open source speech recognition and text-to-speech for iPhone and iPad development
January 31, 2011 9:43 AM Subscribe
OpenEars: open source speech recognition and text-to-speech for iPhone and iPad development
OpenEars is an open-source iOS library for implementing round-trip English language speech recognition and text-to-speech on the iPhone and iPad, which uses the CMU Pocketsphinx and CMU Flite libraries.
OpenEars can:
• Listen continuously for speech on a background thread, while suspending or resuming speech processing on demand, all while using less than 10% CPU on average on an iPhone 3G (decoding speech and speaking uses more CPU),
• Use any of 8 voices for speech,
• Know whether headphones are plugged in and continue voice recognition during speech only when they are plugged in,
• Dispatch information to any part of your app about the results of speech recognition and speech, or changes in the state of the audio session (such as an incoming phone call or headphones being plugged in),
• Deliver level metering for both speech input and speech output so you can design visual feedback for both states.
• Support JSGF grammars,
• Be easily interacted with via standard and simple Objective-C methods,
• Have all significant operating options controlled via configuration files,
• Be installed in a Cocoa-standard fashion using static library projects that, after initial configuration, allow you to target or re-target any SDKs or architectures that are supported by the libraries (verified as going back to SDK 3.1.2 at least) by making changes to your main project only.
OpenEars has lots of good documentation and depending on your connection speed it's possible to get up and running with the sample project in about 10 minutes following the Getting Started instructions. Many questions have been asked and answered at the OpenEars Support Forums. I know there are a few iOS developers here on Metafilter so I hope you'll check it out; feel free to memail me if you want to say hi.
OpenEars is an open-source iOS library for implementing round-trip English language speech recognition and text-to-speech on the iPhone and iPad, which uses the CMU Pocketsphinx and CMU Flite libraries.
OpenEars can:
• Listen continuously for speech on a background thread, while suspending or resuming speech processing on demand, all while using less than 10% CPU on average on an iPhone 3G (decoding speech and speaking uses more CPU),
• Use any of 8 voices for speech,
• Know whether headphones are plugged in and continue voice recognition during speech only when they are plugged in,
• Dispatch information to any part of your app about the results of speech recognition and speech, or changes in the state of the audio session (such as an incoming phone call or headphones being plugged in),
• Deliver level metering for both speech input and speech output so you can design visual feedback for both states.
• Support JSGF grammars,
• Be easily interacted with via standard and simple Objective-C methods,
• Have all significant operating options controlled via configuration files,
• Be installed in a Cocoa-standard fashion using static library projects that, after initial configuration, allow you to target or re-target any SDKs or architectures that are supported by the libraries (verified as going back to SDK 3.1.2 at least) by making changes to your main project only.
OpenEars has lots of good documentation and depending on your connection speed it's possible to get up and running with the sample project in about 10 minutes following the Getting Started instructions. Many questions have been asked and answered at the OpenEars Support Forums. I know there are a few iOS developers here on Metafilter so I hope you'll check it out; feel free to memail me if you want to say hi.
This post was deleted for the following reason: Poster's Request -- Brandon Blatcher
That looks fantastic. Thanks for putting this together and getting it out there. I look forward to trying it out.
posted by ignignokt at 2:28 PM on January 31, 2011
posted by ignignokt at 2:28 PM on January 31, 2011
« Older Valentine's Day Cards from FPCoA. ... | Random Bands... Newer »
posted by schwa at 11:03 AM on January 31, 2011