Home
914 PC Bots Forum  


Ronau
User

Expert Boarder
Posts: 21
graphgraph
Karma: 0  
914 Speech Control - 2007/09/18 04:10 This thread discusses the Content article: 914 Speech Control

I've tried speech recognitions, but the bot doesn't understand but one word, 'stop', which is a good wood for him to know, but it would help if I could get a few others to work.

Has any one else been able to get the Microsoft speech recognition software to work with one of the early 914 bots? I have run through the training, but this doesn't help when I tried to use the speech recognition software.

Thanks,

Ted
  | | The administrator has disabled public write access.
c6jones720
User

Platinum Boarder
Posts: 350
graphgraph
Karma: 3  
Re:914 Speech Control - 2007/09/18 17:16 Hi Ronau, Hows it going?

I have to admit that I actually wrote that software this time last year before I had a robot, so I wasnt able to guarantee every single function.

The way it works is that there are a series of scripting files outside of the program that contain all of the words that you can say. You will find these scripts in the directory You can quite happily alter these scripting files and add your own commands. There is full documentation for this in the program.

I have tried the software now I have a robot and would say that there are a few ways to correct your little problem.


1-Retrain the software and verify that all the levels are set up correctly and trained for your voice. I noticed that pronounciation could have an effect on the program.

2-Verify that the word "stop" exists in the lexicon, I pretty sure I put it in. If you cant find this word you could happily another word such as "Halt" to do the same thing.

3-The position of the microphone might be important. I did intend that the Mic was located on the robot itself and the position of it could

If this dosent work what you can do is modify the instruction for the "stop" command. If you want you can paste the following into the file "COMMANDS.TXT"

//////////////////////////////////////////
///
/// Stuff related to the "stop"
/// command
///
//////////////////////////////////////////

<stop>
<parameters>
0
</parameters>

<DefaultActionNoParameter>
BRIAN(stop)
BRIAN(texttospeech command acknowledged. I will stop)
</DefaultActionNoParameter>
</stop>



As it happens I might be investigating using speech recognition for the 914 using MSRS so watch this space...
  | | The administrator has disabled public write access.
Ronau
User

Expert Boarder
Posts: 21
graphgraph
Karma: 0  
Re:914 Speech Control - 2007/09/20 21:47 I have trained with my voice using the onboard mic and a wired collar mic that would be impracitcal in practice but just to try.

Interestingly enough 'stop' was the one and only command that Em understood! (Em is the name of my bot) He would not understand any other word. And he took a long time to determine what I was trying to say. I was wondering if it was the MS speech SDK, but we reinstalled it and that didn't help. Does your bot have enough cpu to respond in a reasonable timeframe? Is there something that you have to do besides training to get your bot to understand you?

Another problem is most of the time when I start 914 voice controller, it sits at initialising speech engine and won't go any farther. Tips?

Also because of all the problems, I lost the help of our programmer. I was able to complete one mod that you might want to feature, but I didn't know how to upload. I installed a 19" monitor. See attached. We are working on a video of the installation of the mod.

Problems: can't use speech recognition, video refresh is 3 seconds, can't calibrate upper sensors correctly, and can't find an avatar face.

Thanks,

Ted
  | | The administrator has disabled public write access.
jamesbruton
Admin

Admin
Posts: 683
graph
Karma: 8  
Re:914 Speech Control - 2007/09/20 21:54 Have you tried running the speech app on another PC and talking to the BRIAN service on the Bot over the network? - then you can use a wired mic close you yourself without a trailing lead to the 914.

If you have a mod/project etc you'd like featured as an front page article then just send me the details, either by email (click my name while you are logged in) or use the contact form. I'll format the article up and make sure it gets published in the right category etc. Check out the FAQs which detail what to do and how to get pictures into the image gallery etc.

When you say the screen refresh is 3 secs - is this when using VNC?. It may just be that the wireless network signal is weak.

Post edited by: jamesbruton, at: 2007/09/20 13:55
  | | The administrator has disabled public write access.
c6jones720
User

Platinum Boarder
Posts: 350
graphgraph
Karma: 3  
Re:914 Speech Control - 2007/09/20 22:51 The responsiveness of the program could be down to the speed of your computer. The program was originally written on a 1.5GHz cpu, I have run it on my robot whose speed is 1.2GHz.

As you mentioned there can be a slight delay between speech and operation, the program is heavily dependant on script file parsing so thats where the delays come from.

What I would say is that there is a configuration file called "robotspeech.cfg" which defines the operating parameters of the program. To reduce the load on your CPU you can reduce the sample rate of the ADC from 44100 to 22050. Also you can reduce the screen refresh time from 20fps to something like 10fps. This only affects whats drawn on the screen and has no effect on the speech recognition engine.

The program is set up to run as a client to the Whitebox BRIAN program. By default the network arrangements are set up so that the speech program runs on the same computer as BRIAN 127.0.01:13000. You can run the program on a different computer, you just have to ensure the variable BrianIP is set to the IP address of the robot.

When you load the program you will see a splash screen for 3 seconds and then the software will initialise communications to BRIAN. The first thing it does is ask for sensor status. If Brian responds with this data, you will be then able to control your robot with speech.

As for the commands the robot understands, they are all scripted and you will find full instructions on how to use and modify the program in the files:

C:Program Files914 Voice ControllerSYSTEMinstructions.htm
C:Program Files914 Voice ControllerSYSTEMJCL_MANUAL.htm

Post edited by: c6jones720, at: 2007/09/20 14:52
  | | The administrator has disabled public write access.