Project 2012: Unspoken Speech Detection Using a Brain-Computer Interface







Subject Testing:

  1. Electrodes are attached to the heads of subjects at locations Fz, Cz, Pz, Oz, P3, P4 using the International 10-20 System.
  2. Training Phase:  Subjects listen to a sound file containing 3 notes and one space during a 2 second period.  Each of these patterns is specific to a letter (A, F, T, E, R).  For the 2 seconds immediately after this, they “think” of the same pattern.  Their brainwaves are recorded. Subjects are encouraged to think of the tones in the same cadence and pattern with which they are heard.  Note that each subject is given two dry runs where the process occurs, but no readings are taken.
  3. After the first session, the subjects take a break.  During this time, their brain recordings are trained using an LDA Classifier and a Bayes Algorithm.
  4. Real-time Phase:  During a second session, the subjects are presented with a series of tones, each set representing on letter in the work “AFTER.”  They are played the correct tones for before each letter and system classifies it in real time.  If it is classified correctly, the tones for the next letter are presented.  If not, the subject repeats the last letter.
  5. The process continues until all 5 letters in the word AFTER are correctly identified in the correct order.  The time taken is recorded.