Skip to main content

And now for a word from My Mouthpiece...


Hey kids, Jeff here with something new for sufferers of expressive aphasia or the losing the ability to say what you mean to say. Or write. As my aphasia has gotten worse I have had to give some serious thought to what I would do if I were alone (without my caregiver), at the emergency room and needed to convey important information to the ER nurse...or I was out in public and for some reason was stopped by the police...or for the more common problem of some mornings when I feel the worst, I am least able to express what is wrong to my caregiver and so just give up and live with the misery.

Most of the solutions I have seen so far have either relied on language too much (which is why even sign-language users can suffer from aphasia, just like anyone else) or were too limited in scope. For example I can have the best talker app in the world but it will be worthless if it cannot list my current medications for a doctor or to pass on the phone number of my caregiver during one of my occasional brushes with the law.

I am an ex-engineer so thats how I tend to think but I have never had to tackle a problem like this before so to help myself, I needed to do some experimentation to figure out what will work, what will actually help and what won't. To further this testing, I wrote a quicky (and fairly lame) Python app called My Mouthpiece, a reference to how lawyers were referred to in the gangster era. Right now its working under the principle of having what I call "topic" files that are nothing more than text files with lines of text that are either full sentences or sentence fragments that can be stitched together to say something more sophisticated than "My name is Jeff".

To use it, say I wanted it to say the following to someone, perhaps a medical professional:

"My name is Jeff Cobb, I am a 57 year old with Lewy Body Dementia. I have problems with expressive aphasia, cognitive defects and loss of motor skills. My current medications include Norco 10 mg 3 times daily."

Those lines are three lines from my medical.txt file that looks like this:

jeff@jeff-Oryx-Pro:~/bin/mmplib$ cat medical.txt
My name is Jeff Cobb, I am a 57 year old with Lewy Body Dementia.
I have problems with expressive aphasia, cognitive defects and loss of
motor skills.
My current medications include Norco 10 mg 3 times daily.
Please speak slowly.
If you need more information, please contact my caregiver Beth Cobb.
jeff@jeff-Oryx-Pro:~/bin/mmplib$
So to say what I needed to, on my laptop I can open a window and type:

jeff@jeff-Oryx-Pro:~/dev/mymouthpiece$ ./mouthpiece.py -s medical.txt=abc

At which point my app opens medical.txt, grabs the first three lines (abc; abcf would have grabbed the first three and the sixth lines), concatenate them together, then used Google TTS tech to convert the text into human-sounding speech which is then saved as an MP3 file which came out like this:


MMP.TMP.MP3

And the default sound player plays it through the speaker.

I am developing a library of simple topic files, from general stuff like where I live, who I am, how to contact my caregiver to shopping to status (I feel hungry, thirsty, I am fine, I am in pain, etc) and anything else I can think of. 

Right now this is just proof of concept, to see what works and what doesn't. The goal is to develop a system that is more centered around sentence components and not full-speeches, where the components can be combined in a number of ways not envisioned by the programmer to produce unique and meaningful language. Also, by focusing the input on a more symbolic system, the pitfalls of standard language will be avoided. Possibly using gestures to convey intended meaning.

I am also working with a UK charity on an app that lives on the cell phone or tablet which does a much simpler subset of this (point at a picture, it speaks a line) and actually the outcome of these experiments will help that effort....

I will post more as it happens....still even this bit is kind of exciting for me and frankly better than anything else I have tried so far. I do want this or something like it to live on the cell phone so the speech might be piped through a connection of a voice call, or the text part simply going through the texting mechanism....

The problem is the programmer part of my brain is broken AF making even this piddly little thing feel like brain surgery....there there is real question of what I can actually do with this project. Worst comes to worst, it might help give someone else some ideas after I am gone....


Peace
Jeff

UPDATE 28 June: I have added a simple hack that has been on my wish-list from day-one: the ability to stack or compile a response from a variety of sources. For example, currently in my "mouthpiece" library I have the following topic files:

caregiver.txt = info for new caregivers 
general.txt  =  general information about me (contact info, etc)
lbd.txt  = short description of Lewy Body Dementia
medical.txt  = information such as a medical summary, medication list.
mmp.txt  = Oddly when I got the first version of this done I could not tell anyone about it because I was in a bad fog and could barely speak. So I hacked this thing out to explain what My Mouth Piece does.
status.txt =  short status descriptions (I am tired, I am fine, I am hungry, etc)

Until now however I could only "speak" from one topic at a time.  As of a few minutes ago I just finished testing a version where I can (with a single command) request line 1 from the general library, lines 2-4 from the medical topic and line one from the status library by simply doing:

mmp -s general.txt=a -s medical.txt=bcd -s status.txt=a







I have also contacted the author of the main tool I use to do the speech conversion (gTTS for google Text To Speech, same engine as on your phone) for how to change the voice....

J.

Comments

Popular posts from this blog

Dementia Cannabis Update

Update: 22 July
Project started, grow page and journal is here:

Operation: Constant Clarity


This is one of the most difficult posts I have had to write, mostly because I "had" to. Allow me to explain and I promise by the end you will not only understand the "difficulty" and the "had to" bit but also I hope you come away with a few new assumptions or conclusions, you pick and if all that passes you by, perhaps you will find illumination as this is some serious "dementia from the inside out" kinda shit.

The 18:1 Theory
Before I tell you what happened, please recall I have expressed a theory or hypothesis on the effects of a cannabis extract/concentrate that tests out to have a CBD:THC ratio of 18-1 on the demented mind. By demented I mean any brain with not just dementia but anything that alters so-called normal operation. I don't mean anything like it fixes everything, rather there are things that are fixed by this like PTSD and ADD that you …

Be Who You Actually Are

Many moons ago I was starting my day like many of us enjoying the gifts of dementia by spending most of it screwing up each and every thing I attempted to do, large or small and usually in ways both spectacular as well as costly.  On the verge of tears I spent about an hour medicating with my very best botanicals when I had the BFO (Blinding Flash of the Obvious, engineer-speak): I am still attempting to be something that I am not only NOT but barring acts of a supreme deity, never will be again. Its just that damned simple.

* What makes a persons personality unique is the precise set of influences, patterns of thinking, lifetime experiences or memories amongst many other things. These are all stored and/or controlled by the brain.

* The root cause of dementia is damage to select portions of the brain.

* For better or worse, the simple truth is that this will result in a different person. Not better or lesser, simply different, in the same way that any two coworkers might be very dif…

Holy Crap Batman! A hero with dementia!

Braven 2018
Hey kids, I ran across something you just HAVE to watch. I mean you as in readers of these words. Looking for entertainment last night I was scrounging some of the dodgier parts of the Internet for something not involving a cape or "found footage" to watch. Long story short I ran across something from this year (2018) called Braven, starring Jason Mamoa (Aquaman/Ronin on Stargate Atlantis) and Stephen Lang (the major hard-ass in Avatar).  Plot reads like a B-roll actioner, drug dealers drop in on county folk and try to take them on their own turf. I agree, major tired plotline BUT......
Here is the kicker: The country folks (Mamoa/Lang) are in the cabin in the woods kinda thing because Lang (plays Mamoas dad) has alzheimers (he blames it on some Vietnam injury but...) and got into a fight at a local bar, thinking some girl was his dead wife out on the town. 
Of course Jason beats everyones ass in proper manner as it should be but thats why these two are in the c…