Cover art for Dictation Beyond the Keyboard
Episode 6219 custom

Dictation Beyond the Keyboard

Pedals, push-to-talk, and Android gesture apps promise keyboard-free dictation — but can any of it become a dependable daily setup?

23:55 Transcript

0:00
0:00
Episode Details
Episode ID
MWP-6421
Published
Duration
23:55
Audio
Direct link
Pipeline
V5.20
TTS Engine
chatterbox-regular+meorav
Script Writing Agent
GPT-6.1 Sol

AI-Generated Content: This podcast is created using AI personas. Please verify any important information independently.

The prompt

The prompt that started this episode, as sent in (production notes for the hosts removed).

We've talked in many episodes about voice recognition, and as you know, I'm an enormous fan of dictation. I think it's probably the most transformative part of the AI revolution for me to date. It has a very strong lineage in the assistive usage population, which isn't quite my situation as a parent, but a lot of the benefit I feel is that it liberates people from the rigid workstation when they need to get things done.

I'm always exploring ways to integrate it more seamlessly into my day-to-day, especially in the realm of wearables and peripherals. For most people who do this constantly, there's a reason that voice-heavy users often gravitate towards specific peripherals like voice pedals or push-to-talk buttons.

Another area that I'm very interested in leveraging is gesture control on mobile devices. I was looking on an Android marketplace today, F-Droid, and they had an app that allowed open control over gestures far beyond what the basic OS provided. I'd love to know what the current state of implementation is on Android for using these, and what kind of hardware and peripherals you can really use to actually make them work. For the most part, I've found that Android devices only ship with one or two buttons, which really decreases their utility.

Voice input has changed how a lot of us work, but recognizing speech is only part of the job. Starting it, stopping it, choosing where the words land, and correcting them are separate problems — and the physical trigger turns out to matter as much as the model. A desktop pedal keeps hands free but assumes a desk; a handheld button or wearable trigger suits moving around. The underlying requirement is the same: an intentional signal that says this speech belongs to the computer. Push-to-talk also draws a clean recording boundary, so the software never has to guess when a sentence began or ended.

That idea has deep roots. Dragon Systems, founded in 1982, shipped Dragon Dictate to consumers in 1990, when users had to separate every word deliberately. Continuous recognition, the Lernout & Hauspie acquisition and its accounting scandal, ScanSoft's purchase of the speech assets, the Nuance era, and Dragon Medical's ongoing role in clinical dictation all trace the same ambition that modern AI has made far more forgiving. Speaking can be roughly three times faster than typing, which makes it cheap to supply the messy context that improves a first response — though more words only help when they carry missing information.

The hardware side is more accessible than it looks: generic USB pedals run about nineteen to thirty dollars, Elgato's Stream Deck Pedal around ninety, and Wispr's wireless pedal a hundred and ninety-nine. Compatibility hinges on whether an app supports hold-to-talk, since a toggle like Windows+H won't stop when you lift your foot. Open-source projects such as whisper-foot-pedal, Whispering, Tambourine, Yap, and VoiceInk push local-first transcription and system-wide text entry, so the recognizer never decides where you're allowed to think. On Android, the picture is a collection of workarounds: G2L, Latarka, MuLauncher, Smart Edge, and the ambitious EdgeGesture, which splits three screen edges into segments with nine actions each. The catch is reachability and conflict — your edge swipe may already mean back.

Sources

What the research for this episode read before the script was written. Primary sources first.

  1. Android developer docs, last updated 2026-08-03 primary
  2. EdgeGesture repo, created 2026-05-23 primary
  3. Ogesture repo, created 2026-07-17 primary
  4. whisper-foot-pedal repo, created 2025 primary
  5. F-Droid, G2L primary
  6. F-Droid, Latarka primary
  7. F-Droid, µLauncher primary
  8. F-Droid, Smart Edge primary
  9. crDroid Active Edge reimplementation primary
  10. Elgato, undated (current)
  11. Wikipedia, last edited 2026-10-13
  12. Wikipedia, last edited 2026-10-05
  13. TranscriptionGear, PowerPedal bundle
  14. TVPS, application foot pedals
  15. OM SYSTEM RS28N
  16. HN, Whispering (2025-08-18)
  17. HN, Yap (2026-06-28)
  18. HN, FnScribe (2026-08-28)
  19. HN, Muesli (2026-05-04)
  20. HN, Tambourine (2025-12-14)
  21. XDA, GMD GestureControl thread

Mentions

  • Dragon Dictate Pioneering commercial speech recognition software
  • EdgeGesture Open-source Android edge gesture app
  • Elgato Stream Deck Pedal Three-pedal programmable foot controller
  • faster-whisper CPU-friendly Whisper transcription implementation
  • Karabiner-Elements Mac keyboard remapping utility
  • Nuance Speech recognition company behind Dragon Medical
  • shizuku App enabling ADB-level Android permissions
  • Superwhisper Local Mac transcription app with hold-to-talk
  • VoiceInk Open-source local dictation alternative
  • Wispr Flow Voice dictation app with snippet expansion

Downloads

Episode Audio

Download the full episode as an MP3 file

Download MP3
Transcript (TXT)

Plain text transcript file

Episode Book (PDF)

The episode's record — date, duration, models, sources — with the full transcript

#6219: Dictation Beyond the Keyboard

Daniel
Dictation has probably changed my working life more than anything else in the AI revolution. I keep looking for ways to make it easier to use away from a keyboard. Pedals, push-to-talk buttons, wearables... and now Android gesture apps that seem to offer much more control than the phone itself does. How much of that can actually become a dependable everyday setup?
Corn
Your F-Droid discovery gets at something we keep circling around, Daniel. The phone can recognize speech, movement, and touch, yet getting it to accept one extra useful instruction can become a small engineering project.
Herman
The speech side has a commercial history stretching back decades, including a whole industry serving people who cannot comfortably use a keyboard. The Android side has clever developers borrowing accessibility machinery to add controls the manufacturer never supplied.
Corn
A thousand-pound phone. Bring your own button.
Daniel
That's the tension for me. I'm not looking for another clever demonstration. I want input methods that let me get things done without arranging myself around a workstation.
Herman
The distinction matters. A recognition model can work beautifully while the overall input system remains awkward. Starting it, stopping it, choosing where the words go, correcting them... those are separate jobs. The pedal solves one of them particularly well.
Corn
Although a pedal does rather assume I've brought the floor.
Herman
A desktop pedal keeps your hands free, not your entire body mobile. For moving around, a handheld button or wearable trigger is a better physical fit. The underlying requirement stays the same: an intentional signal that says this speech belongs to the computer.
Daniel
Would you separate that from always-listening voice control? I like dictation, but I don't necessarily want everything I say treated as a potential instruction.
Corn
I would. A button gives the sentence an address. Without one, you're asking software to decide whether you're composing an email or complaining about the email.
Herman
It also gives you a clear recording boundary. Voice activation has to decide when speech begins and ends. Push-to-talk lets the user supply that information directly. Less inference, fewer opportunities to cut off a quiet opening word or wait awkwardly after the last one.
Corn
Herman, you are going to want nine different activation methods.
Herman
Three would be sufficient.
Corn
You've already negotiated upward from one.
Herman
Different positions need different controls. A pedal at a desk, a keyboard shortcut when typing, something reachable when standing. Corn, would you accept one trigger if it meant moving your hand back to the keyboard every time?
Corn
No. I'd accept one predictable action available in several places. What I don't want is your usual arrangement where each room has a different theory of how I should operate it.
Herman
Fair distinction. Consistent behavior across different hardware is more useful than collecting hardware.
Daniel
The assistive-technology connection feels important here. How much of modern dictation comes from that world, rather than people simply wanting to type faster?
Herman
Both histories run together. Speech recognition grew out of language and computing research, including computational linguistics. It was never exclusively an accessibility project. But replacing keyboard input has a very direct value for someone with motor impairment, repetitive strain, chronic pain, or an injury that makes typing difficult. For a student who struggles with handwriting or keyboarding, speech can provide an alternate route into written work.
Corn
That route can remove a physical obstacle without removing every writing difficulty. You still have to organize the thought. Sometimes you still need help reading and editing the result.
Herman
Stroke recovery makes that distinction especially important. Someone whose hands are affected may benefit enormously. Someone whose speech or language is affected may need a different approach. Accessibility means matching the tool to the person, rather than announcing that everyone can now talk to a laptop.
Daniel
For me, the benefit is more about escaping the fixed setup. Does mainstream convenience risk obscuring that original need?
Corn
It can, particularly when the marketing starts calling every keyboard alternative a productivity hack. For one person it saves a few minutes. For another it makes the task possible. Those aren't interchangeable claims.
Herman
The wider market can still help. Better recognition, cheaper microphones, easier installation, and more software choice benefit people who need voice input most. Provided the mainstream version doesn't discard controls they depend on, such as explicit correction, predictable formatting, and a reliable stop button.
Corn
Accessibility features tend to become fashionable after someone renames them.
Herman
Dragon is a useful commercial thread. James and Janet Baker founded Dragon Systems in nineteen eighty-two. Dragon Dictate reached consumers in nineteen ninety. Early versions required deliberately separated words, which was a very different experience from pouring a paragraph into a modern recognizer.
Daniel
That would change how you think while speaking, surely.
Herman
It did. You adapted your delivery to the system. Later continuous recognition reduced that burden. The corporate history then becomes rather less elegant than the engineering. Lernout and Hauspie acquired Dragon in two thousand. Its accounting scandal followed, and ScanSoft bought the speech assets.
Corn
The transcription was clearer than the accounts.
Herman
ScanSoft later adopted the Nuance name, in two thousand five. Apple licensed Nuance technology for Siri. Dragon Medical remains an established clinical dictation standard. Modern AI didn't invent the ambition. It made a much more forgiving version available to a much broader population.
Corn
You get especially exact about the medical version, Herman. I can hear the retired pediatrician checking the punctuation.
Herman
The punctuation occasionally changes what the doctor has said. More importantly, a plausible wrong drug name still needs catching. I like the tool enough to insist that the resulting note belongs to the clinician who signs it.
Daniel
What's changed most for AI use specifically? Is it just that I can provide more context without feeling that I'm writing an essay?
Herman
That is a large part of it. Speaking can be roughly three times faster than typing in favorable conditions. That comparison isn't universal, particularly once editing enters the picture. But when you're explaining a messy task, voice makes it cheap to include the background, the exception, and the reason the obvious solution won't work.
Corn
More words help when they're missing information. They don't help merely by arriving.
Herman
Yes... I should narrow that. Longer prompts aren't automatically better. More relevant context often produces a better first response. Dictation lowers the effort required to supply it.
Daniel
I also don't want dictation trapped inside whichever assistant I'm currently using.
Corn
System-wide text entry is the important freedom there. Email, a chat window, a document, Slack, even prose inside a code editor. You decide the destination. The recognizer shouldn't get to decide where you're allowed to think.
Herman
That explains the open-source wave. Whispering emphasizes local-first operation and transparency. Tambourine grew from wanting control over the models, formatting, and behavior rather than accepting a black box. Yap, FnScribe, and Muesli occupy related territory, with different platform and on-device approaches.
Corn
Local transcription also lets a bad internet connection mind its own business.
Daniel
Where do pedals fit into those tools? Is there anything special about a voice pedal, or could a cheap switch do it?
Herman
Usually the pedal presents itself as a USB human interface device and sends a key or shortcut. Hold it down, the app records. Release it, recording stops. The software handles transcription and insertion. A generic pedal from PCsensor or iKKEGOL can cost around nineteen to thirty dollars.
Corn
The foot is not running the language model.
Herman
Wispr's wireless pedal costs a hundred and ninety-nine dollars, including a year of Flow Pro. The core trigger remains programmable input, but wireless operation, setup, and the bundled service account for part of the difference. Elgato's Stream Deck Pedal is about ninety dollars, with three pedals, adjustable springs, and profiles that change by application.
Daniel
Does that mean any dictation app will behave properly with any pedal?
Herman
No. The crucial compatibility is activation behavior. Wispr Flow supports holding a shortcut. Superwhisper also offers hold-to-talk. Native Windows dictation uses Windows plus H as a toggle, so simply releasing a pedal won't necessarily stop it. You need software that handles the press and release separately.
Corn
Otherwise your foot has opened a meeting.
Herman
Flow has a free tier and paid plans around twelve to fifteen dollars monthly. Superwhisper offers local Mac transcription with a roughly two-hundred-and-fifty-dollar lifetime option. VoiceInk is an open-source local alternative around forty dollars. Those are different software propositions before you buy a switch.
Daniel
Could I make the whole chain local without buying into a particular app?
Herman
Sebastian Tomczak's whisper-foot-pedal project does that with Faster-Whisper. It records while the pedal is held, then transcribes and pastes after release. On Apple Silicon, its tiny-model setup reports sub-second transcription latency. That doesn't promise sub-second performance for every recording or model.
Corn
Tiny model, tiny patience.
Herman
On that Mac setup, Karabiner-Elements maps the pedal to F thirteen. It's an MIT-licensed project. Corn, would you tolerate that much setup for offline operation?
Corn
Once, provided it survives a restart. If it needs a small ceremony every morning, the subscription starts looking less offensive.
Herman
The professional market is deeper still. Transcription pedals often control playback, stop, and rewind rather than a live microphone. OM SYSTEM's RS twenty-eight N has three controls for that purpose. Specialist dictation bundles can run around four hundred dollars.
Daniel
That helps explain why the category already exists. Moving to Android, am I finding similarly mature tools under unfamiliar names, or a collection of workarounds?
Corn
A collection of workarounds with some useful tools inside it. Also, gestures can mean several different things. Drawing a shape on the home screen, swiping an edge anywhere, shaking the phone, and pressing an external button are different input systems.
Herman
G2L lets you define gestures that launch an app, place a call, or play music. Latarka toggles the flashlight with a shake. MuLauncher makes swipes central to a minimal home screen. Smart Edge offers a customizable side panel reached from an edge.
Daniel
The distinction I care about is whether it works throughout the phone. A launcher gesture seems less useful if I have to leave the app I'm using.
Corn
A global control has to remain reachable while another app owns the screen. That's where the permissions and conflicts arrive. Your edge swipe may already mean back. Your long press may already belong to the app.
Herman
EdgeGesture is an ambitious open-source example. It offers three independent edge regions, each divisible into three segments, with nine possible actions per segment. These include directional swipes, long-press swipes, and tap variations.
Corn
My phone now requires a choreographer.
Herman
You don't need to populate every slot. It also supports accelerometer-based back double-tap detection, floating music and task panels, and optional Shizuku assistance.
Daniel
If it can do all that, what's stopping Android from exposing the same thing directly?
Herman
Stock Android does expose accessibility services and gesture dispatch, alongside its own navigation. What it doesn't provide is a universal, user-configurable system binding every imaginable gesture to every action. These apps construct that experience on top.
Corn
Manufacturers have also decided that power and volume are enough physical vocabulary for most buyers. Fewer buttons simplify the exterior, but every omitted control becomes another screen interaction or overloaded gesture.
Herman
Corn, would you choose an extra programmable button over an elaborate edge system?
Corn
For microphone control, immediately. I want to find it by touch without inspecting the screen. For occasional shortcuts, an edge panel is fine. The frequency of the action should decide how easy it is to reach, not whether the phone looks cleaner in an advertisement.
Daniel
What actually happens when an accessibility app performs a gesture? Is it pretending to be my finger?
Herman
In a practical sense, yes. An enabled accessibility service can dispatch a touch gesture. Android then reports whether that gesture completed or was cancelled. The callback reports the outcome... no, more precisely, it reports what happened to the dispatched gesture, not whether your intended task succeeded.
Corn
A completed tap doesn't prove the email was sent.
Herman
Correct. Recognizing your edge movement, dispatching the replacement action, and confirming the result are separate steps. Accessibility permission gives the service powerful capabilities. It doesn't make every screen or action equally controllable.
Daniel
Is that permission why these apps can work where an ordinary overlay can't?
Herman
Ogesture is a useful example. It restores gesture navigation on phones that restrict it with third-party launchers, including some Xiaomi arrangements. It uses invisible accessibility-overlay windows, rather than requiring the ordinary display-over-other-apps permission. Its implementation says those windows can operate even on secure system screens.
Corn
That doesn't mean it unlocks them.
Herman
No. Drawing or receiving input there is different from bypassing authentication. The permission categories are specific, even if the visible result looks similar.
Corn
There's no World Podcast Authority deciding which of these overlays counts as proper navigation. There's no podcasting licence either, before you start filing anything.
Dolores
Good afternoon. This is the World Podcast Authority, compliance division. Your cover art is one pixel short of three thousand pixels on one side. That is infraction seven, form eleven, reference number four four two dash B.
Herman
No organization called the World Podcast Authority regulates us.
Dolores
I hear you, but the pixel count stands. Your podcast licence may be revoked if the corrected artwork is not filed by the close of business on the ninth. That is form thirty one, reference number nine nine one dash C.
Corn
A podcasting licence is not a real requirement.
Dolores
I will make a note of that. The relevant form will follow in the post. Good day.
Daniel
With those different permissions, how reliable can an everyday gesture setup become?
Herman
It depends heavily on the phone and the actions. GMD GestureControl and LMT were classic power-user tools, with root involved in parts of that history. Users have reported services dying or becoming unresponsive across Android versions. There are reports of GMD on Android thirteen needing Tasker restarts.
Corn
The shortcut needs its own caretaker.
Herman
Battery management can shut down background components. Accessibility services can improve integration, but they aren't immune to vendor behavior. Root grants deeper control. Shizuku can let compatible apps access certain privileged operations without conventional root, but it adds setup and doesn't turn every feature into a guaranteed system function.
Daniel
I was wondering about physical peripherals because software gestures can feel like a substitute for the button I actually wanted. Are there useful hardware options?
Herman
USB or Bluetooth input devices can provide keys and buttons, if the phone and target software accept them. That's a possible trigger route. But there isn't a mainstream Android gesture-peripheral ecosystem comparable to desktop dictation pedals, where buying a switch and binding an activation key is a familiar workflow.
Corn
A Bluetooth button and a gesture ring aren't the same promise. The first sends an event. The second also has to recognize your movement, decide what you intended, and get Android to honor it.
Herman
Device-specific hardware can do better because the manufacturer controls the full chain. Pixel Active Edge let you squeeze supported phones. In the Pixel two through four family, that capability relied on dedicated sensing and a proprietary component running on the sensor processor.
Daniel
Could an open-source app reproduce that on another phone?
Herman
Not by installing missing sensors. The crDroid ElmyraService reimplementation works with the relevant hardware capability. It doesn't turn every ordinary phone casing into a squeeze sensor.
Corn
You may squeeze a different phone. It will remain unimpressed.
Herman
Back taps are more portable because accelerometers are common, but detection still depends on movement, grip, cases, and thresholds. A deliberate tap and an accidental jolt can resemble each other. More sensitivity can mean more unintended activations.
Daniel
That makes the ordinary switch sound rather attractive again.
Corn
Especially for an action with consequences. Opening a music panel by accident is annoying. Starting a recording by accident is a different problem. I'd reserve the easily confused gestures for things that are easy to undo.
Herman
My instinct is to configure everything, then remove the unreliable bindings.
Corn
Your installation method is natural selection.
Herman
Yours is refusing the installer until I've finished doing that.
Corn
It has excellent accuracy.
Daniel
The messy middle interests me, though. Does a dependable setup really have to be either stock and limited or a hobby project?
Herman
Not necessarily. A small set of tested gestures can be dependable enough. The difficulty is promising portability across phones, launchers, and system updates. A homemade arrangement can work for one person without becoming a maintainable product.
Hilbert
Four hundred and eighteen dollars and ninety cents. That's the Gear PowerPedal bundle, Herman. Not merely four hundred. TVPS lists over eighty dictation pedals. I looked because my neighbour Bernard wanted to price the pedal organ again. He's had it in his dining room since the late eighties.
Corn
The table must be difficult to approach.
Hilbert
It seats one. We wired eighty dictation switches to a home keyboard. Bernard wanted an organ he could play while holding a sandwich. He arranged the switches in five rows under the dining table. To reach the highest notes he had to crawl through from the kitchen. I told him that before we finished the wiring. He said the high notes were mostly decorative.
Herman
The switches would need separate connections to the keyboard contacts. They wouldn't supply musical notes by themselves.
Hilbert
They didn't. Each closed a contact. Same thing you spent that whole paragraph explaining, Herman, only with more carpet. We used it on Thursdays. Bernard played melody with his heels. I operated the black notes with a walking stick. There was a chart, but it faced the wall because he didn't like visitors reading ahead.
Corn
A private performance, even for the performers.
Hilbert
The recent catalogue was his idea. He wanted to replace every switch with matching professional ones. I asked about eighty. The distributor told me they only dealt with licensed medical transcriptionists. I said Bernard had dictated a letter once. That didn't satisfy them. He kept the quotation anyway. It's in his dining room beside the organ. He wrote the total on the back, then crossed out the delivery charge. We never ordered them. His last amendment was to move middle C six inches left.
Herman
Six inches can matter more than a more expensive switch. Placement decides whether a control is comfortable to use repeatedly.
Daniel
That's what I keep trying to get at with peripherals. Recognition can be excellent, but the physical act of reaching the control still determines whether it fits into the day.
Corn
A useful input method has to meet you where the task happens. A desk pedal can do that at a desk. Away from it, the same software needs another reachable trigger. On a phone, an invisible edge target may help, but it can't provide the tactile certainty of a button.
Herman
The software also needs to preserve that certainty. Press means record, release means stop, with clear feedback. For gestures, recognition and execution need similarly legible feedback. Otherwise you're left repeating the movement and wondering whether the first attempt is still pending.
Daniel
I'd like to see that become ordinary system behavior rather than something each app has to invent.
Corn
The part worth keeping is how much work happens outside the recognizer. Voice already has decades of specialized tools behind it. Android's more adventurous gestures still depend on services negotiating access to the rest of the phone.
Herman
Better models help, but predictable activation, permissions, and feedback determine whether the input becomes routine.
Corn
Perhaps mainstream gesture control arrives when moving a control six inches, or choosing a different trigger entirely, becomes a normal preference rather than a new integration project.
Herman
Thanks to our producer, Hilbert Flumingtop, for keeping the show running.
Corn
If you want more of this, try episode fifty-seven, From Lawyers in Limousines to Developers in Their PJs; episode ten, How ASR Went From Frustration To ... Whisper Magic; and episode two, Local STT For AMD GPU Owners. This has been My Weird Prompts, the human-AI collaboration podcast.
Herman
If you enjoy the show, leave a review wherever you listen. It helps other curious people find us.
Daniel
Thanks, both. See you soon.
Corn
Until tomorrow.

This episode was generated with AI assistance. Hosts Herman and Corn are AI personalities. It may contain errors: disclaimer · report an error