October 18, 2026 · 4 min read

Voice Plus Computer Control: A Note in Notepad, Start to Finish

In Locally Uncensored 3.0.6 you can talk to your model, and a model can use the mouse and the keyboard in apps you approve. The two work together. This post follows one task we measured from the first word to the spoken result: typing a note in Notepad by voice.

Both features are in beta. Voice is English only. Our check in the real app ran on Windows. On a Mac, computer control is in the app but not fully tested yet, and on Linux neither feature has been run in the app.

What We Measured

In our test on Windows, typing a note in Notepad by voice took 11 to 22 seconds from the end of the command to the spoken result. It succeeded in 6 of 6 runs. The model was a local 9B chat model without image input, working from the list of buttons and fields that the app exposes.

That number was measured before the card that asks in every new chat existed. In a new chat your click on Allow comes on top.

Step by Step

1. Give Voice the Screen

Open Voice. Next to the title sit four switches. Agent has to be on, and Where it may work has to be set to Whole computer. Workspace only, the default, has no screen at all.

The first time you choose Whole computer, LU asks in a dialog titled "Let Voice work on the whole computer?". Your system asks once more each time LU was started. Choosing that level also switches computer control on.

2. Say the Task

Start a session and say what you want, for example: "Open Notepad and write: call the dentist on Monday."

3. Click Allow on the Card

The first screen task brings a card onto the voice surface: "Allow computer control in this chat?" LU says aloud: "Before I use this computer, I need your permission. Please click Allow or Deny on the screen."

This is the one step you cannot do by voice. A spoken yes does not allow it. LU answers with "This one needs your click on the screen." and the model does not hear the yes. A spoken no or stop declines, like Deny. Until you click Allow, LU looks at nothing and does nothing.

4. Answer the Questions

On Windows the LU window shrinks to a small window in the top right corner, and the edge of the screen glows softly in purple. LU asks its questions aloud. For an ordinary action, a click, a scroll or text in a field, you can answer yes or no. A spoken no is always taken.

A sensitive action never takes a spoken yes. Anything that sends, buys, deletes or changes permissions needs your click, because speech recognition can mishear and the microphone hears the whole room. A button without a name counts as sensitive, and so does Alt with a letter on Windows and Linux.

5. Pause if Something Looks Wrong

Say "stop" or "wait" while the task runs and it pauses. "Hold on" and "pause" work too. Only the word alone does that: "Wait, what is two plus two?" is a question for the model. The paused view asks whether you take over or let LU continue, and that view is answered with a click. Ctrl+Alt+Space pauses as well, and Ctrl+Alt+Esc stops at once.

6. Hear the Result

When the note is typed, LU tells you the result aloud. The screen task and its pictures stay in the transcript as a block you can open. The pictures live in memory only.

Where this was tested
Voice and computer control were checked together on one Windows 10 machine. For most of that check the speech was a recording played into the app as the microphone. On a Mac, computer control is in the app but not fully tested yet, and every click there needs your click, also in a voice session. On Linux, Voice and computer control have not been run in the app. Voice is English only and in beta.

Things to Try

These are ideas, not results. We have not measured them, so start supervised and watch what happens.

Small local models misjudge when a task is finished. A task can end as stopped although the note is already on the screen. A screen task also ends after 8 minutes at the latest.

Which Model to Use

A 9B model such as Qwen 3.5 9B is a good start on a 12 GB card. On a Mac there is no list of buttons and fields, so the model needs image input there. The computer control guide explains the screen model setting, and the Voice guide covers setup, voices and the four switches.

Related


Locally Uncensored is AGPL-3.0 licensed and built by PurpleDoubleD. Corrections welcome on GitHub Discussions or in the Discord.

In the handbook

Locally Uncensored is free, open source and runs on your own machine

Download for Windows Download for Mac (Apple Silicon) Download for Linux

No GPU? LU Cloud runs in a browser, paid from credit packs that start at 15 EUR and need no subscription. See what it costs or open LU Cloud.