Anthropic's experiments to give Claude AI control of your computer are taking on a new tone, literally. Voice control could potentially change the way you operate your device. The AI assistant developer has partnered with Hume AI and its new Empathic Voice Interface (EVI) 2 to help Claude understand the emotion behind our words and respond in kind.
It's about more than just matching your vibe in a conversation. Soften the connection between what you say and how Claude can control your computer. Basically, EVI 2 converts your voice into text and sends it to Claude. Claude then controls the computer, moves the mouse, clicks buttons, and even takes screenshots. Claude then uses simple language to explain his process, text that EVI converts into natural, human speech. It is both a conversation and a way to complete tasks on a computer without a mouse or keyboard.
Hume wants to make AI more natural and intuitive to use. Instead of typing commands or navigating complicated menus, you can have fluid, emotionally intelligent conversations with your devices.
Imagine saying to your laptop: “I'm feeling a little overwhelmed. Can you organize my to-do list? and have him respond in a calming voice with just the right balance of empathy and efficiency as you explain your list and put it together on the screen in front of you. You can see how it works in the video below.
voice control
“By integrating Claude with EVI, we have created something truly special. Claude's frontier natural language capabilities and personality complement EVI's expression, understanding and empathy, so EVI can “represent” Claude's responses and spark conversations fluid and context-aware that feel remarkably human,” explained Hume founder Alan Cowen in a blog post. “Claude is very articulate. “He has a really good personality that people like to talk to.”
It's becoming more common to offer voice interfaces to generative AI assistants, whether it's ChatGPT's advanced voice mode or Microsoft's Copilot Voice. The latest AI models enable adaptive assistants that can respond when you interrupt and easily change the subject, much more so than previous voice assistants from Amazon or Google. Combine that with your computer control and suddenly new horizons open up. Technology becomes more accessible to people with disabilities or those who do other things with their hands simultaneously, making multitasking easier.
Of course, any problems will need to be fixed. The equivalent of an AI hallucination could be disastrous if the AI also has control over your files and messaging services. Additionally, privacy becomes even more important when the digital equivalent of keystrokes and browser history becomes part of the AI log. Still, this deal between Hume AI and Anthropic is still a big step toward personalizing AI when it comes to computer control.