Build your own Jarvis: a voice assistant in your browser that runs on Claude Code

Someone built a real-life Jarvis, and it runs on Claude. You say "Hey Jarvis", it wakes up and listens. Then it can search the web, make images and even drive an Android phone. It lives in your browser with an Iron Man style hologram face. The brain is Claude Code running headless, so you use the Claude plan you already have. No separate API key. This is the full version of the IRON guide from my Reel.

01What it is

JARVIS is an open-source project on GitHub by adewaskar, under the MIT license. It has two parts. The face is a web page you open in Chrome. The brain is a small Node program (the bridge) that uses the Claude Agent SDK. That starts the real claude CLI in the background, so it's Claude Code doing the thinking.

Because it uses your Claude Code login, there's no API key to set up. Usage counts against your Claude plan.

02What you need

Claude Code, installed and logged in.
Node.js 20 or newer.
Google Chrome or Microsoft Edge, in a real window. Preview panes inside other apps block the microphone.
Optional: an ElevenLabs API key for a better voice. Without it, Jarvis uses your browser's built-in speech.

03Setup, step by step

Open a terminal and run these.

1. Download it

git clone https://github.com/adewaskar/jarvis.git
cd jarvis

2. Install

npm install

3. Start it

npm start

Open http://localhost:5173 in Chrome or Edge.
Click INITIALISE.
Allow the microphone.
Say "Hey Jarvis".

04Using it

Say the wake word, then talk normally. You can interrupt him while he's speaking. A few keys help too: Space talks without the wake word, Escape stops him, and D opens diagnostics.

Try saying

Hey Jarvis, search the web for the best-rated ramen near Central, Hong Kong, and give me the top three with one line each.

Its tools come from the MCP servers in your Claude Code config (~/.claude.json). The README lists web search, image and video tools, Android phone control and browser control. Connectors you added on claude.ai don't show up here.

05Make the voice better (optional)

Set an ElevenLabs key on the bridge and it switches to a nicer voice and better speech-to-text by itself.

Mac / Linux

ELEVENLABS_API_KEY=your_key_here npm start

06Good to know

Always use a real Chrome or Edge window. In a preview pane it will never hear you.
Tools are read-only by default. Sending, tapping, deleting, installing and paying are blocked. There's a mode that allows writes (npm run bridge:writes), and the README itself warns it's risky. I leave it off.
This is third-party code that runs Claude Code on your computer with your MCP tools. Read the code before you run it, and don't give it tools or folders you wouldn't hand to a stranger.
By default it only accepts connections from your own computer. Keep it that way.
Every request uses your Claude plan, so a chatty Jarvis uses up your limits faster.
The demo sounds come with the project. If you make money from it, clearing rights to that audio is on you.

Sources

GitHub: adewaskar/jarvis (README)