jmanhype

VAOS Voice Bridge: Building a Talker-Reasoner Architecture on PersonaPlex/Moshi

A technical journal of building dual-process voice AI on top of Kyutai's Moshi and NVIDIA's PersonaPlex, with Letta as the reasoning backbone.

The Goal

Build a Talker-Reasoner voice system where:

• System 1 (Talker): PersonaPlex/Moshi handles real-time conversation at 12.5Hz
• System 2 (Reasoner): Letta agent with persistent memory does deep thinking, web search, tool use
• A Voice Bridge (Bun + TypeScript) connects them, with Voxtral transcription + classification in parallel

kwindla

# export OPENAI_API_KEY=sk_proj-...
# uv run gpt-5-voice-agent.py

# /// script
# dependencies = [
#   "numba==0.61.2",
#   "openai",
#   "python-dotenv",
#   "fastapi[all]",
#   "uvicorn",

karpathy

"""
This is a batched LSTM forward and backward pass
"""
import numpy as np
import code

class LSTM:
  
  @staticmethod
  def init(input_size, hidden_size, fancy_forget_bias_init = 3):