Session Context
How Quox maintains context across conversations and sessions.
Use this document to maintain continuity between development sessions.
Current State (Last Updated: 2025-01-14)
Completed Features
- HAL-9000 style homepage with audio-reactive visualizer
- Voice mode selector (JARVIS/Cyberpunk/HAL)
- Text input fallback with subtitles
- n8n workflow engine running in Docker
- quox-chat webhook for Claude integration
- quox-speak webhook for TTS (ElevenLabs)
- quox-transcribe webhook for STT (Whisper)
- Context injection - Claude knows all 50+ hosts
- Session continuity via session_id
- Quick actions panel with visual feedback
- React Router navigation structure
- Activity logging in n8n
- Comprehensive documentation suite
In Progress
- Voice testing with actual API keys
- Multi-agent development team architecture
- Settings page UI implementation
Not Started
- Self-modification with approval gates
- RAG integration with Qdrant
- Grafana dashboard synchronization
- Prometheus exporter automation
- System update automation agents
API Keys Status
| Service | Key Variable | Status |
|---|---|---|
| Anthropic (Claude) | ANTHROPIC_API_KEY | Configured in n8n |
| OpenAI (Whisper) | OPENAI_API_KEY | NEEDS SETUP |
| ElevenLabs (TTS) | ELEVENLABS_API_KEY | NEEDS SETUP |
To configure:
bash
sudo nano /opt/n8n/.env
# Add keys, then:
cd /opt/n8n && docker compose restart n8n
Next Session Priorities
Priority 1: Voice Testing
- Add OpenAI API key for Whisper
- Add ElevenLabs API key for TTS
- Test full voice conversation flow
- Fix any issues discovered
Priority 2: Automation Agents
Create n8n workflows for:
apt-update- Check for updates on hostsapt-upgrade- Full system upgradegrafana-sync- Update dashboards with current hosts
Priority 3: Bastion Tool Exploration
SSH to nw-edge-gw-01 and document bastion tool features:
- SSH key management
- MOTD configuration
- Prometheus exporter installation
- Firewall port management
Priority 4: RAG Setup
- Deploy Qdrant container
- Create embedding pipeline
- Index n8n workflow templates
- Test context-aware queries
Key Files Reference
Dashboard
| File | Purpose |
|---|---|
src/pages/HALHome.jsx | Main HAL interface |
src/components/hal/HALVisualizer.jsx | Audio-reactive eye |
src/components/hal/VoiceControls.jsx | Mic/speaker buttons |
src/components/hal/Subtitles.jsx | Text display |
src/styles/hal.css | HAL styling |
src/App.jsx | Router and routes |
Infrastructure
| File | Purpose |
|---|---|
/opt/n8n/docker-compose.yml | Service config |
/opt/n8n/.env | API keys |
/opt/n8n/data/ | n8n persistence |
Workflows (JSON)
| File | Purpose |
|---|---|
/tmp/quox-speak.json | TTS workflow |
/tmp/quox-transcribe.json | STT workflow |
Architecture Decisions
Voice Flow
User speaks → Browser MediaRecorder → WebM blob
→ POST /webhook/transcribe → Whisper API → text
→ POST /webhook/chat → Claude API → response
→ POST /webhook/speak → ElevenLabs API → audio
→ Browser Audio playback
State Machine (HAL Eye)
IDLE (red) → LISTENING (blue) → THINKING (orange) → SPEAKING (green) → IDLE
SSH Access Pattern
Dashboard → n8n → Bastion (nw-edge-gw-01) → Target hosts
Known Issues
- SSH intermittent - nw-edge-gw-01 sometimes rejects connections
- Browser audio - Some browsers block autoplay
- Large responses - May need truncation handling
Useful Commands
bash
# Restart services
cd /opt/n8n && docker compose restart
# View n8n logs
docker logs n8n -f
# Rebuild dashboard
cd /home/control/quox-dashboard && npm run build
# Check workflow status
docker exec n8n n8n list:workflow
Session Notes
2025-01-14 Session
- Built complete HAL interface with voice support
- Created comprehensive documentation
- Designed automation agents (not yet implemented)
- Planned RAG integration with Qdrant
- Ready for voice testing once API keys configured
Next Session Goals
- Configure and test voice features
- Implement at least one automation agent
- Explore bastion tool capabilities
- Begin RAG implementation