You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Inject audio input (browser → device, mic injection) into sim/emulator sessions over the existing browser ↔ relay ↔ agent path, so voice/mic features can be exercised during manual QA. Hard constraint: must not degrade the current video/render (streaming) pipeline.
Split out from #259, which now scopes the output direction only (device → browser, phase-4). Input is the lower-priority, harder direction.
Why separate / why later
Smaller use case — only matters for testing voice/mic-driven features, not general QA.
Harder — needs a virtual input device on the device side plus a browser capture surface (getUserMedia), which adds a privacy/permission surface the output path doesn't have.
Goal
Inject audio input (browser → device, mic injection) into sim/emulator sessions over the existing
browser ↔ relay ↔ agentpath, so voice/mic features can be exercised during manual QA. Hard constraint: must not degrade the current video/render (streaming) pipeline.Split out from #259, which now scopes the output direction only (device → browser,
phase-4). Input is the lower-priority, harder direction.Why separate / why later
getUserMedia), which adds a privacy/permission surface the output path doesn't have.Open questions (investigate at planning time)
simctlhas no audio API; likely needs a virtual input device.getUserMediaconsent UX and how mic capture rides the separate audio WS channel without touching video backpressure.Design notes
DeviceAgent.phase-5-plus(AX/later), revisit once output (feat: audio output (device → browser) for simulator/emulator #259) is in.Related: #259 (output-first, the foundation this builds on).