ai conversation #49

Merged
talksik merged 14 commits from ai-conversation into main 2025-07-27 22:07:30 +00:00
Showing only changes of commit 3bb287fcd5 - Show all commits
+1 -22
View File
@@ -1,26 +1,5 @@
# Conversation
This proof of concept is for implementing conversational loop with AI at a low level.
- [x] Capture audio
- [ ] Use deepgram for live transcription
- [ ] Detect final speech/turn detection
- [ ] AI answer -> text
- [ ] Text -> generated voice with deepgram
- [ ] Playback on client side
This proof of concept is for implementing conversational loop with AI at a low level with raw C.
## Requirements
Platform: the project is meant for Linux, specifically Ubuntu desktop.
## Implementation
The loop should be as follows:
- create the thread that manages the deepgram websocket client
- grab audio and send over to other thread to process & send
- stream pcm packets over the websocket connection
- print inbound messages from websocket connection to stdout
- signal in stdout when there is a "final message", which signifies "turn detection"
## Open questions
1. Can deepgram websocket stream take any format? raw pcm?
[Answer here](https://developers.deepgram.com/docs/encoding)
2. Consider using Golang to interop with c, whereby the golang uses deepgram sdk, and the c library for alsa.