diff --git a/ai-conversation/README.md b/ai-conversation/README.md index a3d484a..d3cf286 100644 --- a/ai-conversation/README.md +++ b/ai-conversation/README.md @@ -1,26 +1,5 @@ # Conversation -This proof of concept is for implementing conversational loop with AI at a low level. - -- [x] Capture audio -- [ ] Use deepgram for live transcription -- [ ] Detect final speech/turn detection -- [ ] AI answer -> text -- [ ] Text -> generated voice with deepgram -- [ ] Playback on client side +This proof of concept is for implementing conversational loop with AI at a low level with raw C. ## Requirements Platform: the project is meant for Linux, specifically Ubuntu desktop. - -## Implementation - -The loop should be as follows: -- create the thread that manages the deepgram websocket client -- grab audio and send over to other thread to process & send -- stream pcm packets over the websocket connection -- print inbound messages from websocket connection to stdout -- signal in stdout when there is a "final message", which signifies "turn detection" - -## Open questions -1. Can deepgram websocket stream take any format? raw pcm? -[Answer here](https://developers.deepgram.com/docs/encoding) -2. Consider using Golang to interop with c, whereby the golang uses deepgram sdk, and the c library for alsa.