use basecamp project for managing this project
This commit is contained in:
@@ -1,26 +1,5 @@
|
|||||||
# Conversation
|
# Conversation
|
||||||
This proof of concept is for implementing conversational loop with AI at a low level.
|
This proof of concept is for implementing conversational loop with AI at a low level with raw C.
|
||||||
|
|
||||||
- [x] Capture audio
|
|
||||||
- [ ] Use deepgram for live transcription
|
|
||||||
- [ ] Detect final speech/turn detection
|
|
||||||
- [ ] AI answer -> text
|
|
||||||
- [ ] Text -> generated voice with deepgram
|
|
||||||
- [ ] Playback on client side
|
|
||||||
|
|
||||||
## Requirements
|
## Requirements
|
||||||
Platform: the project is meant for Linux, specifically Ubuntu desktop.
|
Platform: the project is meant for Linux, specifically Ubuntu desktop.
|
||||||
|
|
||||||
## Implementation
|
|
||||||
|
|
||||||
The loop should be as follows:
|
|
||||||
- create the thread that manages the deepgram websocket client
|
|
||||||
- grab audio and send over to other thread to process & send
|
|
||||||
- stream pcm packets over the websocket connection
|
|
||||||
- print inbound messages from websocket connection to stdout
|
|
||||||
- signal in stdout when there is a "final message", which signifies "turn detection"
|
|
||||||
|
|
||||||
## Open questions
|
|
||||||
1. Can deepgram websocket stream take any format? raw pcm?
|
|
||||||
[Answer here](https://developers.deepgram.com/docs/encoding)
|
|
||||||
2. Consider using Golang to interop with c, whereby the golang uses deepgram sdk, and the c library for alsa.
|
|
||||||
|
|||||||
Reference in New Issue
Block a user