33 lines
931 B
Markdown
33 lines
931 B
Markdown
# flowy.stream
|
|
|
|
This is a proof of concept of a showing widgets within a conversation based on intent.
|
|
|
|
## Todo
|
|
- [x] Integrate llama.cpp with local inference. This will set us up for building many parts of experience.
|
|
- [ ] Disect what llama is doing and what the Phi model is doing.
|
|
- [ ] Create conversational loop with chat and running context.
|
|
- [ ] Generate & render different types of blocks: list, email, doc, etc.
|
|
- [ ] Try different models with hugging face
|
|
- [ ] Render TUI elements based on commands
|
|
|
|
## Dependencies
|
|
|
|
### llama.cpp
|
|
```sh
|
|
#model weights
|
|
wget https://huggingface.co/microsoft/Phi-3-mini-4k-instruct-gguf/resolve/main/Phi-3-mini-4k-instruct-q4.gguf
|
|
```
|
|
|
|
```sh
|
|
cd ./thirdparty/llama.cpp
|
|
|
|
rm -rf build
|
|
mkdir -p build
|
|
cmake -S. -Bbuild
|
|
cmake --build build
|
|
```
|
|
|
|
The libraries should be in `./thirdparty/llama.cpp/build/bin`.
|
|
|
|
NOTE: you may have to disable curl as a flag when configuring llama.cpp via cmake.
|