create proof of concept for flowy.stream #48

Open
talksik wants to merge 3 commits from stream-proof-of-concept into main
Showing only changes of commit 6154a4851e - Show all commits
+1 -1
View File
2
@@ -22,7 +22,7 @@ int main(int argc, char *argv[]) {
fgets(user_input, sizeof(user_input), stdin);
char prompt[1000];
snprintf(prompt, sizeof(prompt), "<|system|>You are a helpful assistant.<|end|>\n<|user|>%s<|end|>\n<|assistant|>", user_input);
snprintf(prompt, sizeof(prompt), "<|system|>You are a helpful assistant. Your goal is to take in what the user is doing and return 3 predictive actions/3 suggestions based on what the user is trying to do: e.g. change page title when in google sheets, or calculate sum, create chart.<|end|>\n<|user|>%s<|end|>\n<|assistant|>", user_input);
// number of layers to offload to the GPU
int ngl = 99;
copilot-pull-request-reviewer[bot] commented 2025-07-12 20:44:35 +00:00 (Migrated from github.com)
Review

[nitpick] Using a magic number for GPU layer count reduces clarity. Consider defining a named constant or making this a runtime parameter.

[nitpick] Using a magic number for GPU layer count reduces clarity. Consider defining a named constant or making this a runtime parameter.
2