Commit Graph

150 Commits (main)

Author SHA1 Message Date
sigoden 571d1022f6
refactor: rename some client structs and methods (#555)
* rename `Completeion*` to `ChatCompletions*`

* rename `send_message*` to `chat_completions*`

* rename `request_builder` to `chat_completions_builder`

* rename `build_body` to `build_chat_completions_body`

* rename `extract_completion` to `extract_chat_completions`

* format

* remove unused config fields
2 days ago
sigoden 54a837784c
refactor: rename `SendData` to `CompletionData` (#553) 4 days ago
sigoden c0f4d2d712 chore: fix typos 4 days ago
ProjectMoon 00f3cb182f
refactor: use `json_stream` for ollama to improve reliability (#549)
* Use JSON stream for ollama to improve reliability. Fixes #548.

* remove unused import

* fix clippy error

* format

---------

Co-authored-by: sigoden <sigoden@gmail.com>
5 days ago
rolfwilms 569317728c
fix: bedrock issues (#544)
* Removed extraneous key [stream] for AWS Bedrock Claude models.

* Reduceddefault  AWS Bedrock llama-3 max_output_tokens to 2048 to align with API requirements.

---------

Co-authored-by: Rolf Wilms <rwilms@csc.com>
1 week ago
sigoden 5458150ed3
fix: json stream parser and refine client modules (#538) 2 weeks ago
sigoden 2ccbb0f06a
refactor: qiawen client add qwen-long (#537) 2 weeks ago
sigoden ba3bcfd67c
feat: allow patching req body with client config (#534) 2 weeks ago
sigoden 31977f9642
fix: panic when check api error (#520) 2 weeks ago
sigoden b4a40e3fed
feat: support function calling (#514)
* feat: support function calling

* fix on Windows OS

* implement multi-steps function calling

* fix on Windows OS

* add error for client not support function calling

* refactor message data structure and make claude client supporting function calling

* support reuse previous call results

* improve error handling for function calling

* use prefix `may_`  as indicator for `execute` type fucntions
2 weeks ago
sigoden a75aef459d
feat: remove tiktoken (#506) 3 weeks ago
sigoden 79d0bba640
feat: allow binding model to the role (#505) 3 weeks ago
sigoden 5284a18248
refactor: config::Input (#503) 3 weeks ago
sigoden bc65e880be
feat: enhence roles with messages (#495) 4 weeks ago
sigoden 7762cd6bed
refactor: model pass_max_tokens (#493) 4 weeks ago
sigoden 956a960390
feat: support zhipuai client (#491) 4 weeks ago
sigoden 0071d84aa5
feat: support deepseek client (#490) 4 weeks ago
sigoden 85ad276a29
feat: support playground/arena webui (#487) 4 weeks ago
sigoden 7c6f75a139
refactor: unified access token management (#486) 4 weeks ago
sigoden 9b283024b4
feat: extract vertexai-claude client (#485) 4 weeks ago
sigoden 82a9ef024d
refactor: aware of lowercase https_proxy/all_proxy (#484) 4 weeks ago
sigoden 12b5b90bbc chore: clippy 1 month ago
Tatsuya Kyushima ebad4bb888
chore: fix typos (#476) 1 month ago
sigoden 5eae392dbd
refactore: add models for openai-compatible platforms (#471) 1 month ago
sigoden 8aa18b59f5
refactor: update azure-openai api version (#470) 1 month ago
sigoden 8dba46becf
feat: openai-compatible platforms share the same client (#469) 1 month ago
sigoden 8a65337d59
feat: add `.set max_output_tokens` (#468) 1 month ago
sigoden e7fa6c5a20 refactor: improve code quality 1 month ago
sigoden a50b32ca21
feat: support more openai compatiable clients (#467) 1 month ago
sigoden 97f6d48c42 refactor: check res status code 1 month ago
sigoden 50eac8b594
feat: support replicate client (#466) 1 month ago
sigoden 4d4a100fe6
refactor: sse handling (#465) 1 month ago
sigoden 4d1c53384b
refactor: prompts for generating config file (#463) 1 month ago
sigoden c752ba9b27
feat: `.model` repl completions show max tokens and price (#462) 1 month ago
sigoden 3a00fb283e refactor: user config models replace client builtin models 1 month ago
sigoden 602494b650
refactor: merge config models, update client models (#460) 1 month ago
sigoden 34041a976c
feat: support cloudflare client (#459) 1 month ago
sigoden 68882ecd4d
refactor: abstract event stream handling (#458) 1 month ago
sigoden 37a0cd08a9
refactor: rename some structs (#457) 1 month ago
sigoden 865be2bf75
feat: non-streaming returns completion stats (#456) 1 month ago
sigoden 0c74bd5d15 chore: fix typo 1 month ago
sigoden 7bda1eace2
refactor: rename ollama config field api_key => api_auth (#453) 1 month ago
sigoden 1f2b626703
feat: support bedrock client (#450) 1 month ago
sigoden 615bab215b
feat: support vertexai claude (#439) 1 month ago
sigoden d6df1e84a7
refactor: extract prelude models to models.yaml (#451) 1 month ago
sigoden eac01fb129 refactor: rename macro to openai_compatible_client 1 month ago
sigoden 740ca2413a
refactor: simplify impl client trait (#445) 1 month ago
sigoden a21e1213cc
feat: support perplexity (#444) 1 month ago
sigoden 503ec98bd1
feat: support moonshot again (#442) 1 month ago
sigoden 29a4ffd514
feat: support groq (#441) 1 month ago