Commit Graph

50 Commits

Author SHA1 Message Date
InterestingDarkness
75e3f599e6 Derive Vertex AI Project ID from Service Account JSON
This commit refactors the Vertex AI integration to automatically derive the
Project ID from the provided Service Account JSON. This simplifies the
configuration process for users in "Full" (service account) authentication
mode by removing the need to specify the Project ID separately.
2025-05-28 21:57:17 +08:00
InterestingDarkness
1e2bec1751 Removed direct references to 'vertexai_project_id' from openai.js and related files, ensuring it is now managed through backend secrets for enhanced security. 2025-05-27 21:25:53 +08:00
InterestingDarkness
5656c7950d Implement Vertex AI authentication modes and configuration in UI
- Updated index.html to include options for Vertex AI authentication modes (Express and Full).
- Enhanced openai.js to manage Vertex AI settings, including project ID, region, and service account JSON.
- Added validation and handling for service account JSON in the backend.
- Modified API request handling in google.js to support both authentication modes for Vertex AI.
- Updated secrets.js to include a key for storing Vertex AI service account JSON.
- Improved error handling and user feedback for authentication issues.
2025-05-26 22:09:59 +08:00
Aykut Akgün
e4217dbeba custom endpoint handling (#4031) 2025-05-24 01:41:03 +03:00
Cohee
57b81be9ce Caption - allow custom endpoint for xAI 2025-05-22 23:03:04 +03:00
NijikaMyWaifu
157315cd68 Add Vertex AI express mode support (#3977)
* Add Vertex AI express mode support
Split Google AI Studio and Vertex AI

* Add support for Vertex AI, including updating default models and related settings, modifying frontend HTML to include Vertex AI options, and adjusting request processing logic in the backend API.

* Log API name in the console

* Merge sysprompt toggles back

* Use Gemma tokenizers for Vertex and LearnLM

* AI Studio parity updates

* Add link to express mode doc. Also technically it's not a form

* Split title

* Use array includes

* Add support for Google Vertex AI in image captioning feature

* Specify caption API name, add to compression list

---------

Co-authored-by: Cohee <18619528+Cohee1207@users.noreply.github.com>
2025-05-22 20:10:53 +03:00
Cohee
aef005007f Do not remove data URI prefix from llamacpp caption requests 2025-05-09 23:23:34 +03:00
Cohee
8a4da487dd llamacpp: use generic CC endpoint for captioning 2025-05-09 22:33:25 +03:00
Cohee
91fc50b82d Merge branch 'staging' into gork-ai 2025-04-11 21:15:54 +03:00
bmen25124
fc5e0563ba Added ability to override request payload 2025-04-11 19:07:00 +03:00
Cohee
17cdc78a91 Add xAI for image captioning 2025-04-11 19:05:03 +03:00
bmen25124
4736f533a5 Added proxy support to ChatCompletionService 2025-04-11 19:04:32 +03:00
bmen25124
50b2eeb61f Added api check for ConnectionManagerRequestService.handleDropdown 2025-04-01 04:39:41 +03:00
bmen25124
972b1e5fa7 Fixed variable naming, better jsdoc 2025-03-26 23:30:09 +03:00
bmen25124
a7d48b1aed Added overridable instruct settings, removed macro override 2025-03-26 23:21:48 +03:00
bmen25124
ec474f5571 Added stream support to "custom-request" 2025-03-21 20:44:09 +03:00
bmen25124
86de927ab9 Added "custom_url" to ChatCompletionService 2025-03-17 14:54:59 +03:00
bmen25124
d42a81f97c New connection manager events, ConnectionManagerRequestService (#3603) 2025-03-16 16:58:34 +02:00
Cohee
c167890d26 Add multimodal captioning for Cohere 2025-03-05 21:36:43 +02:00
Cohee
d7b3a56c3d chore: await before returning 2025-01-07 20:07:41 +02:00
Cohee
81841ca2a6 WebLLM: use current tokenizer if not available 2025-01-07 20:01:59 +02:00
Cohee
6706cce10d Groq: Add new models and multimodal captions 2024-10-03 08:41:45 +03:00
Cohee
60df924bec MistralAI: Add Pixtral to models and captioning 2024-09-17 21:44:25 +03:00
Cohee
8bb964515a Fix Gemini multimodal with JPG images
Fixes #2763
2024-09-08 10:48:28 +03:00
Cohee
06e3d5f8de Rename MakerSuite => AI Studio 2024-08-21 21:00:17 +03:00
Cohee
8921b78f87 Add debug logs to WebLLM completions 2024-08-13 19:57:38 +03:00
Cohee
7d3f544e63 Refactor extension install menu 2024-08-13 01:09:14 +03:00
Cohee
8685c2f471 Add WebLLM extension summarization 2024-08-12 23:01:03 +03:00
Cohee
77ab694ea0 Add shared utilities for generating text with WebLLM 2024-08-12 22:07:44 +03:00
Cohee
40ee236ca8 Add multimodal captioning for 01.ai 2024-08-01 01:34:49 +03:00
Cohee
003066a036 Add vLLM as multimodal captioning source 2024-06-29 00:33:12 +03:00
daiaji
66454bb711 Add reverse proxy support to Google MakerSuite to allow some Google MakerSuite URLs to no longer be hardcoded with domain names. (#2307)
* Add reverse proxy support to Google MakerSuite.

* Remove hardcoded URLs for some Google MakerSuite API calls.

* Don't send real key to alt.endpoint

* Fix for image captioning

* Fix key validation

* +fix key check for mistral

* Fix caption key validation

* Fix tokenization endpoint use

---------

Co-authored-by: Cohee <18619528+Cohee1207@users.noreply.github.com>
2024-05-24 21:38:29 +03:00
Cohee
022c180b62 Lint and clean-up 2024-04-15 00:39:15 +03:00
based
540cddf300 new turbo model 2024-04-10 14:24:43 +10:00
Cohee
6ac8ef1b48 Add koboldcpp as a multimodal captioning source 2024-03-14 01:03:51 +02:00
based
64d9c9dc5d anthropic captioning 2024-03-05 07:07:38 +10:00
Cohee
a8fb306c12 Add multimodal captioning for ooba 2023-12-24 01:43:29 +02:00
Cohee
3001db3a47 Add additional parameters for custom endpoints 2023-12-20 23:39:10 +02:00
Cohee
ae64c99835 Add custom caption source 2023-12-20 21:05:20 +02:00
Cohee
4b131067e4 Add local multimodal caption sources 2023-12-20 00:45:45 +02:00
Cohee
c7c1513e91 Add proxy support for multimodal captions. Add caption pre-prompt 2023-12-17 19:41:20 +02:00
Cohee
6406f76c7d Compress too large images for Google captions 2023-12-14 22:28:22 +02:00
based
5071b9a369 webstorm moment 2023-12-15 02:01:42 +10:00
based
178b07f414 cleaned up a little 2023-12-14 23:18:56 +10:00
based
0b7c1a98cd added google vision caption support 2023-12-14 22:37:53 +10:00
valadaptive
a37f874e38 Require single quotes 2023-12-02 13:04:51 -05:00
Cohee
22e17cd681 Pass image type to thumbnail creator 2023-11-23 20:50:08 +02:00
Cohee
b0b19edf31 Add multimodal captioning for SD prompt generation 2023-11-19 15:24:43 +02:00
Cohee
4999fbd97c Check for API key in multimodal captions 2023-11-18 20:58:04 +02:00
Cohee
0608c0afac Add OpenRouter and Llava to captioning plugin. 2023-11-17 23:19:21 +02:00