OpenAI Hub
OpenAI Hub is a comprehensive and robust tool designed to streamline and enhance your interaction with OpenAI's API. It features an innovative way to load balance multiple API keys, allowing users to make requests without needing individual OpenAI API keys. Additionally, it employs a global access control list (ACL) that gives you the power to regulate which APIs and models users can utilize. The Hub also includes JWT Authentication for secure and reliable user authentication, and now, an Access Log feature for tracking API usage and token consumption.
Key Features
- Load Balancing: Utilize multiple API keys efficiently, preventing the overuse of any single key.
- API Key Protection: Allow users to make requests without the need for an individual OpenAI API key, enhancing security and ease of use.
- Global ACL: Regulate user access to specific APIs and models, ensuring the right people have access to the right resources.
- JWT Authentication: Secure and reliable user authentication system using JSON Web Tokens (JWT).
- Access Log: Keep track of API usage and token consumption with our newly implemented access log feature. You can choose to store logs in file, SQLite, MySQL, or PostgreSQL backends.
Getting Started
You can run OpenAI Hub either by cloning the repository and using Cargo, or by using Docker.
Running with Cargo
git clone https://github.com/lightsing/openai-hub.git
cd openai-hub
# build and run
cargo run run --bin openai-hubd --all-features --release
Running with Docker
# pull the Docker image
docker pull lightsing/openai-hub:latest
# run the Docker container
docker run -p 8080:8080 lightsing/openai-hub
# or with your custom configs
docker run -v /your/path/to/config:/opt/openai-hub/config -p <yourport> lightsing/openai-hub
Please replace username with the appropriate GitHub username.
Upcoming Features (To-Do List)
- Per User/RBAC ACL: We're developing a more granular access control system to allow permissions to be set on a per-user basis, and Role-Based Access Control (RBAC) to allow users to have roles that define their access levels.
We're always working to improve OpenAI Hub and add new features. Stay tuned for these exciting updates!
Contributing
We encourage you to contribute to OpenAI Hub! Please check out the Contributing to OpenAI Hub guide for guidelines about how to proceed.
License
OpenAI Hub is released under the MIT License.
Contact
If you have any questions, issues, or suggestions for improvement, please feel free to open an issue in this repository or contact us directly.
We're excited to see how you'll use OpenAI Hub!
4 Dec 7, 2022
73 Dec 27, 2022
4 Oct 26, 2022
10 Mar 28, 2023
10 Dec 25, 2022
7 Dec 18, 2022
5 Nov 17, 2021
26 Nov 25, 2022
11 Aug 10, 2022
2 Nov 12, 2022
11 Nov 5, 2021
99 Jan 5, 2023
54 Apr 21, 2022
738 Dec 28, 2022
475 Jan 2, 2023
6 May 22, 2022
11 Dec 23, 2022
4 Dec 27, 2022
2 Dec 15, 2022