5 Repositories
Rust rwkv Libraries
A highly customizable, full scale web backend for web-rwkv, built on axum with websocket protocol.
web-rwkv-axum A axum web backend for web-rwkv, built on websocket. Supports BNF-constrained grammar, CFG sampling, etc., all streamed over network. St
12 Sep 25, 2023
A localized open-source AI server that is better than ChatGPT.
💯AI00 RWKV Server English | ä¸æ–‡ | 日本語 AI00 RWKV Server is an inference API server based on the RWKV model. It supports VULKAN inference acceleration a
142 Aug 23, 2023
Implementation of the RWKV language model in pure WebGPU/Rust.
Web-RWKV This is an implementation of the language model of RWKV in pure WebGPU. Compile and Run Install Rust. Run cargo run --release --example gen t
22 Jul 12, 2023
Do the RWKV thing, but now in Rust with GGML
RWKV, but in Rust with ggml A project which reimplementation llama.cpp in rustformers/llm style. Current situation Performance issue: current version
4 May 6, 2023
A small, basical and unoptimized version of RWKV in Rust written by someone with no math or ML knowledge.
Smol Rust RWKV What is it? A simple example of the RWKV approach to language models written in Rust by someone that knows basically nothing about math
32 Apr 9, 2023