Implementation of the RWKV language model in pure WebGPU/Rust.

研究社交

Last update: Jul 12, 2023

Related tags

Web programming web-rwkv

Overview

Web-RWKV

This is an implementation of the language model of RWKV in pure WebGPU.

Compile and Run

Install Rust.
Run cargo run --release --example gen to generate 100 tokens and measure the time cost.
Run cargo run --release --example chat to chat with the model.
To specify the location of your safetensors model, use cargo run --release --example chat -- --model /path/to/model.

Or you can download the pre-compiled binaries from the release page and run

$ chat --model /path/to/model

Use in Your Project

To use in your own rust project, simply add web-rwkv = "0.1" as a dependency in your Cargo.toml. Check examples on how to create the environment, the tokenizer and how to run the model.

Convert Models

You may download the official RWKV World series models from HuggingFace, and convert them via the provided convert_safetensors.py.

An already-converted 0.4B model can be found under assets/models.

Credits

Tokenizer is implemented by @koute.

You might also like...

puppy is an example implementation of a tiny Web browser for educational purposes.

An example implementation of a tiny Web browser for educational purposes.

580 Dec 28, 2022

An implementation of the callbag spec

callbag-rs An implementation of the callbag spec License Licensed under either of Apache License, Version 2.0, (LICENSE-APACHE or https://www.apache.o

29 Dec 5, 2022

A minimalistic implementation of Refal.

Refal A minimalistic implementation of Refal. It is based on the following (in Russian) papers by Sergei Romanenko: С.А.Романенко. Машинно-независимый

12 Apr 7, 2022

Rust Macro which loads files into the rust binary at compile time during release and loads the file from the fs during dev.

Rust Embed Rust Custom Derive Macro which loads files into the rust binary at compile time during release and loads the file from the fs during dev. Y

1k Jan 5, 2023

Rust I18n is use Rust codegen for load YAML file storage translations on compile time, and give you a t! macro for simply get translation texts.

Rust I18n Rust I18n is use Rust codegen for load YAML file storage translations on compile time, and give you a t! macro for simply get translation te

73 Dec 27, 2022

lispr is a Rust macro that tries to implement a small subset of LISPs syntax in Rust

lispr lispr is a Rust macro that tries to implement a small subset of LISPs syntax in Rust. It is neither especially beautiful or efficient since it i

0 Feb 4, 2022

A Rust web framework

cargonauts - a Rust web framework Documentation cargonauts is a Rust web framework intended for building maintainable, well-factored web apps. This pr

179 Dec 25, 2022

A Rust library to extract useful data from HTML documents, suitable for web scraping.

select.rs A library to extract useful data from HTML documents, suitable for web scraping. NOTE: The following example only works in the upcoming rele

829 Dec 28, 2022

openapi schema serialization for rust

open api Rust crate for serializing and deserializing open api documents Documentation install add the following to your Cargo.toml file [dependencies