3 Rust Ggml Libraries

Rust library for integrating local LLMs (with llama.cpp) and external LLM APIs.

Table of Contents About The Project Getting Started Roadmap Contributing License Contact A rust interface for the OpenAI API and Llama.cpp ./server AP

4 Dec 18, 2023

Do the RWKV thing, but now in Rust with GGML

RWKV, but in Rust with ggml A project which reimplementation llama.cpp in rustformers/llm style. Current situation Performance issue: current version

4 May 6, 2023

GGML bindings that aim to be idiomatic Rust rather than directly corresponding to the C/C++ interface

rusty-ggml GGML bindings that aim to be idiomatic Rust rather than directly corresponding to the C/C++ interface. GG-what? See: https://github.com/gge

6 May 16, 2023

Rust Ggml Resources

Rust ggml Libraries

Rust library for integrating local LLMs (with llama.cpp) and external LLM APIs.

Do the RWKV thing, but now in Rust with GGML

GGML bindings that aim to be idiomatic Rust rather than directly corresponding to the C/C++ interface

Rust Ggml Resources

Related tags

Rust ggml Libraries

Rust library for integrating local LLMs (with llama.cpp) and external LLM APIs.

Do the RWKV thing, but now in Rust with GGML

GGML bindings that aim to be idiomatic Rust rather than directly corresponding to the C/C++ interface