rust+slint+candle+openchat3.5 demo

Last update: Dec 13, 2023

Related tags

Command-line slint-chatbot-demo

Overview

Slint Chatbot Demo

This is a demo of Rust + Slint + Candle + OpenChat LLM, it looks like this:

Do it by yourself

Make sure you have downloaded openchat_3.5.Q4_K_M.gguf and tokenizer.json by:

HF_HUB_ENABLE_HF_TRANSFER=1 HF_ENDPOINT=https://hf-mirror.com huggingface-cli download TheBloke/openchat_3.5-GGUF openchat_3.5.Q4_K_M.gguf
HF_HUB_ENABLE_HF_TRANSFER=1 HF_ENDPOINT=https://hf-mirror.com huggingface-cli download openchat/openchat_3.5 tokenizer.json

The downloads locate at ~/.cache/huggingface/hub/.

Copy them to the root of the current project directory, like the following:

$ ls -lh
total 12G
-rw-r--r-- 1 daoga 197609   71 12月  6 12:34 build.rs
-rw-r--r-- 1 daoga 197609 141K 12月  7 17:37 Cargo.lock
-rw-r--r-- 1 daoga 197609  436 12月  7 17:36 Cargo.toml
-rw-r--r-- 1 daoga 197609 1.1K 12月  6 12:34 LICENSE
-rw-r--r-- 1 daoga 197609 4.1G 12月  7 15:31 openchat_3.5.Q4_K_M.gguf
-rw-r--r-- 1 daoga 197609 7.2G 12月  7 15:53 openchat_3.5.Q8_0.gguf
-rw-r--r-- 1 daoga 197609  468 12月  7 17:39 README.md
drwxr-xr-x 1 daoga 197609    0 12月  7 15:07 src/
drwxr-xr-x 1 daoga 197609    0 12月  6 16:49 target/
-rw-r--r-- 1 daoga 197609 1.8M 12月  7 15:30 tokenizer.json
drwxr-xr-x 1 daoga 197609    0 12月  6 12:34 ui/

and then

cargo run --release

You will look at a GUI app poped up, good luck!

Rust-clippy - A bunch of lints to catch common mistakes and improve your Rust code

Clippy A collection of lints to catch common mistakes and improve your Rust code. There are over 450 lints included in this crate! Lints are divided i

8.7k Dec 31, 2022

Rust-battery - Rust crate providing cross-platform information about the notebook batteries.

battery Rust crate providing cross-platform information about the notebook batteries. Table of contents Overview Supported platforms Install Examples

326 Dec 21, 2022

A Rust-based shell script to create a folder structure to use for a single class every semester. Mostly an excuse to use Rust.

A Rust Course Folder Shell Script PROJECT IN PROGRESS (Spring 2022) When completed, script will create a folder structure of the following schema: [ro

1 Apr 10, 2022

Rust Imaging Library's Python binding: A performant and high-level image processing library for Python written in Rust

ril-py Rust Imaging Library for Python: Python bindings for ril, a performant and high-level image processing library written in Rust. What's this? Th

13 Dec 6, 2022

FTL Rust Demangler is a command-line tool for demangling symbol names that are mangled with the Rust convention

FTL Rust Demangler is a command-line tool for demangling symbol names that are mangled with the Rust convention. It takes a mangled symbol name as input and returns the demangled name

7 Mar 30, 2023

rpm (Rust project manager) is a tool that helps you to manage your rust projects

rpm rpm (Rust project manager) is a open source tool for managing your rust project in an organized way Installation # make sure you have rust install

4 May 4, 2023

auto-rust is an experimental project that aims to automatically generate Rust code with LLM (Large Language Models) during compilation, utilizing procedural macros.

Auto Rust auto-rust is an experimental project that aims to automatically generate Rust code with LLM (Large Language Models) during compilation, util

6 May 14, 2023

Rusty Shellcode Reflective DLL Injection (sRDI) - A small reflective loader in Rust 4KB in size for generating position-independent code (PIC) in Rust.

Shellcode Reflective DLL Injection (sRDI) Shellcode reflective DLL injection (sRDI) is a process injection technique that allows us to convert a given

242 Jul 5, 2023

This rust compiler backend emmits valid CLR IR, enambling you to use Rust in .NET projects

What is rustc_codegen_clr? NOTE: this project is a very early proof-of-concept This is a compiler backend for rustc which targets the .NET platform an

252 Sep 7, 2023

rust+slint+candle+openchat3.5 demo

Related tags

Overview

Slint Chatbot Demo

Do it by yourself

You might also like...

Rust-clippy - A bunch of lints to catch common mistakes and improve your Rust code

Rust-battery - Rust crate providing cross-platform information about the notebook batteries.

A Rust-based shell script to create a folder structure to use for a single class every semester. Mostly an excuse to use Rust.

Rust Imaging Library's Python binding: A performant and high-level image processing library for Python written in Rust

FTL Rust Demangler is a command-line tool for demangling symbol names that are mangled with the Rust convention

rpm (Rust project manager) is a tool that helps you to manage your rust projects

auto-rust is an experimental project that aims to automatically generate Rust code with LLM (Large Language Models) during compilation, utilizing procedural macros.

Rusty Shellcode Reflective DLL Injection (sRDI) - A small reflective loader in Rust 4KB in size for generating position-independent code (PIC) in Rust.

This rust compiler backend emmits valid CLR IR, enambling you to use Rust in .NET projects

Owner

A small cli demo of rust&wasm hostcall framework.

Demo Rust Cursive crate for terminal user interface (TUI)

Demo app duplicated in 5 languages (Go/JavaScript/Python/Ruby/Rust) showing how to go from source code to container image using melange+apko

Demo Repo for BSides 2024 Live Training: "Blue Crab Shells: Getting Started with Offensive Rust Programming"

Polyexen demo of Plonkish Arithmetiation Format (Plaf) on the zkevm-circuits

A demo for a cross-chain lending using chainsight

A simple demo to bind a TCP port with k8s exec channel.k8s.io websocket API.

A set of demo projects for the Fyrox Game Engine.

GraphQL Summit 2023 Workshop Demo for Federated Subscriptions in GraphOS.

Rust-advent - Learning Rust by solving advent of code challenges (Streaming live on Twitch every Monday)