67 Repositories
Rust variable-length-encoding Libraries
fanum tax 64-bit integers with LEB128
rizz64 Fanum* tax 64-bit integers. * Fanum is a popular streamer who taxes his friends by taking bites of their food. This crate provides an efficient
Efficiently store Rust idiomatic bytes related types in Avro encoding.
Serde Avro Bytes Avro is a binary encoding format which provides a "bytes" type optimized to store &[u8] data like. Unfortunately the apache_avro enco
Rust library for A-law and μ-law (mu-law) audio encoding.
law-encoder ⚖️️️law-encoder👨⚖ is a Rust library for A-law and μ-law (mu-law) audio encoding. These encoding schemes are defined in ITU-T standards
Base64 encoding for Aztec's noir language
Noir base64 Noir base64 contains functions for base64 string and u8 array encoding for Aztec's Noir language Installation In your Nargo.toml file, add
Base 32 + 64 encoding and decoding identifiers + bytes in rust, quickly
fast32 Base32 and base64 encoding in Rust. Primarily for integer (u64, u128) and UUID identifiers (behind feature uuid), as well as arbitrary byte arr
🦖 Evolve your fixed length data files into Apache Arrow tables, fully parallelized!
🦖 Evolve your fixed length data files into Apache Arrow tables, fully parallelized! 🔎 Overview ... 📦 Installation The easiest way to install evolut
Truly universal encoding detector in pure Rust - port of Python version
Charset Normalizer A library that helps you read text from an unknown charset encoding. Motivated by original Python version of charset-normalizer, I'
Macro to print variable(s) with values nicely (stripped from release builds)
log_macro Macro to print variable(s) with values nicely (stripped from release builds) Install cargo add log_macro Use Add this to top of file: #[mac
An efficient async condition variable for lock-free algorithms
async-event An efficient async condition variable for lock-free algorithms, a.k.a. "eventcount". Overview Eventcount-like primitives are useful to mak
Zero-copy, no-std proquint encoding and decoding
proqnt A pronounceable quintuplet, or proquint, is a pronounceable 5-letter string encoding a unique 16-bit integer. Proquints may be used to encode b
Extension trait to chunk iterators into const-length arrays.
const-chunks This crate provides an extension trait that lets you chunk iterators into constant-length arrays using const generics. See the docs for m
Tool to convert variable and function names in C/C++ source code to snake_case
FixNameCase Tool to convert variable and function names in C/C++ source code to snake_case. Hidden files and files listed in .gitignore are untouched.
Split text into semantic chunks, up to a desired chunk size. Supports calculating length by characters and tokens
Large language models (LLMs) can be used for many tasks, but often have a limited context size that can be smaller than documents you might want to use. To use documents of larger length, you often have to split your text into chunks to fit within this context size.
🍹Branch and bound solution using Rust to calculate an optimal cocktail ingredient list of arbitrary length 🍸
Calculating an Optimal Cocktail Ingredient List Tom Explains the Problem You have 100 different ingredients You have 20 cocktails, each of which use 2
High performance wlroots screen recording, featuring hardware encoding
wl-screenrec High performance wlroots based screen recorder. Uses dma-buf transfers to get surface, and uses the GPU to do both the pixel format conve
Stdto provides a set of functional traits for conversion between various data representations.
Stdto stdto provides a set of functional traits for conversion between various data representations. | Examples | Docs | Latest Note | stdto = "0.13.0
Huffman Encoding/Decoding
Huffman Encoding/Decoding This project is inspired by lab_huffman of CS225(2022fall) @ UIUC Team: -- Chaoqi LIU ([email protected]) -- Jiahu
Safe Unix shell-like parameter expansion/variable substitution via cross-platform CLI or Rust API
Safe Unix shell-like parameter expansion/variable substitution for those who need a more powerful alternative to envsubst but don't want to resort to
Databento Binary Encoding (DBZ) - Fast message encoding and storage format for market data
dbz A library (dbz-lib) and CLI tool (dbz-cli) for working with Databento Binary Encoding (DBZ) files. Python bindings for dbz-lib are provided in the
TLV-C encoding support.
TLV-C: Tag - Length - Value - Checksum TLV-C is a variant on the traditional [TLV] format that adds a whole mess of checksums and whatnot. Why, you as
A tool to convert old and outdated "characters" into the superior Rustcii-Encoding.
rustcii A tool to convert old and outdated "characters" into the superior Rustcii-Encoding. Speak your mind. Blazingly ( 🦀 ) fast ( 🚀 ). Github | cr
Rust utility crate for parsing, encoding and generating x25519 keys used by WireGuard
WireGuard Keys This is a utility crate for parsing, encoding and generating x25519 keys that are used by WireGuard. It exports custom types that can b
Entropy Encoding notebook. Simple implementations of the "tANS" encoder/decoder.
EntropyEncoding Experiments This repository contains my Entropy Encoding notebook. Entropy encoding is an efficient lossless data compression scheme.
Substreams development kit for Ethereum chains, contains Firehose Block model and helpers as well as utilities for Ethereum ABI encoding/decoding.
Substreams Ethereum Substreams development kit for Ethereum chains, contains Rust Firehose Block model and helpers as well as utilities for Ethereum A
Figma Agent for Linux (a.k.a. Font Helper)
Figma Agent for Linux (a.k.a. Font Helper)
A binary encoder / decoder implementation in Rust.
Bincode A compact encoder / decoder pair that uses a binary zero-fluff encoding scheme. The size of the encoded object will be the same or smaller tha
Parse and encoding of data using the SCTE-35 standard.
SCTE-35 lib and parser for Rust Work in progress! This library provide access to parse and encoding of data using the SCTE-35 standard. This standard
A rust bencode encoding/decoding implementation backed by serde.
Bende A rust bencode encoding/decoding implementation backed by serde. About This is one of a few bencode implementations available for rust. Though t
Astro Format is a library for efficiently encoding and decoding a set of bytes into a single buffer format.
Astro Format is a library for efficiently transcoding arrays into a single buffer and native rust types into strings
Derive macro for encoding/decoding instructions and operands as bytecode
bytecoding Derive macro for encoding and decoding instructions and operands as bytecode. Documentation License Licensed under either of Apache License
AV1 encoding tool with fast VMAF sampling. Uses svt-av1, ffmpeg & vmaf
ab-av1 AV1 encoding tool with fast VMAF sampling. Uses svt-av1, ffmpeg & vmaf. Command: auto-encode Automatically determine the best crf to deliver th
A small command-line utility for encoding and decoding bech32 strings
A small command-line utility for encoding and decoding bech32 strings.
A library for decoding and encoding DirectDraw Surface files
A library for decoding and encoding DirectDraw Surface files. Currently handles decoding some uncompressed DX9 formats, as well as DXT1-5. Supports encoding in the A8R8G8B8 format. Support for cubemaps and volumes, as well as DX10 is planned.
This is a Discord bot written in Rust to translate to and from the Bottom Encoding Standard using bottom-rs and Serenity.
bottom-bot This is a Discord bot written in Rust to translate to and from the Bottom Encoding Standard using bottom-rs and Serenity. Ever had this pro
corncobs: Corny COBS encoding/decoding in Rust
corncobs: Corny COBS encoding/decoding in Rust This crate provides Consistent Overhead Byte Stuffing (COBS) support for Rust programs, with a particul
A series of compact encoding schemes for building small and fast parsers and serializers
A series of compact encoding schemes for building small and fast parsers and serializers
a universal meta-transliterator that can decipher arbitrary encoding schemas, built in pure Rust
transliterati a universal meta-transliterator that can decipher arbitrary encoding schemas, built in pure Rust what does it do? You give it this: Барл
A (de)serializer for RLP encoding in ETH
An ETH RLP (Recursive Length Prefix) (de)serializer written in Rust
Port Finance Variable Rate Lending & Liquidity Mining Program
Port Variable Rate Lending Forked from Solana Token Lending Bug Bounty We have partnered with Immunefi to offer bug bounty up to 500K: https://immunef
Encoding and decoding images in Rust
Image Maintainers: @HeroicKatora, @fintelia How to contribute An Image Processing Library This crate provides basic image processing functions and met
A cargo subcommand to fetch the $OUT_DIR environment variable from build scripts
cargo-outdir A cargo subcommand to fetch the $OUT_DIR variable from build scripts. This is extremely useful to inspect the output of automatically gen
A wav encoding and decoding library in Rust
Hound A wav encoding and decoding library in Rust. Hound can read and write the WAVE audio format, an ubiquitous format for raw, uncompressed audio. T
CBOR (binary JSON) for Rust with automatic type based decoding and encoding.
THIS PROJECT IS UNMAINTAINED. USE serde_cbor INSTEAD. This crate provides an implementation of RFC 7049, which specifies Concise Binary Object Represe
PNG decoding and encoding library in pure Rust
PNG Decoder/Encoder PNG decoder/encoder in pure Rust. It contains all features required to handle the entirety of the PngSuite by Willem van Schack. p
A tool to deserialize data from an input encoding, transform it and serialize it back into an output encoding.
dts A simple tool to deserialize data from an input encoding, transform it and serialize it back into an output encoding. Requires rust = 1.56.0. Ins
A "cursed" container with opaque keys, usable as a static variable
cursedcontainer Please, for the love of all things good in the world, do not use this crate unless you've read the code thoroughly and understand the
Variable-length signed and unsigned integer encoding that is byte-orderable for Rust
ordered-varint Provides variable-length signed and unsigned integer encoding that is byte-orderable. This crate provides the Variable trait which enco
The tool to make svg with triangles by length from two points.
The tool to make svg with triangles by length from two points.
Bad Apple!! for the Uxn stack-machine
bad-apple-uxn Bad Apple!! for the Uxn stack-machine by Hundred Rabbits. Quick start cargo run --release -- --input assets/badapple.mp4 --output badapp
decode a byte stream of varint length-encoded messages into a stream of chunks
length-prefixed-stream decode a byte stream of varint length-encoded messages into a stream of chunks This crate is similar to and compatible with the
🧵 Generate self-describing strings of a given length to help aid software testing
rust-counter-strings Counter strings generator written in rust to help aid software testing What is a counterstring? "A counterstring is a graduated s
Serde support for encoding/decoding rusty_v8 values
Serde support for encoding/decoding rusty_v8 values
ABI encoding, fast
fast-abi Encodes and decodes abi data, fast. Usage const RUST_ENCODER = new FastABI(ABI as MethodAbi[]); const callData = RUST_ENCODER.encodeInput('sa
A performant binary encoding for geographic data based on flatbuffers
FlatGeobuf A performant binary encoding for geographic data based on flatbuffers that can hold a collection of Simple Features including circular inte
TIFF decoding and encoding library in pure Rust
image-tiff TIFF decoding and encoding library in pure Rust Supported Features Baseline spec (other than formats and tags listed below as not supported
Google Encoded Polyline encoding & decoding in Rust.
polyline Google Encoded Polyline encoding & decoding in Rust. A Note on Coordinate Order This crate uses Coordinate and LineString types from the geo-
Rust-tokenizer offers high-performance tokenizers for modern language models, including WordPiece, Byte-Pair Encoding (BPE) and Unigram (SentencePiece) models
rust-tokenizers Rust-tokenizer offers high-performance tokenizers for modern language models, including WordPiece, Byte-Pair Encoding (BPE) and Unigra
A tool that uses the credentials stored in 1password as an environment variable.
openv A tool that uses the credentials stored in 1password as an environment variable. Requirements 1password command-line tool Getting Started # Sign
Encoding and decoding images in Rust
Image Maintainers: @HeroicKatora, @fintelia How to contribute An Image Processing Library This crate provides basic image processing functions and met
A TOML encoding/decoding library for Rust
toml-rs A TOML decoder and encoder for Rust. This library is currently compliant with the v0.5.0 version of TOML. This library will also likely contin
A HTML entity encoding library for Rust
A HTML entity encoding library for Rust Example usage All example assume a extern crate htmlescape; and use htmlescape::{relevant functions here}; is
Character encoding support for Rust
Encoding 0.3.0-dev Character encoding support for Rust. (also known as rust-encoding) It is based on WHATWG Encoding Standard, and also provides an ad
A Gecko-oriented implementation of the Encoding Standard in Rust
encoding_rs encoding_rs an implementation of the (non-JavaScript parts of) the Encoding Standard written in Rust and used in Gecko (starting with Fire
Encoding and decoding support for BSON in Rust
bson-rs Encoding and decoding support for BSON in Rust Index Overview of BSON Format Usage BSON Values BSON Documents Modeling BSON with strongly type
Implementation of Bencode encoding written in rust
Rust Bencode Implementation of Bencode encoding written in rust. Project Status Not in active developement due to lack of time and other priorities. I
A binary encoder / decoder implementation in Rust.
Bincode A compact encoder / decoder pair that uses a binary zero-fluff encoding scheme. The size of the encoded object will be the same or smaller tha
I/O and binary data encoding for Rust
nue A collection of tools for working with binary data and POD structs in Rust. pod is an approach at building a safe interface for transmuting POD st