425 Repositories
Rust data-cloud Libraries
Filen.io is a cloud storage provider with an open-source desktop client.
Library to call Filen.io API from Rust Filen.io is a cloud storage provider with an open-source desktop client. My goal is to write a library which ca
Garbage Collector(Hyaline- Safe Memory Reclaimation) for lock free data structures
Hyaline-SMR This crate provides garbage collection using hyaline algorithm for building concurrent data structures. When a thread removes an object fr
Lightweight Google Cloud Storage sync Rust Client with better performance than gsutil rsync
gcs-rsync Lightweight and efficient Rust gcs rsync for Google Cloud Storage. gcs-sync is faster than gsutil rsync when files change a lot while perfor
Showing how to deploy a Terra smart contract using Chainlink Data Feeds
Chainlink Terra Developing Requirements This demo requires the following components: Rust: rustup with cargo 1.44.1+. rustc and cargo 1.44.1+. Install
Mordern Redis Cluster solution for easy operation.
Mordern Redis Cluster solution for easy operation.
A library for easily creating WebRTC data channel connections in Rust
Cyberdeck A library for easily creating WebRTC data channel connections in Rust.
Zenith substitutes PostgreSQL storage layer and redistributes data across a cluster of nodes
Zenith substitutes PostgreSQL storage layer and redistributes data across a cluster of nodes
Generate alerts for when metrics/recordings become absent
prometheus-absent-data-alert-rule-generator prometheus-absent-data-alert-rule-generator is a tool to generate alerts for missing data in time-series t
It is a backup tool that creates backups and stores them on an object storage
Hold My Backup It is a backup tool that creates backups and stores them on an object storage. By default it uses minio but you can use AWS: S3 as well
Cyclic Double-Linked List
Double-Linked List This crate provides a doubly-linked list with owned nodes, implemented as a cyclic list. Usage First, add dependency in your Cargo.
Display financial Data on The Terminal
tuinance Tuinance is a performant TUI program to display financial data, written completely in Rust. All data is gathered through the Yahoo Finance AP
Analysis of Canadian Federal Elections Data
Canadian Federal Elections election is a small Rust program for processing vote data from Canadian Federal Elections. After building, see election --h
CLI tools to process cryptocurrency data
crypto-cli-tools A collection of CLI tools to process cryptocurrency data. Install: RUSTFLAGS="-C target-cpu=native" cargo install crypto-cli-tools cr
Zei is a library that provide tools to create and verify public transaction with confidential data.
#Zei: Findora's Cryptographic Library Zei is a library that provide tools to create and verify public transaction with confidential data. Support: Bas
binocle is a graphical tool to visualize binary data
a graphical tool to visualize binary data
Data graphing library for command line.
DataBrush DataBrush is a simple library for displaying structured data in the command line. In supports dividing data into chunks and highlighting cer
Twitch data consumer and broadcaster
NeoTwitch Arch Network broadcaster Chat (message buffer) If the message buffer is full then shut down Channel point events If the message buffer is fu
Blazingly fast data generation & seeding for MongoDB
Planter Blazingly fast and simple data generation & seeding for MongoDB Installation Use the package manager cargo to install planter. Add the followi
Command line tool to extract various data from Blender .blend files
blendtool Command line tool to extract various data from Blender .blend files. Currently supports dumping Eevee irradiance volumes to .dds, new featur
📺(tv) Tidy Viewer is a cross-platform CLI csv pretty printer that uses column styling to maximize viewer enjoyment.
📺(tv) Tidy Viewer is a cross-platform CLI csv pretty printer that uses column styling to maximize viewer enjoyment.
below is an interactive tool to view and record historical system data.
A time traveling resource monitor for modern Linux systems
ruborute is an interactive command-line tool to get asphyxia@sdvx gaming data.
ruborute Are you 暴龍天 ?. The ruborute is an interactive command-line tool to get asphyxia@sdvx gaming data. asphyxia-core/plugins: https://github.com/a
TestDrive automatically scrapes input/output data from BOJ(Baekjoon Online Judge) and runs tests for your executable binary file!
🚖 TestDrive What does it do? TestDrive automatically scrapes input/output data from BOJ(Baekjoon Online Judge) and runs tests for your executable bin
Fill Apache Arrow record batches from an ODBC data source in Rust.
arrow-odbc Fill Apache Arrow arrays from ODBC data sources. This crate is build on top of the arrow and odbc-api crate and enables you to read the dat
TensorBase is a new big data warehousing with modern efforts.
TensorBase is a new big data warehousing with modern efforts.
A cross-platform library to retrieve performance statistics data.
A toolkit designed to be a foundation for applications to monitor their performance.
A highly efficient daemon for streaming data from Kafka into Delta Lake
A highly efficient daemon for streaming data from Kafka into Delta Lake
Utilities to gather data out of roms. Written in Rust. It (should) support all types.
snesutilities Utilities to gather data out of roms. Written in Rust. It (should) support all types. How Have a look at main.rs: use snesutilities::Sne
Engula empowers engineers to build reliable and cost-effective databases.
Engula is a storage engine that empowers engineers to build reliable and cost-effective databases with less effort and more confidence. Engula is in t
Obake is a procedural macro for declaring and maintaining versioned data-structures.
Obake is a procedural macro for declaring and maintaining versioned data-structures. The name 'obake' is taken from the Japanese 'お化け (おばけ)', a class of supernatural beings in Japanese folklore that shapeshift.
Algorithms and Data Structures of all kinds written in Rust.
Classic Algorithms in Rust This repo contains the implementation of various classic algorithms for educational purposes in Rust. Right now, it is in i
Hypergraph is data structure library to create a directed hypergraph in which a hyperedge can join any number of vertices.
Hypergraph is data structure library to create a directed hypergraph in which a hyperedge can join any number of vertices.
Hypergraph is a data structure library to generate directed hypergraphs.
Hypergraph is data structure library to create a directed hypergraph in which a hyperedge can join any number of vertices.
An expression based data notation, aimed at transpiling itself to any cascaded data notation.
Lala An expression oriented data notation, aimed at transpiling itself to any cascaded data notation. Lala is separated into three components: Nana, L
🚀 efficient approximate nearest neighbor search algorithm collections library written in Rust 🦀 .
🚀 efficient approximate nearest neighbor search algorithm collections library written in Rust 🦀 .
A Modern Real-Time Data Processing & Analytics DBMS with Cloud-Native Architecture, built to make the Data Cloud easy
A Modern Real-Time Data Processing & Analytics DBMS with Cloud-Native Architecture, built to make the Data Cloud easy
A Modern Real-Time Data Processing & Analytics DBMS with Cloud-Native Architecture, built to make the Data Cloud easy
A Modern Real-Time Data Processing & Analytics DBMS with Cloud-Native Architecture, built to make the Data Cloud easy
Doku is a framework for building documentation with code-as-data methodology in mind.
Doku is a framework for building documentation with code-as-data methodology in mind. Say goodbye to stale, hand-written documentation - with D
A Key-Value data storage system. - dorea db
Dorea DB 🛰 Dorea is a key-value data storage system. It is based on the Bitcask storage model Documentation | Crates.io | API Doucment 简体中文 | English
Simple Spreadsheet editor written in Rust
Rexcel Simple Spreadsheet editor written in Rust Keyboard Shortcuts: CTRL + S = Save CTRL + Q = Quit CTRL + W + Save And Quit CTRL + ALT + S = Sav
ConnectorX - Fastest library to load data from DB to DataFrames in Rust and Python
ConnectorX enables you to load data from databases into Python in the fastest and most memory efficient way.
Serde is a framework for serializing and deserializing Rust data structures efficiently and generically.
Serde is a framework for serializing and deserializing Rust data structures efficiently and generically.
QuickCheck bug hunting in Rust standard library data structures
BugHunt, Rust This project is aiming to provide "stateful" QuickCheck models for Rust's standard library. That is, we build up a random list of operat
Binary Analysis Framework in Rust
Welcome to Falcon Falcon is a formal binary analysis framework in Rust. Expression-based IL with strong influences from RREIL and Binary Ninja's LLIL.
The trait for generating structured data from arbitrary, unstructured input.
Arbitrary The trait for generating structured data from arbitrary, unstructured input. About The Arbitrary crate lets you construct arbitrary instance
A utility like pkg-audit for Arch Linux. Based on Arch Security Team data.
arch-audit pkg-audit-like utility for Arch Linux. Based on data from security.archlinux.org collected by the awesome Arch Security Team. Installation
Experimental playground for wiktionary data
wikt Experimental playground for wiktionary data. This document might not update as often as the code does. Set up You'll want a minimum of 10 GB free
Dynamically get the suggested clusters in the data for unsupervised learning.
Python implementation of the Gap Statistic Purpose Dynamically identify the suggested number of clusters in a data-set using the gap statistic. Full e
Barnes-Hut t-SNE implementation written in Rust.
bhtsne Barnes-Hut implementation of t-SNE written in Rust. The algorithm is described with fine detail in this paper by Laurens van der Maaten. Instal
Orkhon: ML Inference Framework and Server Runtime
Orkhon: ML Inference Framework and Server Runtime Latest Release License Build Status Downloads Gitter What is it? Orkhon is Rust framework for Machin
A Modern Real-Time Data Processing & Analytics DBMS with Cloud-Native Architecture, written in Rust
Datafuse Modern Real-Time Data Processing & Analytics DBMS with Cloud-Native Architecture Datafuse is a Real-Time Data Processing & Analytics DBMS wit
Simple but powerful graph library for Rust
Graphlib Graphlib is a simple and powerful Rust graph library. This library attempts to provide a generic api for building, mutating and iterating ove
Graph data structure library for Rust.
petgraph Graph data structure library. Supports Rust 1.41 and later. Please read the API documentation here Crate feature flags: graphmap (default) en
GraphScope: A One-Stop Large-Scale Graph Computing System from Alibaba
A One-Stop Large-Scale Graph Computing System from Alibaba GraphScope is a unified distributed graph computing platform that provides a one-stop envir
DataFrame / Series data processing in Rust
black-jack While PRs are welcome, the approach taken only allows for concrete types (String, f64, i64, ...) I'm not sure this is the way to go. I want
Rnp - A simple cloud-friendly tool for testing network reachability.
Rnp - A simple cloud-friendly tool for testing network reachability. Release Status Crates.io Github release Nuget packages NOTE: This project is in e
SegVec data structure for rust. Similar to Vec, but allocates memory in chunks of increasing size.
segvec This crate provides the SegVec data structure. It is similar to Vec, but allocates memory in chunks of increasing size, referred to as "segment
the file filesystem: mount semi-structured data (like JSON) as a Unix filesystem
ffs: the file filesystem ffs, the file filessytem, let's you mount semi-structured data as a fileystem---a tree structure you already know how to work
🐸Slippi DB ingests Slippi replays and puts the data into a SQLite database for easier parsing.
The primary goal of this project is to make it easier to analyze large amounts of Slippi data. Its end goal is to create something similar to Ballchasing.com but for Melee.
Lossless compressor and decompressor for numerical data using quantiles
This rust library compresses and decompresses sequences of numerical data very well. It currently supports the following data types: i32, i64, u32, u64, f32, f64. Smaller data types like i16 can be efficiently compressed by casting to i32. Timestamp support may come soon in the future.
Data structures and algorithms for 3D geometric modeling.
geom3d Data structures and algorithms for 3D geometric modeling. Features: Bezier curve and surface B-Spline curve and surface Spin surface Sweep surf
🤖 brwrs is a new protocol running over TCP/IP that is intended to be a suitable candidate for terminal-only servers
brwrs is a new protocol running over TCP/IP that is intended to be a suitable candidate for terminal-only servers (plain text data). That is, although it can be accessed from a browser, brwrs will not correctly interpret the browser's GET request.
Rust library for string parsing of basic data structures.
afmt Simple rust library for parsing basic data structures from strings. Usage You can specify string formats to any strucute, via the use of the fmt
😎 A CLI tool for fetching data and displaying it nicely
😎 A CLI tool for fetching data and displaying it nicely. (The neofetch for remote data fetching)
Uindex is a data store, for data that can be parsed as sentences in some context-free language.
Uindex - Universal index Uindex is a data store, for data that can be parsed as sentences in some context-free language.
Simple Data Stealer
helfsteal Simple Data Stealer Hi All, I published basic data stealer malware with Rust. FOR EDUCATIONAL PURPOSES. You can use it for Red Team operatio
Quickwit is a big data search engine.
Quickwit This repository will host Quickwit, the big data search engine developed by Quickwit Inc. We will progressively polish and opensource our cod
A proof of concept implementation of cyclic data structures in stable, safe, Rust.
A proof of concept implementation of cyclic data structures in stable, safe, Rust. This demonstrates the combined power of the static-rc crate and the
Data-oriented and data-driven game engine written in Rust
What is Amethyst? Amethyst is a data-driven and data-oriented game engine aiming to be fast and as configurable as possible. Principles These principl
A refreshingly simple data-driven game engine built in Rust
What is Bevy? Bevy is a refreshingly simple data-driven game engine built in Rust. It is free and open-source forever! WARNING Bevy is still in the ve
Fluvio is a high-performance distributed streaming platform that's written in Rust
Fluvio is a high-performance distributed streaming platform that's written in Rust, built to make it easy to develop real-time applications.
OpenStreetMap flatdata format and compiler
osmflat Flat OpenStreetMap (OSM) data format providing an efficient random data access through memory mapped files. The data format is described and i
A performant binary encoding for geographic data based on flatbuffers
FlatGeobuf A performant binary encoding for geographic data based on flatbuffers that can hold a collection of Simple Features including circular inte
Rust read/write support for GPS Exchange Format (GPX)
gpx gpx is a library for reading and writing GPX (GPS Exchange Format) files. It uses the primitives provided by geo-types to allow for storage of GPS
Zero-Copy reading and writing of geospatial data.
GeoZero Zero-Copy reading and writing of geospatial data. GeoZero defines an API for reading geospatial data formats without an intermediate represent
Spatial Data Structures for Rust
spade Documentation Using spade Examples Project state Performance License Spade (SPAtial DatastructurEs, obviously!) implements a few nifty data stru
An advanced geospatial data analysis platform
Bringing the power of Whitebox GAT to the world at large This page is related to the stand-alone command-line program and Python scripting API for geo
Rust read/write support for GPS Exchange Format (GPX)
gpx gpx is a library for reading and writing GPX (GPS Exchange Format) files. It uses the primitives provided by geo-types to allow for storage of GPS
An implementation of the FP-Growth algorithm in pure Rust.
fp-growth-rs An implementation of the FP-Growth algorithm in pure Rust, which is inspired by enaeseth/python-fp-growth. Usage Add this to your Cargo.t
Proof-of-concept for a memory-efficient data structure for zooming billion-event traces
Proof-of-concept for a gigabyte-scale trace viewer This repo includes: A memory-efficient representation for event traces An unusually simple and memo
A Google-like web search engine that provides the user with the most relevant websites in accordance to his/her query, using crawled and indexed textual data and PageRank.
Mini Google Course project for the Architecture of Computer Systems course. Overview: Architecture: We are working on multiple components of the web c
Rayon: A data parallelism library for Rust
Rayon Rayon is a data-parallelism library for Rust. It is extremely lightweight and makes it easy to convert a sequential computation into a parallel
A high-performance, high-reliability observability data pipeline.
Quickstart • Docs • Guides • Integrations • Chat • Download What is Vector? Vector is a high-performance, end-to-end (agent & aggregator) observabilit
Orkhon: ML Inference Framework and Server Runtime
Orkhon: ML Inference Framework and Server Runtime Latest Release License Build Status Downloads Gitter What is it? Orkhon is Rust framework for Machin
Cleora AI is a general-purpose model for efficient, scalable learning of stable and inductive entity embeddings for heterogeneous relational data.
Cleora Cleora is a genus of moths in the family Geometridae. Their scientific name derives from the Ancient Greek geo γῆ or γαῖα "the earth", and metr
High-performance runtime for data analytics applications
Weld Documentation Weld is a language and runtime for improving the performance of data-intensive applications. It optimizes across libraries and func
A highly efficient daemon for streaming data from Kafka into Delta Lake
kafka-delta-ingest The kafka-delta-ingest project aims to build a highly efficient daemon for streaming data through Apache Kafka into Delta Lake. Thi
RiteLinked - LinkedHashMap & LinkedHashSet in Rust
RiteLinked -- HashMap-like containers that hold their key-value pairs in a user controllable order RiteLinked provides more up to date versions of Lin
The simplest way to de-Google your life and business: Inbox, Calendar, Files, Contacts & much more
Bloom The all-in-one private workspace Try it for free! You no longer trust tech monopolies with your data? You are done with your privacy invaded by
A cloud-native distributed serverless workers platform.
rusty-workers A cloud-native distributed serverless workers platform. Features JavaScript and WebAssembly engine powered by V8 Fetch API Highly scalab
Easily share data between terminal windows!
abra A tool that makes data sharing between terminal windows easy. abra can be used for displaying info about the current working directory, for split
A Rust application which funnels external webhook event data to an Urbit chat.
Urbit Webhook Funnel This is a simple Rust application which funnels external webhook event data to an Urbit chat. This application is intended to be
A Rust library to extract useful data from HTML documents, suitable for web scraping.
select.rs A library to extract useful data from HTML documents, suitable for web scraping. NOTE: The following example only works in the upcoming rele
High-performance log search engine.
NOTE: This project is under development, please do not depend on it yet as things may break. MinSQL MinSQL is a log search engine designed with simpli
A Rust library for zero-allocation parsing of binary data.
Zero A Rust library for zero-allocation parsing of binary data. Requires Rust version 1.6 or later (requires stable libcore for no_std). See docs for
Rust client for NATS, the cloud native messaging system.
A Rust client for the NATS messaging system. Status Motivation Rust may be the most interesting new language the NATS ecosystem has seen. We believe t
A data-first Rust-native UI design toolkit.
Druid A data-first Rust-native UI toolkit. Druid is an experimental Rust-native UI toolkit. Its main goal is to offer a polished user experience. Ther
A refreshingly simple data-driven game engine built in Rust
What is Bevy? Bevy is a refreshingly simple data-driven game engine built in Rust. It is free and open-source forever! WARNING Bevy is still in the ve
Rusty Object Notation
Rusty Object Notation RON is a simple readable data serialization format that looks similar to Rust syntax. It's designed to support all of Serde's da
pem-rs pem PEM jcreekmore/pem-rs [pem] — A Rust based way to parse and encode PEM-encoded data
pem A Rust library for parsing and encoding PEM-encoded data. Documentation Module documentation with examples Usage Add this to your Cargo.toml: [dep