119 Repositories
Rust distributed-computing Libraries
Salty and Sweet one-line Rust Runtime Optimization Library
SAS SAS (Salty-And-Sweet) is an one-line Rust runtime optimization library. Features NUMA-aware rayon: numa feature should be enabled If you have 1 NU
A Distributed SQL Database - Building the Database in the Public to Learn Database Internals
Table of Contents Overview Usage TODO MVCC in entangleDB SQL Query Execution in entangleDB entangleDB Raft Consensus Engine What I am trying to build
Spider ported to Node.js
spider-rs The spider project ported to Node.js Getting Started npm i @spider-rs/spider-rs --save import { Website, pageTitle } from "@spider-rs/spider
A reconciliation service to sync a key-value map over multiple instances.
reconcile-rs Docs This crate provides a key-data map structure HRTree that can be used together with the reconciliation Service. Different instances c
NodeCraft - Crafting seamless node operations for distributed systems
NodeCraft Crafting seamless node operations for distributed systems, which provides foundational traits for node identification and address resolution
Assured Confidential Execution (ACE) for RISC-V
Assured Confidential Execution (ACE) for RISC-V ACE-RISCV is an open-source project, whose goal is to deliver a confidential computing framework with
A Zenoh plug-in for ROS2 with a DDS RMW.
zplugin-ros2dds A new Zenoh bridge for ROS2. ⚠️ Work in progress... ⚠️ How to install it No version has been released yet. Therefore only nightly buil
Kuintessence - Open Source HPC Computing Orchestration System
Kuintessence is an advanced computing orchestration system designed to revolutionize HPC workload and cluster management, to empower HPC users by allowing them to concentrate on their scientific ideas rather than getting bogged down by HPC environment complications, and enhance research productivity to its fullest potential.
Precio is a Rust library that implements the Precio protocol for computing private layered histograms and sums.
Overview of Precio Precio is a Rust implementation of the protocol described in eprint.iacr.org/2021/1490. The goal of the protocol is to enable an an
The open source distributed web search engine that searches by meaning.
DawnSearch DawnSearch is an open source distributed web search engine that searches by meaning. It uses semantic search (searching on meaning), using
A lightweight distributed message queue. Like AWS SQS and RSMQ but on Postgres.
Postgres Message Queue (PGMQ) A lightweight distributed message queue. Like AWS SQS and RSMQ but on Postgres. Features Lightweight - Built with Rust a
Distributed, MVCC SQLite that runs on FoundationDB.
mvSQLite Distributed, MVCC SQLite that runs on top of FoundationDB. Documentation mvSQLite Features Releases Quick reference Try it Contributing Featu
This is a small demo of how to transform a simple single-server RocksDB service written in Rust into a distributed version using OmniPaxos.
OmniPaxos Demo This is a small demo of how to transform a simple single-server RocksDB service into a distributed version using OmniPaxos. Related res
⚛ Quantum computing crate for Rust programming language.
🦀 Quantum crab Quantum crab is a quantum computing crate for Rust programming language. use quantum_crab::{ backend::Backend, quantum_circuit
DKG using BLS12-381
DKG This library is an implementation of the distributed key generator required for blind DKG. Overview dkg-core: supports both std and no-std. When b
ThRust is a software framework for thermodynamic and probabilistic computing.
ThRust ThRust is a Rust crate that provides a framework for thermodynamic and probabilistic computing. This package currently supports the following f
A hardware-accelerated GPU terminal emulator powered by WebGPU, focusing to run in desktops, browsers, tvs and everywhere.
Rio term tl;dr: Rio is a terminal built to run everywhere, as a native desktop applications by Rust/WebGPU or even in the browser powered by WebAssemb
The fly.io distributed systems challenges solved in Rust
The fly.io distributed systems challenges solved in Rust. Live-streamed in https://youtu.be/gboGyccRVXI License Licensed under either of Apache Licens
A Platform-less, Runtime-less Actor Computing Model
CrossBus A Platform-Less, Runtime-Less Actor Computing Model Overview CrossBus is an implementation of Actor Computing Model, with the concept that Ru
Serde support for n-dimensional arrays from self-describing formats
serde-ndim Overview This crate provides a way to serialize and deserialize arrays of arbitrary dimensionality from self-described formats such as JSON
Reference application for connecting to the TAPLE DLT network.
⚠️ TAPLE is in early development and should not be used in production ⚠️ TAPLE Client TAPLE (pronounced T+ 🍎 ['tapəl]) stands for Tracking (Autonomou
A simple to use rust package to generate or parse Twitter snowflake IDs,generate time sortable 64 bits unique ids for distributed systems
A simple to use rust package to generate or parse Twitter snowflake IDs,generate time sortable 64 bits unique ids for distributed systems (inspired from twitter snowflake)
A distributed network for cloud-native services
fólkvangr A distributed network for cloud-native services About Fólkvangr started out as a way to build social networks that were secure and decentral
Nitrogen - a tool for deploying web services to AWS Nitro Enclaves
Nitrogen CLI Nitrogen is a tool for deploying web services to AWS Nitro Enclaves. Given a dockerfile and an ssh key, Nitrogen will spin up an EC2, con
A toy event store and event messaging system.
RDeeBee Follow this blog series for more details on this project. This system is inspired by Martin Kleppman's arguments that Event Sourcing system an
Distributed Vault For Your Secrets
https://meta-secret.github.io Application Design Activity Diagram graph TD User -- |split password| MSS{MetaSecret} MSS -- |split| Hash1
Scientific computing for Rhai.
About rhai-sci This crate provides some basic scientific computing utilities for the Rhai scripting language, inspired by languages like MATLAB, Octav
Non-volatile, distributed file cache backed by content-addressed storage
blobnet A low-latency file server that responds to requests for chunks of file data. This acts as a non-volatile, over-the-network content cache. Inte
BURN: Burn Unstoppable Rusty Neurons
BURN BURN: Burn Unstoppable Rusty Neurons This library aims to be a complete deep learning framework with extreme flexibility written in Rust. The goa
The rust client for CeresDB. CeresDB is a high-performance, distributed, schema-less, cloud native time-series database that can handle both time-series and analytics workloads.
The rust client for CeresDB. CeresDB is a high-performance, distributed, schema-less, cloud native time-series database that can handle both time-series and analytics workloads.
A high-performance, distributed, schema-less, cloud native time-series database
CeresDB is a high-performance, distributed, schema-less, cloud native time-series database that can handle both time-series and analytics workloads.
Habitat is open source software that creates platform-independent build artifacts and provides built-in deployment and management capabilities.
Habitat is open source software that creates platform-independent build artifacts and provides built-in deployment and management capabilities. The go
Bioyino is a distributed statsd-protocol server with carbon backend.
Bioyino The StatsD server written in Rust Description Bioyino is a distributed statsd-protocol server with carbon backend. Features all basic metric t
RISC Zero is a zero-knowledge verifiable general computing platform based on zk-STARKs and the RISC-V microarchitecture.
RISC Zero WARNING: This software is still experimental, we do not recommend it for production use (see Security section). RISC Zero is a zero-knowledg
Spacedrive is an open source cross-platform file explorer, powered by a virtual distributed filesystem written in Rust.
Spacedrive A file explorer from the future. spacedrive.com » Download for macOS · Windows · Linux · iOS · watchOS · Android ~ Links will be added once
RisingWave is a cloud-native streaming database that uses SQL as the interface language.
RisingWave is a cloud-native streaming database that uses SQL as the interface language. It is designed to reduce the complexity and cost of building real-time applications. RisingWave consumes streaming data, performs continuous queries, and updates results dynamically. As a database system, RisingWave maintains results inside its own storage and allows users to access data efficiently.
A CLI test program for HNU Cloud Computing Lab 2, built with Rust.
HTTP Server Tester This is a CLI test program for HNU Cloud Computing Lab 2. Install For most student, you don't neet to rebuild this project. We prov
A universal, distributed package manager
Cask A universal, distributed package manager. Installation | Usage | How to publish package? | Design | Contributing | Cask.toml If you are tired of:
Sorock is an experimental "so rocking" scale-out distributed object storage
Sorock is an experimental "so rocking" scale-out distributed object storage
A Computer Science Wordle variant, where all solutions are related to computing
Csdle I decided to expand a previous project I made, Rdle, which was a plain wordle clone. Recently however, I have been getting very into Wordle vari
Fast, accessible and privacy friendly AI deployment
Mithril Security - BlindAI Website | LinkedIn | Blog | Twitter | Documentation | Discord Fast, accessible and privacy friendly AI deployment 🚀 🔒 Bli
Tool for computing vanity Gnosis Safe addresses
0xdeadbeef Tool used for computing vanity Gnosis Safe addresses. This tool is currently hard-coded to only support the v1.3.0 Safe deployment: GnosisS
Gyroflow is an application that can stabilize your video by using motion data from a gyroscope and optionally an accelerometer
Gyroflow is an application that can stabilize your video by using motion data from a gyroscope and optionally an accelerometer. Modern cameras record that data internally (GoPro, Sony, Insta360 etc), and this application stabilizes the captured footage precisely by using them. It can also use gyro data from an external source (eg. from Betaflight blackbox).
This is an experiment in designing a distributed connected garden experience.
This is an experiment in designing a distributed connected garden experience. It started as an implementation of a blockchain, but has moved on to be a bit more than that. There is no proof of work like a cryptocurrency, but plays with the idea of a distributed consensus-building system.
Cap'n Proto is a type system for distributed systems
Cap'n Proto for Rust documentation blog Introduction Cap'n Proto is a type system for distributed systems. With Cap'n Proto, you describe your data an
Damavand is a quantum circuit simulator. It can run on laptops or High Performance Computing architectures, such CPU distributed architectures or multi GPU distributed architectures.
Damavand is a code that simulates quantum circuits. In order to learn more about damavand, refer to the documentation. Development status Core feature
Embedded Distributed Encrypted Database (Research).
EDED Embedded Distributed Encrypted Database. Research projects to support ESSE. WIP Distributed design features Adapt to personal distributed usecase
Raft distributed consensus algorithm implemented in Rust.
Raft Problem and Importance When building a distributed system one principal goal is often to build in fault-tolerance. That is, if one particular nod
Lightweight p2p library. Support build robust stable connection on p2p/distributed network.
Chamomile Build a robust stable connection on p2p network features Support build a robust stable connection between two peers on the p2p network. Supp
Rust implementation of the i2p client/server/router protocols
ri2p Rust implementation of the i2p client/server/router protocols Status Common Commands cargo build: Builds the ri2p binary cargo run: Runs the ri2p
Distributed, version controlled, SQL database with cryptographically verifiable storage, queries and results. Think git for postgres.
SDB - SignatureDB Distributed, version controlled, SQL database with cryptographically verifiable storage, queries and results. Think git for postgres
A linear algebra library written in Rust
rulinalg This library is no longer actively maintained The crate is currently on version 0.4.2. Read the API Documentation to learn more. Summary Ruli
Framework for large distributed pipelines
Rain Rain is an open-source distributed computational framework for processing of large-scale task-based pipelines. Rain aims to lower the entry barri
Statistical routines for ndarray
ndarray-stats This crate provides statistical methods for ndarray's ArrayBase type. Currently available routines include: order statistics (minimum, m
Machine learning crate in Rust
DeepRust - Machine learning in Rust Vision To create a deeplearning crate in rust aiming to create a great experience for ML researchers & developers
Rust library for of graph ensembles
Rust library for random graph ensembles Minimal Rust version: 1.55.0 Implements simple sampling and monte carlo (or rather markov-) steps, that can be
open source training courses about distributed database and distributed systemes
Welcome to learn Talent Plan Courses! Talent Plan is an open source training program initiated by PingCAP. It aims to create or combine some open sour
Distributed SQL database in Rust, written as a learning project
toyDB Distributed SQL database in Rust, written as a learning project. Most components are built from scratch, including: Raft-based distributed conse
a collection of well-tested, serializable CRDTs for Rust
crdts: family of thoroughly tested hybrid crdt's. A family of CRDT's supporting both State and Op based replication. what is a CRDT? CRDT's are the so
Canary - Distributed systems library for making communications through the network easier, while keeping minimalism and flexibility.
Canary Canary is a distributed systems and communications framework, focusing on minimalism, ease of use and performance. Development of Canary utiliz
AMCOS - A high-peformance parallel monte-carlo simulation for estimating the fair value of options in finance
antoons-monte-carlo-options-sim A high-peformance parallel monte-carlo simulation for estimating the fair value of options in finance. Written in Rust
Damavand is a quantum circuit simulator. It can run on laptops or High Performance Computing architectures, such CPU distributed architectures or multi GPU distributed architectures.
Damavand is a quantum circuit simulator. It can run on laptops or High Performance Computing architectures, such CPU distributed architectures or multi GPU distributed architectures.
Spartan: High-speed zkSNARKs without trusted setup
Spartan: High-speed zkSNARKs without trusted setup Spartan is a high-speed zero-knowledge proof system, a cryptographic primitive that enables a prove
A scalable, distributed, collaborative, document-graph database, for the realtime web
is the ultimate cloud database for tomorrow's applications Develop easier. Build faster. Scale quicker. What is SurrealDB? SurrealDB is an end-to-end
ChiselStore is an embeddable, distributed SQLite for Rust, powered by Little Raft.
ChiselStore ChiselStore is an embeddable, distributed SQLite for Rust, powered by Little Raft. SQLite is a fast and compact relational database manage
Zero-Trust Decentralized Package Network
Zero-Trust Decentralized Package Network Current Development Phase 📢 We are looking for your feedback! This project is currently in the "sandbox" 🏖️
A general-purpose distributed memory cache system compatible with Memcached
memcrsd memcached server implementation in Rust memcrsd is a key value store implementation in Rust. It is compatible with binary protocol of memcache
Secure and fast microVMs for serverless computing.
Our mission is to enable secure, multi-tenant, minimal-overhead execution of container and function workloads. Read more about the Firecracker Charter
PyQIR is a set of APIs for generating, parsing, and evaluating Quantum Intermediate Representation (QIR).
PyQIR PyQIR is a set of APIs for generating, parsing, and evaluating Quantum Intermediate Representation (QIR). It consists of the following component
Garage is a lightweight S3-compatible distributed object store
Garage [ Website and documentation | Binary releases | Git repository | Matrix channel ] Garage is a lightweight S3-compatible distributed object stor
End-to-end encryption and mutual authentication for distributed applications.
✨ Hands-on Introduction: Build end-to-end encrypted, mutually-authenticated, secure messaging in Rust ✨ Rust and Elixir libraries for end-to-end encry
Paxakos is a pure Rust implementation of a distributed consensus algorithm
Paxakos is a pure Rust implementation of a distributed consensus algorithm based on Leslie Lamport's Paxos. It enables distributed systems to consistently modify shared state across their network, even in the presence of failures.
Simple WIP GPGPU framework for Rust built on top of wgpu
gpgpu A simple GPU compute library based on wgpu. It is meant to be used alongside wgpu if desired. To start using gpgpu, just create a Framework inst
High performance distributed framework for training deep learning recommendation models based on PyTorch.
PERSIA (Parallel rEcommendation tRaining System with hybrId Acceleration) is developed by AI platform@Kuaishou Technology, collaborating with ETH. It
Blackmarlin is a chess engine fully written in Rust.
Blackmarlin WIP UCI Chess Engine Blackmarlin is a chess engine fully written in Rust. Make sure to compile the chess engine with cargo build --release
An End-to-End Privacy Computing Protocol on Layer 2
Eigen Network Eigen Network is an end-to-end privacy computation network for a better digital economy based on hybrid privacy computation protocols an
Raft distributed consensus for WebAssembly in Rust
WRaft: Raft in WebAssembly What is this? A toy implementation of the Raft Consensus Algorithm for WebAssembly, written in Rust. Basically, it synchron
Command line tool for computing gigantic correlation matrices
turbocor This is little program designed to compute (sparse) Pearson correlation matrices as efficiently as possible. The main ideas are thus: Pairwis
The labs of Raft consensus algorithm based on MadSim.
MadRaft The labs of Raft consensus algorithm based on MadSim. Some codes are derived from MIT 6.824 and PingCAP Talent Plan: Raft Lab. Thanks for thei
Automate device security provisioning with edge intelligence.
UNiD Automate device security provisioning with edge intelligence Features Decentralized PKI(DPKI), DIDs, DKMS, and Credential Management End-to-End E
The lightest distributed consensus library. Run your own replicated state machine! ❤️
Little Raft The lightest distributed consensus library. Run your own replicated state machine! ❤️ Installing Simply import the crate. In your Cargo.to
FS-DKR: One Round Distributed Key Rotation
FS-DKR: One Round Distributed Key Rotation Intro In this note we aim to re-purpose the Fouque-Stern Distributed Key Generation (DKG) to support a secu
Magical Automatic Deterministic Simulator for distributed systems in Rust.
MadSim Magical Automatic Deterministic Simulator for distributed systems. Deterministic simulation MadSim is a Rust async runtime similar to tokio, bu
Skytable is an extremely fast, secure and reliable real-time NoSQL database with automated snapshots and TLS
Skytable is an effort to provide the best of key/value stores, document stores and columnar databases, that is, simplicity, flexibility and queryability at scale. The name 'Skytable' exemplifies our vision to create a database that has limitless possibilities. Skytable was previously known as TerrabaseDB (and then Skybase) and is also nicknamed "STable", "Sky" and "SDB" by the community.
delicate A lightweight and distributed task scheduling platform written in rust
A lightweight and distributed task scheduling platform written in rust.
Xaynet represents an agnostic Federated Machine Learning framework to build privacy-preserving AI applications.
xaynet Xaynet: Train on the Edge with Federated Learning Want a framework that supports federated learning on the edge, in desktop browsers, integrate
A Modern Real-Time Data Processing & Analytics DBMS with Cloud-Native Architecture, written in Rust
Datafuse Modern Real-Time Data Processing & Analytics DBMS with Cloud-Native Architecture Datafuse is a Real-Time Data Processing & Analytics DBMS wit
GraphScope: A One-Stop Large-Scale Graph Computing System from Alibaba
A One-Stop Large-Scale Graph Computing System from Alibaba GraphScope is a unified distributed graph computing platform that provides a one-stop envir
Sample code for compute shader 101 training
Sample code for Compute Shader 101 This repo contains sample code to help you get started writing applications using compute shaders.
A model checker for implementing distributed systems.
A model checker for implementing distributed systems.
This is an implementation defining standard for client-side-validation
Client-side-validation Foundation Libraries This is an implementation defining standard of client-side-validation representing a set of its Foundation
Rustpad is an efficient and minimal collaborative code editor, self-hosted, no database required
Rustpad is an efficient and minimal open-source collaborative text editor based on the operational transformation algorithm
Hitbox is an asynchronous caching framework supporting multiple backends and suitable for distributed and for single-machine applications.
Hitbox is an asynchronous caching framework supporting multiple backends and suitable for distributed and for single-machine applications.
RiteRaft - A raft framework, for regular people
RiteRaft - A raft framework, for regular people This is an attempt to create a layer on top of tikv/raft-rs, that is easier to use and implement. This
Quickwit is a big data search engine.
Quickwit This repository will host Quickwit, the big data search engine developed by Quickwit Inc. We will progressively polish and opensource our cod
The new, performant, and simplified version of Holochain on Rust (sometimes called Holochain RSM for Refactored State Model)
Holochain License: This repository contains the core Holochain libraries and binaries. This is the most recent and well maintained version of Holochai
Fluvio is a high-performance distributed streaming platform that's written in Rust
Fluvio is a high-performance distributed streaming platform that's written in Rust, built to make it easy to develop real-time applications.
Rust numeric library with R, MATLAB & Python syntax
Peroxide Rust numeric library contains linear algebra, numerical analysis, statistics and machine learning tools with R, MATLAB, Python like macros. W
High-performance automatic differentiation of LLVM.
The Enzyme High-Performance Automatic Differentiator of LLVM Enzyme is a plugin that performs automatic differentiation (AD) of statically analyzable
Xaynet represents an agnostic Federated Machine Learning framework to build privacy-preserving AI applications.
xaynet Xaynet: Train on the Edge with Federated Learning Want a framework that supports federated learning on the edge, in desktop browsers, integrate