115 Repositories
Rust distributed-cache Libraries
fclicache - File-based Simple CLI Cache
fclicache is a command-line utility that caches the output of resource-intensive commands, enabling faster retrieval of results when the same commands are executed repeatedly within a specified Time-to-Live (TTL) period.
The fastest memoizing and caching Python library written in Rust.
Cachebox Cachebox is a Python library (written in Rust) that provides memoizations and cache implementions with different cache replecement policies.
A Distributed SQL Database - Building the Database in the Public to Learn Database Internals
Table of Contents Overview Usage TODO MVCC in entangleDB SQL Query Execution in entangleDB entangleDB Raft Consensus Engine What I am trying to build
An expressive Rust library for interacting with a cache.
Amnesia An expressive Rust library for interacting with a Cache. Features Driver-Based Architecture: Easily switch between different caching strategie
Spider ported to Node.js
spider-rs The spider project ported to Node.js Getting Started npm i @spider-rs/spider-rs --save import { Website, pageTitle } from "@spider-rs/spider
A reconciliation service to sync a key-value map over multiple instances.
reconcile-rs Docs This crate provides a key-data map structure HRTree that can be used together with the reconciliation Service. Different instances c
Implemented reverse-engineered signature algorithm to successfully register with Apple's caching server.
View as English 项目描述 本项目通过逆向得到苹果缓存服务器的签名算法,并可以成功注册缓存服务。算法分为两种运行模式。 运行模式 直接运行(x64): 效率较高,但只支持64位CPU。已测试可运行在Windows/Linux/macOS上。 模拟器运行: 兼容性极高,支持所有CPU架构
A reliable key-value storage for modern software
Quick-KV A reliable key-value storage for modern software Features Binary Based Data-Store Serde Supported Data Types Thread Safe Links Documentation
NodeCraft - Crafting seamless node operations for distributed systems
NodeCraft Crafting seamless node operations for distributed systems, which provides foundational traits for node identification and address resolution
A CLI tool for CIs and build scripts, making file system based caching easy and correct (locking, eviction, etc.)
FS Dir Cache A CLI tool for CIs and build scripts, making file system based caching easy and correct (locking, eviction, etc.) When working on build s
A performant but not-so-accurate time and capacity based cache for Rust.
fastcache A performant but not-so-accurate time and capacity based cache for Rust. This crate provides an implementation of a time-to-live (TTL) and c
The open source distributed web search engine that searches by meaning.
DawnSearch DawnSearch is an open source distributed web search engine that searches by meaning. It uses semantic search (searching on meaning), using
A lightweight distributed message queue. Like AWS SQS and RSMQ but on Postgres.
Postgres Message Queue (PGMQ) A lightweight distributed message queue. Like AWS SQS and RSMQ but on Postgres. Features Lightweight - Built with Rust a
Leptos Query - a robust asynchronous state management library for Leptos,
Leptos Query is a robust asynchronous state management library for Leptos, providing simplified data fetching, integrated reactivity, server-side rendering support, and intelligent cache management.
A generational arena based LRU Cache implementation in 100% safe rust.
generational-lru Crate providing a 100% safe, generational arena based LRU cache implementation. use generational_lru::lrucache::{LRUCache, CacheError
SQLite-based on-disk cache for Rust.
sqlite-cache SQLite-based on-disk cache for Rust. Usage let cache = Cache::new( CacheConfig::default(), rusqlite::Connection::open_in_memory()
Distributed, MVCC SQLite that runs on FoundationDB.
mvSQLite Distributed, MVCC SQLite that runs on top of FoundationDB. Documentation mvSQLite Features Releases Quick reference Try it Contributing Featu
This is a small demo of how to transform a simple single-server RocksDB service written in Rust into a distributed version using OmniPaxos.
OmniPaxos Demo This is a small demo of how to transform a simple single-server RocksDB service into a distributed version using OmniPaxos. Related res
Fast turbo remote cache server written in Rust
Fast turbo remote cache server written in Rust. if you are using turbo and you want to have a self hosted remote cache server this is for you.
DKG using BLS12-381
DKG This library is an implementation of the distributed key generator required for blind DKG. Overview dkg-core: supports both std and no-std. When b
Run if inputs have changed, otherwise use cache
Boost Why Boost? Our planet is burning, and everywhere I look I see CI pipelines repeating work that has already been done. Tools such as TurboRepo, N
Key-value cache RESP server with support for key expirations ⌛
BADER-DB (بادِر) Key-value cache RESP server with support for key expirations ⌛ Supported Features • Getting Started • Basic Usage • Cache Eviction •
The fly.io distributed systems challenges solved in Rust
The fly.io distributed systems challenges solved in Rust. Live-streamed in https://youtu.be/gboGyccRVXI License Licensed under either of Apache Licens
Fast GraphQL CDN on Cloudflare Edge.
EdgeQL EdgeQL is a fast GraphQL CDN on Cloudflare Edge, delivering optimized GraphQL responses with low latency. Easy to use and integrate, EdgeQL lev
Reference application for connecting to the TAPLE DLT network.
⚠️ TAPLE is in early development and should not be used in production ⚠️ TAPLE Client TAPLE (pronounced T+ 🍎 ['tapəl]) stands for Tracking (Autonomou
A simple to use rust package to generate or parse Twitter snowflake IDs,generate time sortable 64 bits unique ids for distributed systems
A simple to use rust package to generate or parse Twitter snowflake IDs,generate time sortable 64 bits unique ids for distributed systems (inspired from twitter snowflake)
Multi-tenant Nix Binary Cache
Attic Attic is a self-hostable Nix Binary Cache server backed by an S3-compatible storage provider. It has support for global deduplication and garbag
A distributed network for cloud-native services
fólkvangr A distributed network for cloud-native services About Fólkvangr started out as a way to build social networks that were secure and decentral
syncmap is a fast, concurrent cache library built with a focus on performance and correctness.
syncmap syncmap syncmap is a fast, concurrent cache library syncmap is a fast, concurrent cache library built with a focus on performance and correctn
Rust type wrapper to cache hash of potentially large structures.
CachedHash For a type T, CachedHashT wraps T and implements Hash in a way that caches T's hash value. This is useful when T is expensive to hash (fo
A toy event store and event messaging system.
RDeeBee Follow this blog series for more details on this project. This system is inspired by Martin Kleppman's arguments that Event Sourcing system an
Distributed Vault For Your Secrets
https://meta-secret.github.io Application Design Activity Diagram graph TD User -- |split password| MSS{MetaSecret} MSS -- |split| Hash1
Non-volatile, distributed file cache backed by content-addressed storage
blobnet A low-latency file server that responds to requests for chunks of file data. This acts as a non-volatile, over-the-network content cache. Inte
Download pdbs from symbol servers and cache locally, parse symbol paths from env vars
symsrv This crate lets you download and cache pdb files from symbol servers, according to the rules from the _NT_SYMBOL_PATH environment variable. It
The rust client for CeresDB. CeresDB is a high-performance, distributed, schema-less, cloud native time-series database that can handle both time-series and analytics workloads.
The rust client for CeresDB. CeresDB is a high-performance, distributed, schema-less, cloud native time-series database that can handle both time-series and analytics workloads.
A high-performance, distributed, schema-less, cloud native time-series database
CeresDB is a high-performance, distributed, schema-less, cloud native time-series database that can handle both time-series and analytics workloads.
Habitat is open source software that creates platform-independent build artifacts and provides built-in deployment and management capabilities.
Habitat is open source software that creates platform-independent build artifacts and provides built-in deployment and management capabilities. The go
Bioyino is a distributed statsd-protocol server with carbon backend.
Bioyino The StatsD server written in Rust Description Bioyino is a distributed statsd-protocol server with carbon backend. Features all basic metric t
Nix binary cache implemented in rust using libnix-store
harmonia Build Whole application nix-shell --run cargo b C Library Wrapper around libnixstore nix-shell --run make Note: The makefile is only to pro
Turn your discord cache back to viewable images.
discache 🦀 Every time you view an Image in Discord, it gets saved in your cache folder as an unviewable file. Discache allows you to convert those fi
Spacedrive is an open source cross-platform file explorer, powered by a virtual distributed filesystem written in Rust.
Spacedrive A file explorer from the future. spacedrive.com » Download for macOS · Windows · Linux · iOS · watchOS · Android ~ Links will be added once
A read-only, memory-mapped cache.
mmap-cache A low-level API for a memory-mapped cache of a read-only key-value store. Design The [Cache] index is an [fst::Map], which maps from arbitr
RisingWave is a cloud-native streaming database that uses SQL as the interface language.
RisingWave is a cloud-native streaming database that uses SQL as the interface language. It is designed to reduce the complexity and cost of building real-time applications. RisingWave consumes streaming data, performs continuous queries, and updates results dynamically. As a database system, RisingWave maintains results inside its own storage and allows users to access data efficiently.
Read-optimized cache of Cardano on-chain entities
Read-optimized cache of Cardano on-chain entities Intro Scrolls is a tool for building and maintaining read-optimized collections of Cardano's on-chai
Find and clean heavy build or cache directories.
ProjClean Find and clean heavy build or cache directories. ProjClean finds directories such as node_modules(node), target(rust), build(java) and their
A set of safe Least Recently Used (LRU) map/cache types for Rust
LruMap A set of safe Least-Recently-Used (LRU) cache types aimed at providing flexible map-like structures that automatically evict the least recently
ConstDB - an in-memory cache store which aims at master-master replications
A redis-like cache store that implements CRDTs and active-active replications.
A universal, distributed package manager
Cask A universal, distributed package manager. Installation | Usage | How to publish package? | Design | Contributing | Cask.toml If you are tired of:
Sorock is an experimental "so rocking" scale-out distributed object storage
Sorock is an experimental "so rocking" scale-out distributed object storage
This is an experiment in designing a distributed connected garden experience.
This is an experiment in designing a distributed connected garden experience. It started as an implementation of a blockchain, but has moved on to be a bit more than that. There is no proof of work like a cryptocurrency, but plays with the idea of a distributed consensus-building system.
A lightweight key-value cache system developed for experimental purposes
A lightweight key-value cache system developed for experimental purposes. It can also include distributed systems setup if I can.
Cap'n Proto is a type system for distributed systems
Cap'n Proto for Rust documentation blog Introduction Cap'n Proto is a type system for distributed systems. With Cap'n Proto, you describe your data an
Damavand is a quantum circuit simulator. It can run on laptops or High Performance Computing architectures, such CPU distributed architectures or multi GPU distributed architectures.
Damavand is a code that simulates quantum circuits. In order to learn more about damavand, refer to the documentation. Development status Core feature
Embedded Distributed Encrypted Database (Research).
EDED Embedded Distributed Encrypted Database. Research projects to support ESSE. WIP Distributed design features Adapt to personal distributed usecase
Raft distributed consensus algorithm implemented in Rust.
Raft Problem and Importance When building a distributed system one principal goal is often to build in fault-tolerance. That is, if one particular nod
Lightweight p2p library. Support build robust stable connection on p2p/distributed network.
Chamomile Build a robust stable connection on p2p network features Support build a robust stable connection between two peers on the p2p network. Supp
Rust implementation of the i2p client/server/router protocols
ri2p Rust implementation of the i2p client/server/router protocols Status Common Commands cargo build: Builds the ri2p binary cargo run: Runs the ri2p
Distributed, version controlled, SQL database with cryptographically verifiable storage, queries and results. Think git for postgres.
SDB - SignatureDB Distributed, version controlled, SQL database with cryptographically verifiable storage, queries and results. Think git for postgres
Framework for large distributed pipelines
Rain Rain is an open-source distributed computational framework for processing of large-scale task-based pipelines. Rain aims to lower the entry barri
open source training courses about distributed database and distributed systemes
Welcome to learn Talent Plan Courses! Talent Plan is an open source training program initiated by PingCAP. It aims to create or combine some open sour
Distributed SQL database in Rust, written as a learning project
toyDB Distributed SQL database in Rust, written as a learning project. Most components are built from scratch, including: Raft-based distributed conse
a collection of well-tested, serializable CRDTs for Rust
crdts: family of thoroughly tested hybrid crdt's. A family of CRDT's supporting both State and Op based replication. what is a CRDT? CRDT's are the so
Canary - Distributed systems library for making communications through the network easier, while keeping minimalism and flexibility.
Canary Canary is a distributed systems and communications framework, focusing on minimalism, ease of use and performance. Development of Canary utiliz
Damavand is a quantum circuit simulator. It can run on laptops or High Performance Computing architectures, such CPU distributed architectures or multi GPU distributed architectures.
Damavand is a quantum circuit simulator. It can run on laptops or High Performance Computing architectures, such CPU distributed architectures or multi GPU distributed architectures.
A scalable, distributed, collaborative, document-graph database, for the realtime web
is the ultimate cloud database for tomorrow's applications Develop easier. Build faster. Scale quicker. What is SurrealDB? SurrealDB is an end-to-end
ChiselStore is an embeddable, distributed SQLite for Rust, powered by Little Raft.
ChiselStore ChiselStore is an embeddable, distributed SQLite for Rust, powered by Little Raft. SQLite is a fast and compact relational database manage
Zero-Trust Decentralized Package Network
Zero-Trust Decentralized Package Network Current Development Phase 📢 We are looking for your feedback! This project is currently in the "sandbox" 🏖️
A general-purpose distributed memory cache system compatible with Memcached
memcrsd memcached server implementation in Rust memcrsd is a key value store implementation in Rust. It is compatible with binary protocol of memcache
Stretto is a Rust implementation for ristretto. A high performance memory-bound Rust cache.
Stretto is a Rust implementation for ristretto. A high performance memory-bound Rust cache.
Garage is a lightweight S3-compatible distributed object store
Garage [ Website and documentation | Binary releases | Git repository | Matrix channel ] Garage is a lightweight S3-compatible distributed object stor
End-to-end encryption and mutual authentication for distributed applications.
✨ Hands-on Introduction: Build end-to-end encrypted, mutually-authenticated, secure messaging in Rust ✨ Rust and Elixir libraries for end-to-end encry
Paxakos is a pure Rust implementation of a distributed consensus algorithm
Paxakos is a pure Rust implementation of a distributed consensus algorithm based on Leslie Lamport's Paxos. It enables distributed systems to consistently modify shared state across their network, even in the presence of failures.
High performance distributed framework for training deep learning recommendation models based on PyTorch.
PERSIA (Parallel rEcommendation tRaining System with hybrId Acceleration) is developed by AI platform@Kuaishou Technology, collaborating with ETH. It
Raft distributed consensus for WebAssembly in Rust
WRaft: Raft in WebAssembly What is this? A toy implementation of the Raft Consensus Algorithm for WebAssembly, written in Rust. Basically, it synchron
Key-Value based in-memory cache library which supports Custom Expiration Policies
Endorphin Key-Value based in-memory cache library which supports Custom Expiration Policies with standard HashMap, HashSet interface. use endorphin::H
This plugin provides an interface for storing unencrypted values on the application cache folder.
Tauri Plugin Store This plugin provides an interface for storing unencrypted values on the application cache folder. Architecture This repo shape migh
Scalable and encrypted embedded database with 3-tier caching
Infinitree is a versioned, embedded database that uses uniform, encrypted blobs to store data.
An object-relational in-memory cache, supports queries with an SQL-like query language.
qlcache An object-relational in-memory cache, supports queries with an SQL-like query language. Warning This is a rather low-level library, and only p
The labs of Raft consensus algorithm based on MadSim.
MadRaft The labs of Raft consensus algorithm based on MadSim. Some codes are derived from MIT 6.824 and PingCAP Talent Plan: Raft Lab. Thanks for thei
A native stateless cache implementation.
fBNC fBNC, Blockchain Native Cache. A native stateless storage library for block chain. Its value is to improve the stability and security of online s
This is a Rust implementation for popular caches (support no_std).
Caches This is a Rust implementation for popular caches (support no_std). See Introduction, Installation and Usages for more details. English | 简体中文 I
This is a Rust implementation for HashiCorp's golang-lru. This crate contains three LRU based cache, LRUCache, TwoQueueCache and AdaptiveCache.
This is a Rust implementation for HashiCorp's golang-lru. This crate contains three LRU based cache, LRUCache, TwoQueueCache and AdaptiveCache.
The lightest distributed consensus library. Run your own replicated state machine! ❤️
Little Raft The lightest distributed consensus library. Run your own replicated state machine! ❤️ Installing Simply import the crate. In your Cargo.to
FS-DKR: One Round Distributed Key Rotation
FS-DKR: One Round Distributed Key Rotation Intro In this note we aim to re-purpose the Fouque-Stern Distributed Key Generation (DKG) to support a secu
A CLI for extracting libraries from Apple's dyld shared cache file
dyld-shared-cache-extractor As of macOS Big Sur, instead of shipping the system libraries with macOS, Apple ships a generated cache of all built in dy
Magical Automatic Deterministic Simulator for distributed systems in Rust.
MadSim Magical Automatic Deterministic Simulator for distributed systems. Deterministic simulation MadSim is a Rust async runtime similar to tokio, bu
Skytable is an extremely fast, secure and reliable real-time NoSQL database with automated snapshots and TLS
Skytable is an effort to provide the best of key/value stores, document stores and columnar databases, that is, simplicity, flexibility and queryability at scale. The name 'Skytable' exemplifies our vision to create a database that has limitless possibilities. Skytable was previously known as TerrabaseDB (and then Skybase) and is also nicknamed "STable", "Sky" and "SDB" by the community.
delicate A lightweight and distributed task scheduling platform written in rust
A lightweight and distributed task scheduling platform written in rust.
Xaynet represents an agnostic Federated Machine Learning framework to build privacy-preserving AI applications.
xaynet Xaynet: Train on the Edge with Federated Learning Want a framework that supports federated learning on the edge, in desktop browsers, integrate
A Modern Real-Time Data Processing & Analytics DBMS with Cloud-Native Architecture, written in Rust
Datafuse Modern Real-Time Data Processing & Analytics DBMS with Cloud-Native Architecture Datafuse is a Real-Time Data Processing & Analytics DBMS wit
A model checker for implementing distributed systems.
A model checker for implementing distributed systems.
This is an implementation defining standard for client-side-validation
Client-side-validation Foundation Libraries This is an implementation defining standard of client-side-validation representing a set of its Foundation
Thread Safe Cache with async loader functions based on tokio-rs
cache-loader-async crates.io The goal of this crate is to provide a thread-safe and easy way to access any data structure which might is stored in a d
Rustpad is an efficient and minimal collaborative code editor, self-hosted, no database required
Rustpad is an efficient and minimal open-source collaborative text editor based on the operational transformation algorithm
Hitbox is an asynchronous caching framework supporting multiple backends and suitable for distributed and for single-machine applications.
Hitbox is an asynchronous caching framework supporting multiple backends and suitable for distributed and for single-machine applications.
RiteRaft - A raft framework, for regular people
RiteRaft - A raft framework, for regular people This is an attempt to create a layer on top of tikv/raft-rs, that is easier to use and implement. This
Quickwit is a big data search engine.
Quickwit This repository will host Quickwit, the big data search engine developed by Quickwit Inc. We will progressively polish and opensource our cod
The new, performant, and simplified version of Holochain on Rust (sometimes called Holochain RSM for Refactored State Model)
Holochain License: This repository contains the core Holochain libraries and binaries. This is the most recent and well maintained version of Holochai
Fluvio is a high-performance distributed streaming platform that's written in Rust
Fluvio is a high-performance distributed streaming platform that's written in Rust, built to make it easy to develop real-time applications.
Xaynet represents an agnostic Federated Machine Learning framework to build privacy-preserving AI applications.
xaynet Xaynet: Train on the Edge with Federated Learning Want a framework that supports federated learning on the edge, in desktop browsers, integrate