166 Repositories
Rust cloud-storage-services Libraries
An LSM storage engine designed to significantly reduce I/O amplification written in safe rust (Under active development)
VelarixDB is an LSM-based storage engine designed to significantly reduce IO amplification, resulting in better performance and durability for storage
Kubernetes operator for declaratively deploying wasmCloud applications (via wadm) and hosts on Kubernetes.
wasmcloud-operator An operator for managing a set of wasmCloud hosts running on Kubernetes and manage wasmCloud applications using wadm. The goal is t
Cloud Native Buildpack that builds an OCI image with Ollama and a large language model.
Ollama Cloud Native Buildpack This buildpack builds an OCI image with Ollama and a large language model. Configure your model by an Ollama Modelfile o
An extendable system made up of autonomous execution services known as nodes organized in a tree of processes. Inspired by Godot!
NodeTree NodeTree is a framework to create large scalable programs and games through a tree of processes. Each process is fully autonomous and is capa
An automated CLI tool that optimizes gas usage in Solidity smart contracts, focusing on storage and function call efficiency.
Solidity-Gas-Optimizoor An high performance automated CLI tool that optimizes gas usage in Solidity smart contracts, focusing on storage and function
Cloud-optimized GeoTIFF ... Parallel I/O 🦀
cog3pio Cloud-optimized GeoTIFF ... Parallel I/O Yet another attempt at creating a GeoTIFF reader, in Rust, with Python bindings. Installation Rust ca
UnlimCloud provides unlimited cloud storage for your files, utilizing Telegram as the storage solution
UnlimCloud provides unlimited cloud storage for your files, utilizing Telegram as the storage solution. Simply log in using your Telegram ID, and you are good to go.
Hyperswitch Card Vault is an open-source sensitive information storage system built on Rust.
Tartarus - Rust Locker Overview The Hyperswitch Card Vault (Tartarus) is a highly performant and a secure vault to save sensitive data such as payment
A reconciliation service to sync a key-value map over multiple instances.
reconcile-rs Docs This crate provides a key-data map structure HRTree that can be used together with the reconciliation Service. Different instances c
HTTP client/libcurl TUI front end in Rust, with request + key storage
Rust TUI HTTP Client with API Key Management This project is still in active development and although it is useable, there may still be bugs and signi
A file server that supports static serving, uploading, searching, accessing control, webdav...
Dufs Dufs is a distinctive utility file server that supports static serving, uploading, searching, accessing control, webdav... Features Serve static
A reliable key-value storage for modern software
Quick-KV A reliable key-value storage for modern software Features Binary Based Data-Store Serde Supported Data Types Thread Safe Links Documentation
RocksDB-based queue with python bindings
RocksQ An inproc RocksDB-based queue with Python bindings. It is implemented in Rust. Features: max capacity limit in number of elements; size calcula
Manas project aims to create a modular framework and ecosystem to create robust storage servers adhering to Solid protocol in rust.
मनस् | Manas Solid is a web native protocol to enable interoperable, read-write, collaborative, and decentralized web, truer to web's original vision.
A fast, simple TUI for interacting with systemd services and their logs
systemctl-tui A fast, simple TUI for interacting with systemd services and their logs. systemctl-tui can quickly browse service status and logs, and s
Tool and framework for securely reading untrusted USB mass storage devices.
usbsas is a free and open source (GPLv3) tool and framework for securely reading untrusted USB mass storage devices. Description Following the concept
Narrowlink securely connects devices and services together, even when both nodes are behind separate NAT
Narrowlink Narrowlink is a self-hosted platform that allows you to establish secure remote connections between devices within a network that may be hi
A standalone yjs server with persistence to blob storage.
y-sweet: a Yjs server with persistence and auth y-sweet is an open-source server for building realtime applications on top of the Yjs CRDT library. Fe
Example app & project structure for Golem Cloud
Synopsis This project serves as an example/template for building an application using WebAssembly Component Model (and in this case, an app for Ziverg
A high-performance storage engine for modern hardware and platforms.
PhotonDB A high-performance storage engine for modern hardware and platforms. PhotonDB is designed from scratch to leverage the power of modern multi-
🦀Rust + Large Language Models - Make AI Services Freely and Easily. Inspired by LangChain
llmchain: Modern Data Transformations with LLM 🦀 + Large Language Models, inspired by LangChain. Features Models: LLMs & Chat Models & Embedding Mode
Rust libraries for Bluesky's AT Protocol services. NOT STABLE (yet)
ATrium ATrium is a collection of Rust libraries designed to work with the AT Protocol, providing a versatile and coherent ecosystem for developers. Th
A tiny embedded database built in Rust.
TinyBase TinyBase is an in-memory database built with Rust, based on the sled embedded key-value store. It supports indexing and constraints, allowing
A library-first, lightweight, high-performance, cloud-native supported API gateway🪐 by RUST
Preview version, will not guarantee the stability of the API! Do NOT use in production environment! A library-first, lightweight, high-performance, cl
A version control system implemented from scratch in Rust.
Version Control An experiment to write a version control system from scratch in Rust. CLI Usage Usage: revtool COMMAND Commands: init initia
dbt Cloud™️ infrastructure-as-code that is friendly to analysts
dbterra dbt Cloud ™️ infrastructure-as-code that is friendly to analysts, bizops, etc Motivation While there are Terraform ™️ plugins that can be used
Superviseur - A simple process supervisor for UNIX-like systems
A simple process supervisor for UNIX-like systems. Currently supports non-containerized services. Containerized services and wasm services will be supported in the future.
SQL database to read and write "discord"
GlueSQL Discord Storage After discussing how CI testing will be managed, we plan to move it upstream. Precautions for use discord ToS https://discord.
A simple local storage media library manager.
OFFFLIX A simple application to auto manage series on your local storage. Features Resume watching Play next episode Auto increment season Play random
Keep a Hetzner Cloud firewall up to date with your dynamic public IP address.
hcloud-firewall-controller hcloud-firewall-controller determines the current public IP and creates or updates a Hetzner Cloud firewall with this IP. S
ISG lets you use YouTube as cloud storage for ANY files, not just video
I was working on this instead of my finals, hope you appreciate it. I'll add all relevant executables when I can Infinite-Storage-Glitch AKA ISG (writ
Mirroring remote repositories to s3 storage, with atomic updates and periodic garbage collection.
rsync-sjtug WIP: This project is still under development, and is not ready for production use. rsync-sjtug is an open-source project designed to provi
store virtually unlimited, large files on discord by splitting them into small chunks
Discord Drive This repo hold an MVP implementation of an concept to store data on discord by dividing them into chunks of 7MB each, which are then upl
A distributed network for cloud-native services
fólkvangr A distributed network for cloud-native services About Fólkvangr started out as a way to build social networks that were secure and decentral
This repo is a sample video search app using AWS services.
Video Search This repo is a sample video search app using AWS services. You can check the demo on this link. Features Transcribing Video and generate
Koofr Vault is an open-source, client-side encrypted folder for your Koofr cloud storage offering an extra layer of security for your most sensitive files.
Koofr Vault https://vault.koofr.net Koofr Vault is an open-source, client-side encrypted folder for your Koofr cloud storage offering an extra layer o
A tutorial of building an LSM-Tree storage engine in a week! (WIP)
LSM in a Week Build a simple key-value storage engine in a week! Tutorial The tutorial is available at https://skyzh.github.io/mini-lsm. You can use t
Rust library to generate word cloud images from text and images !
wordcloud-rs A Rust library to generate word-clouds from text and images! Example Code use std::collections::HashMap; use std::fs; use lazy_static::la
Nitrogen - a tool for deploying web services to AWS Nitro Enclaves
Nitrogen CLI Nitrogen is a tool for deploying web services to AWS Nitro Enclaves. Given a dockerfile and an ssh key, Nitrogen will spin up an EC2, con
A simple key-value store with a log-structured, append-only storage architecture where data is encrypted with AES GCM.
akvdb A simple key-value store with a log-structured, append-only storage architecture where data is encrypted with AES GCM. Modified from the actionk
OSINT from your favorite services in a friendly terminal user interface
osintui Open Source Intelligence Terminal User Interface Report Bug · Request Feature Installation First, install Rust (using the recommended rustup i
An apocalypse-resistant data storage format for the truly paranoid.
Carbonado An apocalypse-resistant data storage format for the truly paranoid. Designed to keep encrypted, durable, compressed, provably replicated con
Cloud Native high performance security and privacy SQL proxy.
Fern proxy With the advent of Cloud Native applications, architecture patterns evolved and emerged to take advantage of cloud computing, and build mor
Connects to Woodpecker CI and dynamically creates an agent in the cloud.
Picus Picus connects to a Woodpecker CI server and creates an agent in the cloud when there are pending jobs. The agent will be shutdown when there ar
Rust API Client for ImageKit.io a file storage and image processing service
Rust API Client for ImageKit.io a file storage and image processing service Usage You must retrieve your Public and Private Keys from the ImageKit Dev
Generate rust command line executables from gRPC protobuf services.
Rust template repository. An opinionated starting point for rust projects such as systemd services command line tools client programs server programs
A simple command line program to upload file or directory to web3.storage with optional encryption and compression
w3s-cli A simple command line program to upload file or directory to web3.storage with optional encryption and compression. Features Uploads single fi
Project Masterpass is a deterministic databaseless key management algorithm, aimed to help those who cannot protect their encryption keys in storage
Project Masterpass (working title) Attention! This project is still under heavy development, and SHOULD NOT be used in practice, as the algorithms cou
Simple utility to backup/sync data between devices to the cloud
RSink Simple utility to backup/sync data between devices to the cloud Features 🚀 Blazingly Fast ⛽ Lightweight 🛟 Cross-platform, runs everywhere 📁 S
Databento Binary Encoding (DBZ) - Fast message encoding and storage format for market data
dbz A library (dbz-lib) and CLI tool (dbz-cli) for working with Databento Binary Encoding (DBZ) files. Python bindings for dbz-lib are provided in the
Demo: Connect Phala's Fat Contract to external storage services, both centralized (Amazon s3) and decentralized .
This demo shows how to connect Phala's Fat Contract to external storage services, both centralized (Amazon s3) and decentralized (Arweave/Filecoin thr
Cloud native log storage and management for Kubernetes, containerised workloads
Live Demo | Website | API Workspace on Postman Parseable is an open source, cloud native, log storage and management platform. Parseable helps you ing
Replicated storage docker plugin.
Fractal Docker Plugin This plugin handles the creation and deletion of docker volumes backed by copy-on-write filesystems (BTRFS currently), regular s
Storage metadata service.
Storage API This projects hosts the storage metadata API, a backend component which hosts metadata for storage snapshots, the actual data is housed in
Non-volatile, distributed file cache backed by content-addressed storage
blobnet A low-latency file server that responds to requests for chunks of file data. This acts as a non-volatile, over-the-network content cache. Inte
⚡Rust Serverless Framework
Zapp Rust Serverless Framework The Zapp project was launched with the goal of reducing software development, operation and maintenance costs. Build Se
Rust Shop is a fake cloud-based software company that you can fork.
RustShop RustShop is an attempt at building a template and utilities to help quickly set up and manage a production grade cloud-based system. The core
A mini kv database demo that using simplified bitcask storage model with rust implementation
A mini kv database demo that using simplified bitcask storage model with rust implementation.
The rust client for CeresDB. CeresDB is a high-performance, distributed, schema-less, cloud native time-series database that can handle both time-series and analytics workloads.
The rust client for CeresDB. CeresDB is a high-performance, distributed, schema-less, cloud native time-series database that can handle both time-series and analytics workloads.
OBKV Table Client is Rust Library that can be used to access table data from OceanBase storage layer.
OBKV Table Client is Rust Library that can be used to access table data from OceanBase storage layer. Its access method is different from JDBC, it skips the SQL parsing layer, so it has significant performance advantage.
Dufs is a distinctive utility file server that supports static serving, uploading, searching, accessing control, webdav...
Dufs (Old Name: Duf) Dufs is a distinctive utility file server that supports static serving, uploading, searching, accessing control, webdav... Featur
Seed your development database with real data ⚡️
Seed Your Development Database With Real Data ⚡️ Replibyte is a blazingly fast tool to seed your databases with your production data while keeping sen
By mirroring traffic to and from your machine, mirrord surrounds your local service with a mirror image of its cloud environment.
mirrord lets you easily mirror traffic from your Kubernetes cluster to your development environment. It comes as both Visual Studio Code extension and
A high-performance, distributed, schema-less, cloud native time-series database
CeresDB is a high-performance, distributed, schema-less, cloud native time-series database that can handle both time-series and analytics workloads.
Provide CRUD CLI for Moco Activities with Jira Cloud Sync Option for faster time tracking.
Moco CLI Provide CRUD CLI for Moco Activities with Jira Cloud Sync Option for faster time tracking. Available commands Login Jira Must be called befor
A HashMap/Vector hybrid: efficient, ordered key-value data storage in Rust.
hashvec A HashVec is a hash map / dictionary whose key-value pairs are stored (and can be iterated over) in a fixed order, by default the order in whi
High concurrency, RealTime, In-memory storage inspired by erlang mnesia
DarkBird is a Document oriented, high concurrency in-memory Storage, also persist data to disk to avoid loss any data The darkbird provides the follow
Plugin for macro-, mini-quad (quads) to save data in simple local storage using Web Storage API in WASM and local file on a native platforms.
quad-storage This is the crate to save data in persistent local storage in miniquad/macroquad environment. In WASM the data persists even if tab or br
📊 Collect cloud usage data, so that it can be combined with impact data of Boavizta API.
cloud-scanner Collect aws cloud usage data, so that it can be combined with impact data of Boavizta API. ⚠ Very early Work in progress ! At the moment
A small CLI tool to query ArcGIS REST API services, implemented in Rust. The server response is returned as pretty JSON.
A small CLI tool to query ArcGIS REST API services, implemented in Rust. The server response is returned as pretty JSON.
A template for creating services in Rust using Axum and Prisma.
A template for creating services in Rust using Axum and Prisma. This uses the super cool Prisma Rust Client.
Quickwit - the next-gen search & analytics engine built for logs
Quickwit is the next-gen search & analytics engine built for logs. It is a highly reliable & cost-efficient alternative to Elasticsearch.
An open source desktop wallet for nano and banano with end-to-end encrypted, on chain messaging using the dagchat protocol.
An open source wallet with end-to-end encrypted, on chain messaging for nano and banano using the dagchat protocol.
RisingWave is a cloud-native streaming database that uses SQL as the interface language.
RisingWave is a cloud-native streaming database that uses SQL as the interface language. It is designed to reduce the complexity and cost of building real-time applications. RisingWave consumes streaming data, performs continuous queries, and updates results dynamically. As a database system, RisingWave maintains results inside its own storage and allows users to access data efficiently.
Replibyte - a powerful tool to seed your databases
Seed Your Development Database With Real Data ⚡️ Replibyte is a powerful tool to seed your databases with real data and other cool features 🔥 Feature
A CLI test program for HNU Cloud Computing Lab 2, built with Rust.
HTTP Server Tester This is a CLI test program for HNU Cloud Computing Lab 2. Install For most student, you don't neet to rebuild this project. We prov
Off-chain services for Gnosis Protocol v2
Cow Protocol Services This repository contains backend code for Cow Protocol Services written in Rust. Order Book The orderbook crate provides the htt
Sorock is an experimental "so rocking" scale-out distributed object storage
Sorock is an experimental "so rocking" scale-out distributed object storage
Polydrive an experimental open source alternative to Google Drive
Polydrive is an experimental open source alternative to Google Drive. It allows users to synchronize their files on multiple devices.
Attribute-Level Caching in Heterogeneous In-Memory DBMS
Alchemy Attribute-Level Caching in Heterogeneous In-Memory DBMS Alchemy is a DRAM-PM hybrid database engine built from scratch to achieve high perform
Services Info Register/KeepAlive/Publish/Subscribe. Based on etcd-rs, tokio
Services Info Register/KeepAlive/Publish/Subscribe. Based on etcd-rs, tokio
Proxmox Backup Server and Client
Build & Release Notes rustup Toolchain We normally want to build with the rustc Debian package. To do that you can set the following rustup configurat
Cloud-Based Microservice Performance Profiling Tool
Revelio Systems Revelio Systems is a student startup sponsored by UT Austin's Inventors Program in partnership with Trend Micro. Team: Tejas Saboo, So
Open Data Access Layer that connect the whole world together
OpenDAL Open Data Access Layer that connect the whole world together. Status OpenDAL is in alpha stage and has been early adopted by databend. Welcome
A pure-Rust library to interact with systemd DBus services
A pure-Rust library to interact with systemd DBus services
Databend aimed to be an open source elastic and reliable serverless data warehouse,
An elastic and reliable Serverless Data Warehouse, offers Blazing Fast Query and combines Elasticity, Simplicity, Low cost of the Cloud, built to make the Data Cloud easy
Appendable and iterable key/list storage, backed by S3, written in rust
klstore Appendable and iterable key/list storage, backed by S3. General Overview Per key, a single writer appends to underlying storage, enabling many
A lightweight key-value cache system developed for experimental purposes
A lightweight key-value cache system developed for experimental purposes. It can also include distributed systems setup if I can.
SQLite compiled to WASM with pluggable data storage
wasm-sqlite SQLite compiled to WASM with pluggable data storage. Useful to save SQLite in e.g. Cloudflare Durable Objects (example: https://github.com
Rust Verbio SpeechCenter Client
The CLI client allows you to launch a single file to the server. It also allows you to use either a grammar or a language model.
Adds a uf2 header Microsofts HID Flashing Format (UF2) for copying over to UF2 bootloader mass storage devices
uf2conv Adds a uf2 header Microsofts HID Flashing Format (UF2) for copying over to UF2 bootloader mass storage devices. UF2 is factory programmed exte
Single File Assets is a file storage format for images
SFA (Rust) Single File Assets is a file storage format for images. The packed images are not guaranteed to be of same format because the format while
This repo contains crates that are used to create the micro services and keep shared code in a common place.
MyEmma Helper Crates This repo contains crates that can are reused over different services. These crate are used in projects at MyEmma. But these crat
An event replay tool for the Trento storage backend.
photofinish - a little, handy tool to replay events This tiny CLI tool aims to fulfill the need to replay some events and get fixtures. Photofinish re
The Stacks 2.0 blockchain implementation
Stacks 2.0 Reference implementation of the Stacks blockchain in Rust. Stacks 2.0 is a layer-1 blockchain that connects to Bitcoin for security and ena
Distributed, version controlled, SQL database with cryptographically verifiable storage, queries and results. Think git for postgres.
SDB - SignatureDB Distributed, version controlled, SQL database with cryptographically verifiable storage, queries and results. Think git for postgres
Routing - specialised storage DHT
PLEASE NOTE THAT THIS REPOSITORY HAS NOW BEEN ARCHIVED All routing development is now via the safe_network repository sn_routing sn_routing - a specia
Provides multiple-dtype columner storage, known as DataFrame in pandas/R
brassfibre Provides multiple-dtype columner storage, known as DataFrame in pandas/R. Series Single-dtype 1-dimentional vector with label (index). Crea
A collection of lower-level libraries for composable network services.
Actix Net A collection of lower-level libraries for composable network services. Example See actix-server/examples and actix-tls/examples for some bas
LibreAuth is a collection of tools for user authentication.
LibreAuth is a collection of tools for user authentication. Features Password / passphrase authentication no character-set limitation reason