Sorock is an experimental "so rocking" scale-out distributed object storage

Akira Hayakawa

Last update: Jun 13, 2022

Related tags

Distributed systems sorock

Overview

Sorock

Documentation

Sorock is an experimental "so rocking" scale-out distributed object storage.

The name comes from Soroku Ebara, the founder of Azabu high school which is my alma mater.

Features

Containerized.
Erasure Coding for data resiliency.
ASURA instead of consistent-hashing for calculating holder nodes.
Cluster configuration is replicated by Raft for faster propagation than Gossip.
Automatic stabilization on cluster change.
Automatic failure detection by SWIM.
Automatic data rebuild on node failure.

Author

Akira Hayakawa ([email protected])

Merge together and efficiently time-sort compressed .pcap files stored in AWS S3 object storage (or locally) to stdout for pipelined processing.

Merge together and efficiently time-sort compressed .pcap files stored in AWS S3 object storage (or locally) to stdout for pipelined processing. High performance and parallel implementation for 10 Gbps playback throughput with large numbers of files (~4k).

4 Aug 19, 2022

figure out who holds the nfts that came out of a candy machine.

Candy Holders This is far from finished, but can: find tokens with a given update authority find holders of those tokens Neither the Rust or Node APIs

24 Dec 29, 2022

Damavand is a quantum circuit simulator. It can run on laptops or High Performance Computing architectures, such CPU distributed architectures or multi GPU distributed architectures.

0 Mar 29, 2022

open source training courses about distributed database and distributed systemes

Welcome to learn Talent Plan Courses! Talent Plan is an open source training program initiated by PingCAP. It aims to create or combine some open sour

8.3k Dec 30, 2022

Damavand is a quantum circuit simulator. It can run on laptops or High Performance Computing architectures, such CPU distributed architectures or multi GPU distributed architectures.

Damavand is a code that simulates quantum circuits. In order to learn more about damavand, refer to the documentation. Development status Core feature

6 Mar 29, 2022

Distributed, version controlled, SQL database with cryptographically verifiable storage, queries and results. Think git for postgres.

SDB - SignatureDB Distributed, version controlled, SQL database with cryptographically verifiable storage, queries and results. Think git for postgres

5 Apr 26, 2022

Non-volatile, distributed file cache backed by content-addressed storage

blobnet A low-latency file server that responds to requests for chunks of file data. This acts as a non-volatile, over-the-network content cache. Inte

12 Dec 31, 2022

Network Block Storage server, written in Rust. Supports pluggable and chainable underlying storage

nbd-rs Disclaimer DO NEVER USE THIS FOR PRODUCTION Do not use this for any data that you cannot afford to lose any moment. Expect data loss, corruptio

10 Sep 30, 2022

Plugin for macro-, mini-quad (quads) to save data in simple local storage using Web Storage API in WASM and local file on a native platforms.

quad-storage This is the crate to save data in persistent local storage in miniquad/macroquad environment. In WASM the data persists even if tab or br

9 Jan 4, 2023

UnlimCloud provides unlimited cloud storage for your files, utilizing Telegram as the storage solution

UnlimCloud provides unlimited cloud storage for your files, utilizing Telegram as the storage solution. Simply log in using your Telegram ID, and you are good to go.

5 Nov 27, 2023

GraphScope: A One-Stop Large-Scale Graph Computing System from Alibaba

A One-Stop Large-Scale Graph Computing System from Alibaba GraphScope is a unified distributed graph computing platform that provides a one-stop envir

2.2k Jan 1, 2023

Tells you how many years you need to wait until your subatomic xeon crystal synchronizer has doubled in plasma inversion efficiency on the Goldberg-Moleman scale or whatever.

about Tells you how many years you need to wait until your subatomic xeon crystal synchronizer has doubled in plasma inversion efficiency on the Goldb

2 Dec 3, 2021

rbdt is a python library (written in rust) for parsing robots.txt files for large scale batch processing.

rbdt 🚨 🚨 🚨 🚨 rbdt is a work in progress, currently being extracted out of another (private) project for the purpose of open sourcing and better so

0 Nov 9, 2021

Build fast, reward everyone, and scale without friction.

Scrypto Language for building DeFi apps on Radix. Terminology Package: A collection of blueprints, compiled and published as a single unit. Blueprint:

330 Dec 25, 2022

Web-Scale Blockchain for fast, secure, scalable, decentralized apps and marketplaces.

Building 1. Install rustc, cargo and rustfmt. $ curl https://sh.rustup.rs -sSf | sh $ source $HOME/.cargo/env $ rustup component add rustfmt When buil

9.8k Jan 3, 2023

Codemod - Codemod is a tool/library to assist you with large-scale codebase refactors that can be partially automated but still require human oversight and occasional intervention

Codemod - Codemod is a tool/library to assist you with large-scale codebase refactors that can be partially automated but still require human oversight and occasional intervention. Codemod was developed at Facebook and released as open source.

4k Dec 29, 2022

Thalo is an event-sourcing framework for building large scale systems

Thalo Event sourcing framework for building microservices. Overview Thalo is an event-sourcing framework for building large scale systems based on the

548 Jan 3, 2023

Cost saving K8s controller to scale down and up of resources during non-business hours

Kube-Saver Motivation Scale down cluster nodes by scaling down Deployments, StatefulSet, CronJob, Hpa during non-business hours and save $$, but if yo

5 Aug 15, 2022

Static low-bandwidth search at scale

Pagefind Pagefind is a fully static search library that aims to perform well on large sites, while using as little of your users' bandwidth as possibl

657 Dec 30, 2022

Owner

Akira Hayakawa

I am just a very good Rust programmer.

GitHub

Sorock is an experimental "so rocking" scale-out distributed object storage

Related tags

Overview

Sorock

Features

Author

You might also like...

Merge together and efficiently time-sort compressed .pcap files stored in AWS S3 object storage (or locally) to stdout for pipelined processing.

figure out who holds the nfts that came out of a candy machine.

Damavand is a quantum circuit simulator. It can run on laptops or High Performance Computing architectures, such CPU distributed architectures or multi GPU distributed architectures.

open source training courses about distributed database and distributed systemes

Damavand is a quantum circuit simulator. It can run on laptops or High Performance Computing architectures, such CPU distributed architectures or multi GPU distributed architectures.

Distributed, version controlled, SQL database with cryptographically verifiable storage, queries and results. Think git for postgres.

Non-volatile, distributed file cache backed by content-addressed storage

Network Block Storage server, written in Rust. Supports pluggable and chainable underlying storage

Plugin for macro-, mini-quad (quads) to save data in simple local storage using Web Storage API in WASM and local file on a native platforms.

UnlimCloud provides unlimited cloud storage for your files, utilizing Telegram as the storage solution

GraphScope: A One-Stop Large-Scale Graph Computing System from Alibaba

Tells you how many years you need to wait until your subatomic xeon crystal synchronizer has doubled in plasma inversion efficiency on the Goldberg-Moleman scale or whatever.

rbdt is a python library (written in rust) for parsing robots.txt files for large scale batch processing.

Build fast, reward everyone, and scale without friction.

Web-Scale Blockchain for fast, secure, scalable, decentralized apps and marketplaces.

Codemod - Codemod is a tool/library to assist you with large-scale codebase refactors that can be partially automated but still require human oversight and occasional intervention

Thalo is an event-sourcing framework for building large scale systems

Cost saving K8s controller to scale down and up of resources during non-business hours

Static low-bandwidth search at scale

Owner

Akira Hayakawa

A model checker for implementing distributed systems.

Magical Automatic Deterministic Simulator for distributed systems in Rust.

The lightest distributed consensus library. Run your own replicated state machine! ❤️

Raft distributed consensus for WebAssembly in Rust

Paxakos is a pure Rust implementation of a distributed consensus algorithm

A universal, distributed package manager

Decode SCALE bytes into custom types using a scale-info type registry and a custom Visitor impl.

Merge multiple Juniper object definitions into a single object type.

Garage is a lightweight S3-compatible distributed object store

It is a backup tool that creates backups and stores them on an object storage