463 Repositories
Rust data-flow-analysis Libraries
An EVM low-level language that gives full control over the control flow of the smart contract.
Meplang - An EVM low-level language Meplang is a low-level programming language that produces EVM bytecode. It is designed for developers who need ful
RusQTTbom takes weather data from the Bureau of Meteorology (BOM) and publishes that data via MQTT messages.
RusQTTbom RusQTTbom collects weather data from the Bureau of Meterology (BOM) then publishes said data locally via MQTT messages. BOM weather data is
Data analysis infrastructure for the Neo N3 blockchain.
Shrike Shrike is a set of tools built for the purpose of Neo blockchain data analysis. The infrastructure comprises three components: Indexer - Synchr
Xbox live authentication flow for Minecraft with Rust.
MC Auth Xbox live authentication flow for Minecraft in Rust. Why? In order to create tools for Minecraft based on rust that implement the user profile
Command-line tool to convert Apple HealthKit data to a SQLite database.
healthkit-to-sqlite Command-line tool to convert Apple HealthKit data to a SQLite database. Getting Started Open the Health app on your iOS device. Cl
Finds imports that could be exploited, still requires manual analysis.
drv-vuln-scanner Vulnerable driver scanning tool for win64, put drivers to scan in drv/. Finds imports that could be exploited, still requires manual
A compact generational arena data structure for Rust.
Compact Generational Arena This crate provides ArenaT, a contiguous growable container which assigns and returns IDs to values when they are added t
Experimenting with Rust's fundamental data model
ferrilab Redefining the Rust fundamental data model bitvec funty radium Introduction The ferrilab project is a collection of crates that provide more
Library and proc macro to analyze memory usage of data structures in rust.
Allocative: memory profiler for Rust This crate implements a lightweight memory profiler which allows object traversal and memory size introspection.
Inspect and recreate in-memory data structures
YClass A program that allows you to inspect and recreate data structures of other processes. Installation To compile YClass you will need Rust. git cl
Code examples, data structures, and links from my book, Rust Atomics and Locks.
This repository contains the code examples, data structures, and links from Rust Atomics and Locks. The examples from chapters 1, 2, 3, and 8 can be f
Viterbi-based accelerated tokenizer (Python wrapper)
🐍 python-vibrato 🎤 Vibrato is a fast implementation of tokenization (or morphological analysis) based on the Viterbi algorithm. This is a Python wra
Bam Error Stats Tool (best): analysis of error types in aligned reads.
best Bam Error Stats Tool (best): analysis of error types in aligned reads. best is used to assess the quality of reads after aligning them to a refer
When your network-sense tingles 🚨
HTTP Sense HTTP Sense is a reverse proxy and network monitoring tool that provides comprehensive network monitoring for your backend servers and micro
Stdto provides a set of functional traits for conversion between various data representations.
Stdto stdto provides a set of functional traits for conversion between various data representations. | Examples | Docs | Latest Note | stdto = "0.13.0
A fast static code analyzer & language server for Python
pylyzer ⚡ pylyzer is a static code analyzer / language server for Python written in Rust. Installation cargo (rust package manager) cargo install pyly
simple and powerful IP architecture in Rust.
ipzone Ipzone provides a simple and powerful IP architecture to Rust. | Examples | Docs | Latest Note | ipzone = "0.4.0" Examples use ipzone::prelude:
Python+Rust implementation of the Probabilistic Principal Component Analysis model
Probabilistic Principal Component Analysis (PPCA) model This project implements a PPCA model implemented in Rust for Python using pyO3 and maturin. In
Pure rust library for reading / writing DNG files providing access to the raw data in a zero-copy friendly way.
DNG-rs A pure rust library for reading / writing DNG files providing access to the raw data in a zero-copy friendly way. Also containing code for re
Captures packets and streams them to other devices. Built for home network analysis and A&D CTFs.
🍩 shiny-donut shiny-donut is a packet capture app that supports streaming packets from a remote system to another device. The main use for this is to
🎄 My solutions to Advent of Code 2022.
🎄 advent-of-code-2022 Overview This repository contains my solutions to Advent of Code 2022. I decided to take this year as an opportunity to learn R
Displaying data for the Soroban Futurenet.
Soroban Fiddle https://leighmcculloch.github.io/soroban-fiddle Web frontend-only application that displays data on the Soroban Futurenet network. Feat
A simple key-value store with a log-structured, append-only storage architecture where data is encrypted with AES GCM.
akvdb A simple key-value store with a log-structured, append-only storage architecture where data is encrypted with AES GCM. Modified from the actionk
A modern high-performance open source file analysis library for automating localization tasks
🧛 Filecount Filecount is a modern high-performance open source file analysis library for automating localization tasks. It enables you to add file an
A fast and robust MLOps tool for managing data and pipelines
xvc A Fast and Robust MLOps Swiss-Army Knife in Rust ⌛ When to use xvc? Machine Learning Engineers: When you manage large quantities of unstructured d
🔀 Rusty flow graph processing library
flowing flowing is a flow graph processing library written in Rust. It shall serve as a general-purpose building block for all kinds of dataflow progr
OSINT from your favorite services in a friendly terminal user interface
osintui Open Source Intelligence Terminal User Interface Report Bug · Request Feature Installation First, install Rust (using the recommended rustup i
Quickly find all blackhole directories with a huge amount of filesystem entries in a flat structure
findlargedir About Findlargedir is a tool specifically written to help quickly identify "black hole" directories on an any filesystem having more than
Your one stop CLI for ONNX model analysis.
Your one stop CLI for ONNX model analysis. Featuring graph visualization, FLOP counts, memory metrics and more! ⚡️ Quick start First, download and ins
An apocalypse-resistant data storage format for the truly paranoid.
Carbonado An apocalypse-resistant data storage format for the truly paranoid. Designed to keep encrypted, durable, compressed, provably replicated con
rust_aads - Rust Algorithms And Data Structures
rust_aads - Rust Algorithms And Data Structures rust_aads is an open repository with algorithms and data structures, used in computer science and comp
A general-purpose, transactional, relational database that uses Datalog and focuses on graph data and algorithms
cozo A general-purpose, transactional, relational database that uses Datalog for query and focuses on graph data and algorithms. Features Relational d
Generate Soufflé Datalog types, relations, and facts that represent ASTs from a variety of programming languages.
treeedb treeedb makes it easier to start writing a source-level program analysis in Soufflé Datalog. First, treeedb generates Soufflé types and relati
A library for spatial partitioning of 3D data.
Eightfold A library for spatial partitioning of 3D data. Built with nalgebra. Not yet fit for actual use; wait until 1.0.0. Feature Flags spatial :: [
A dead-simple tool for working with data in Kafka
ktool - a tool for Kafka ktool is a dead-simple tool for working with data in Kafka: Copy partitions / topics to disk Replay messages Inspect message
An extremely fast Python linter, written in Rust.
Ruff An extremely fast Python linter, written in Rust. Linting the CPython codebase from scratch. ⚡️ 10-100x faster than existing linters 🐍 Installab
UniSBOM is a tool to build a software bill of materials on any platform with a unified data format.
UniSBOM is a tool to build a software bill of materials on any platform with a unified data format. Work in progress Support MacOS Uses system_profile
Simple utility to backup/sync data between devices to the cloud
RSink Simple utility to backup/sync data between devices to the cloud Features 🚀 Blazingly Fast ⛽ Lightweight 🛟 Cross-platform, runs everywhere 📁 S
Convert rust coverage data to HTML reports, LCOV files or terminal tables
Coverage Prepare Convert coverage data to HTML reports, LCOV files or terminal tables. coverage-prepare --help: Convert "profraw" coverage data to: *
Databento Binary Encoding (DBZ) - Fast message encoding and storage format for market data
dbz A library (dbz-lib) and CLI tool (dbz-cli) for working with Databento Binary Encoding (DBZ) files. Python bindings for dbz-lib are provided in the
Library provides a simple API for Google Firestore for create/update/query/streaming/listening data
Firestore for Rust Library provides a simple API for Google Firestore: Create or update documents using Rust structures and Serde; Support for queryin
Parse RISC-V opcodes to provide more detailed structured data
riscv-opcodes-parser Parse RISC-V opcodes to provide more detailed structured data. License Licensed under either of Apache License, Version 2.0 (LICE
Heimdall is an advanced Ethereum smart contract toolkit for forensic and heuristic analysis.
Heimdall is an advanced EVM toolkit which aims to make dealing with smart contracts on EVM based chains easier. Installation & Usage Heimdall's update
Concurrent and multi-stage data ingestion and data processing with Rust+Tokio
TokioSky Build concurrent and multi-stage data ingestion and data processing pipelines with Rust+Tokio. TokioSky allows developers to consume data eff
Hashlink bytecode disassembler, analyzer, decompiler and assembler.
Hashlink bytecode This repository contains a collection of Rust crates and cli tools to load, disassemble, decompile and analyze Hashlink bytecode. Re
A fast and simple in-memory database with a key-value data model written in Rust
Segment Segment is a simple & fast in-memory database with a key-value data model written in Rust. Features Dynamic keyspaces Keyspace level control o
Linux anti-debugging and anti-analysis rust library
DebugOff Library Linux anti-analysis Rust library The goal of this library is to make both static and dynamic (debugging) analysis more difficult. The
The powerful analysis platform to explore and visualize data from blockchain.
Mars: The powerful analysis platform to explore and visualize data from Web3 Features Blazing Fast Create from scratch with Rust. Pipeline Processor E
A library and application for lossless, format-preserving, two-pass optimization and repair of Vorbis data, reducing its size without altering any audio information.
OptiVorbis A library and application for lossless, format-preserving, two-pass optimization and repair of Vorbis data, reducing its size without alter
Plow - The ontology package manager
Plow - Ontology package manager Plow is package management solution for OWL ontologies, with support for specifying dependencies between packages via
qsv: Ultra-fast CSV data-wrangling toolkit
qsv is a command line program for indexing, slicing, analyzing, splitting, enriching, validating & joining CSV files. Commands are simple, fast & composable
A data compatibility project for Minecraft's assets
Data Compat MC Data tool for the Falcon MC project. Description DataCompatMC is a cli tool designed to help deal with the many different versions of M
A data compatibility project for Minecraft's assets
Data Compat MC Data tool for the Falcon MC project. Description DataCompatMC is a cli tool designed to help deal with the many different versions of M
ReadySet is a lightweight SQL caching engine written in Rust that helps developers enhance the performance and scalability of existing applications.
ReadySet is a SQL caching engine designed to help developers enhance the performance and scalability of their existing database-backed applications. W
OBKV Table Client is Rust Library that can be used to access table data from OceanBase storage layer.
OBKV Table Client is Rust Library that can be used to access table data from OceanBase storage layer. Its access method is different from JDBC, it skips the SQL parsing layer, so it has significant performance advantage.
Rust libraries for working with GPT (GUID Partition Table) disk data
gpt-disk-rs no_std libraries related to GPT (GUID Partition Table) disk data. There are three Rust packages in this repository: uguid The uguid packag
CLI application to run clang-tidy on a set of files specified using globs in a JSON configuration file.
run-clang-tidy CLI application for running clang-tidy for an existing .clang-tidy file on a set of files, specified using globs in a .json configurati
🐎 A fast implementation of the Aho-Corasick algorithm using the compact double-array data structure. (Python wrapper for daachorse)
python-daachorse daachorse is a fast implementation of the Aho-Corasick algorithm using the compact double-array data structure. This is a Python wrap
PRQL is a modern language for transforming data — a simpler and more powerful SQL
PRQL Pipelined Relational Query Language, pronounced "Prequel". PRQL is a modern language for transforming data — a simpler and more powerful SQL. Lik
Seed your development database with real data ⚡️
Seed Your Development Database With Real Data ⚡️ Replibyte is a blazingly fast tool to seed your databases with your production data while keeping sen
📚 flow state reading in the terminal
fsrx 📚 (f)low (s)tate (r)eading e(x)change – flow state reading in the terminal Inspired by (but not affiliated with) Renato Casutt and his revolutio
Jsonptr - Data structures and logic for resolving, assigning, and deleting by JSON Pointers
jsonptr - JSON Pointers for Rust Data structures and logic for resolving, assigning, and deleting by JSON Pointers (RFC 6901). Usage Resolve JSON Poin
🛥 Vaporetto is a fast and lightweight pointwise prediction based tokenizer. This is a Python wrapper for Vaporetto.
🐍 python-vaporetto 🛥 Vaporetto is a fast and lightweight pointwise prediction based tokenizer. This is a Python wrapper for Vaporetto. Installation
Sort (key, value) data sets that don't fit in memory
kv-par-merge-sort Key-Value Parallel Merge Sort Sort Pod (key, value) data sets that don't fit in memory. This crate provides the kv_par_merge_sort li
Steggy CLI Tool - hides data within the least significant bit of an image
Written in Rust, features a simple cli and a client-side webapp. This tool hides data within the least significant bit of an image. Obfuscation techniques are utilized to make the
Library with support for de/serialization, parsing and executing on data-structures and network messages related to Bitcoin
Rust Bitcoin Library with support for de/serialization, parsing and executing on data-structures and network messages related to Bitcoin. Heads up for
Noria: data-flow for high-performance web applications
Noria: data-flow for high-performance web applications Noria is a new streaming data-flow system designed to act as a fast storage backend for read-he
Vector is a high-performance, end-to-end (agent & aggregator) observability data pipeline that puts you in control of your observability data
Quickstart • Docs • Guides • Integrations • Chat • Download What is Vector? Vector is a high-performance, end-to-end (agent & aggregator) observabilit
The Declarative Data Generator
The Declarative Data Generator Synth is a tool for generating realistic data using a declarative data model. Synth is database agnostic and can scale
User-friendly secure computation engine based on secure multi-party computation
CipherCore If you have any questions, or, more generally, would like to discuss CipherCore, please join the Slack community. See a vastly extended ver
Generic and extensible egui widgets to create analog synthesizer-like UI with data-oriented API
egui_cable A generic and extensible data-oriented widget for connecting ports by cables. I create this for the visual programming editor of Hihaheho/D
NSE is a rust cli binary and library for extracting real-time data from National Stock Exchange (India)
NSE Check out the sister projects NsePython and SaveKiteEnctoken which are Python & Javascript libraries to use the NSE and Zerodha APIs respectively
A HashMap/Vector hybrid: efficient, ordered key-value data storage in Rust.
hashvec A HashVec is a hash map / dictionary whose key-value pairs are stored (and can be iterated over) in a fixed order, by default the order in whi
An app which reads data from a serial port and serves it on a TCP port.
serial-to-tcp An app which reads data from a serial port and serves it on a TCP port. How to use Clone this repo and build the app as outlined below (
Turns running Rust code into a serializable data structure.
WasmBox WasmBox turns running Rust code into a serializable data structure. It does this by compiling it to WebAssembly and running it in a sandbox. T
Convert perf.data files to the Firefox Profiler format
fxprof-perf-convert A converter from the Linux perf perf.data format into the Firefox Profiler format, specifically into the processed profile format.
Modular FFXIV data toolkit written in rust.
ironworks Modular FFXIV data toolkit written in rust. ironworks is pre-1.0, and as such its API should be considered unstable. Breaking API changes wi
Plugin for macro-, mini-quad (quads) to save data in simple local storage using Web Storage API in WASM and local file on a native platforms.
quad-storage This is the crate to save data in persistent local storage in miniquad/macroquad environment. In WASM the data persists even if tab or br
Generates a unique hash/identifier for a system given a set of parameters.
uniqueid 🔍 Generates a unique hash/identifier for a system given a set of parameters. Example usage use uniqueid; pub fn main() { let data = vec
Parse and encoding of data using the SCTE-35 standard.
SCTE-35 lib and parser for Rust Work in progress! This library provide access to parse and encoding of data using the SCTE-35 standard. This standard
📊 Collect cloud usage data, so that it can be combined with impact data of Boavizta API.
cloud-scanner Collect aws cloud usage data, so that it can be combined with impact data of Boavizta API. ⚠ Very early Work in progress ! At the moment
A SOAP client for Brazilian Central Bank's Time Series Management System
A SOAP client for Brazilian Central Bank's Time Series Management System
Export MacOS iMessage data + run iMessage Diagnostics
imessage-export This crate provides both a library to interact with iMessage data as well as a binary that can perform some useful read-only operation
An intel PT trace converter from `perf.data` to Fuchsia trace format.
Introduction Recent Intel processors feature the "Intel Processor Trace" feature, which can be used to capture the full execution trace of a program.
Make data-driven table rendering easy with Dioxus
Dioxus Table Make data-driven table rendering easy with Dioxus Installation Until the next release of Dioxus this requires Dioxus nightly from git. Th
A parser for the perf.data format
linux-perf-data This repo contains a parser for the perf.data format which is output by the Linux perf tool. It also contains a main.rs which acts sim
A prefix tree (trie) is a data structure that allows you to store an associative array whose keys are strings
RadixTrie A prefix tree (trie) is a data structure that allows you to store an associative array whose keys are strings. It is a root tree, each edge
NixEl is a Rust library that turns Nix code into a variety of correct, typed, memory-safe data-structures
🐉 NixEL Lexer, Parser, Abstract Syntax Tree and Concrete Syntax Tree for the Nix Expressions Language. NixEl is a Rust library that turns Nix code in
A rust library for creating and managing logs of arbitrary binary data
A rust library for creating and managing logs of arbitrary binary data. Presently it's used to collect sensor data. But it should generally be helpful in cases where you need to store timeseries data, in a nearly (but not strictly) append-only fashion.
computed data's hash by webAssembly
wasm-hasher computed data's hash by webAssembly support md5,sha1,sha2-224,sha2-356,sha2-384,sha2-512,sha3-224,sha3-256,sha3-384,sha3-512,china-sm3 typ
A high performance python technical analysis library written in Rust and the Numpy C API.
Panther A efficient, high-performance python technical analysis library written in Rust using PyO3 and rust-numpy. Indicators ATR CMF SMA EMA RSI MACD
BTM is an incremental data backup mechanism that does not require downtime.
BTM Blockchain Time Machine. BTM is an incremental data backup mechanism that does not require downtime.
Provides a mechanism to lay out data into GPU buffers according to WGSL's memory layout rules
Provides a mechanism to lay out data into GPU buffers ensuring WGSL's memory layout requirements are met. Features supports all WGSL host-shareable ty
Rest API to check if a password is in a data breach
easypwned (haveibeenpwned / HIBP) Rest API to check if a password is in a data breach. Works offline - everything stays on your machine! Database is i
Fast, efficient, and robust memory reclamation for concurrent data structures
Seize Fast, efficient, and robust memory reclamation for concurrent data structures. Introduction Concurrent data structures are faced with the proble
A lightweight Rust library for BitVector Rank&Select operations, coupled with a generic Sparse Array implementation
A lightweight Rust library for BitVector Rank&Select operations, coupled with a generic Sparse Array implementation
Focus Annotator - a tool for annotation the focal plane of a part of an image
Focus Annotator Focus Annotator is a tool for annotation the focal plane of a part of an image. It is a tool I built in rust as part of my master's th
🍖A WGPU graphics pipeline, along with simple types used to marshal data to the GPU
renderling 🍖 This library is a collection of WGPU render pipelines. Shaders are written in GLSL. shaderc is used to compile shaders to SPIR-V. Defini
sblade or switchblade it's a multitool in one capable of doing simple analysis with any type of data, attempting to speed up ethical hacking activities
sblade or switchblade it's a multitool in one capable of doing simple analysis with any type of data, attempting to speed up ethical hacking activities
Dade is data definition for Rust structures.
dade dade is data definition for Rust structures. For the easy handle of data, the following will support it. Data validation. Data schema conforms Js