68 Repositories
Rust streaming-logs Libraries
Extract patterns from unstructured log messages
logu logu is for extracting patterns from (streaming) unstructured log messages. For parsing unstructured logs, it uses the parser from Drain. In simp
Rust client for Timeplus Proton, a fast and lightweight streaming SQL engine
Rust Client for Timeplus Proton Rust client for Timeplus Proton. Proton is a streaming SQL engine, a fast and lightweight alternative to Apache Flink,
Global-Scale Media Server written in Rust (WebRTC/RTMP/SIP)
Decentralized Ultra-Low Latency Streaming Server A decentralized media server designed to handle media streaming at a global-scale, making it suitable
A web-based streaming service with improved privacy, performance, and simplicity.
Majiix Majiix is a web-based open-source streaming service. The backend that handles the core streaming logic is written in Rust and makes use of cutt
Global-Scale Media Server written in Rust (WebRTC/RTMP/SIP)
8xFF Media Server: Global-Scale Ultra-Low Latency Streaming Server written in Rust A media server that supports multiple protocols, including WebRTC,
"Last Mile" streaming server and client
TSLM - Terminal Stream Last Mile This is an asynchronous WebSocket server written in Rust using tokio-tungstenite. It allows a WebSocket client to per
A fast, simple TUI for interacting with systemd services and their logs
systemctl-tui A fast, simple TUI for interacting with systemd services and their logs. systemctl-tui can quickly browse service status and logs, and s
Fast fail2ban-like tools for parsing nginx logs
Fast2ban This is simple fail2ban-like replacement written in Rust. Usage: ./fast2ban # reads default config.toml from current directory ./fast2ban co
Crates.io library that provides high-level APIs for obtaining information on various entertainment media such as books, movies, comic books, anime, manga, and so on.
Crates.io library that provides high-level APIs for obtaining information on various entertainment media such as books, movies, comic books, anime, manga, and so on.
Infino - Fast and scalable service to store time series and logs - written in Rust
Infino γ½οΈ πͺ΅ β π π β βοΈ π° Ingest Metrics and Logs β Query and Insights β Scale and Save $$ Infino is an observability platform for storing metrics
A cli tool to prettify stacktrace in json logs.
stack A cli tool to prettify stacktrace in json logs. Why to write this tool? When we read the stacktrace info from json logs, it's hard to read witho
π 10x easier, π 10x cheaper, π high performance, π petabyte scale - Elasticsearch/Splunk/Datadog alternative for π (logs, metrics, traces).
π 10x easier, π 10x cheaper, π petabyte scale - Elasticsearch/Splunk/Datadog alternative for π (logs, metrics, traces). ZincObserve ZincObserve is
A high-performance WebSocket integration library for streaming public market data. Used as a key dependency of the `barter-rs` project.
Barter-Data A high-performance WebSocket integration library for streaming public market data from leading cryptocurrency exchanges - batteries includ
Diosic is an open source web-based music collection server and streamer
Diosic is an open source web-based music collection server and streamer. Mainly suitable for users who need to deploy on servers with low hardware specifications.
Streaming I/O for Linux built on DMA Buffers
dmastorage High-performance I/O for Linux based on DMA Buffers ALPHA QUALITY SOFTWARE Warning DmaStorage is still just a concept and shouldn't be used
Provides json/csv/protobuf streaming support for axum
axum streams for Rust Library provides HTTP response streaming support for axum web framework: JSON array stream format JSON lines stream format CSV s
Cloud native log storage and management for Kubernetes, containerised workloads
Live Demo | Website | API Workspace on Postman Parseable is an open source, cloud native, log storage and management platform. Parseable helps you ing
Library provides a simple API for Google Firestore for create/update/query/streaming/listening data
Firestore for Rust Library provides a simple API for Google Firestore: Create or update documents using Rust structures and Serde; Support for queryin
ReadySet is a lightweight SQL caching engine written in Rust that helps developers enhance the performance and scalability of existing applications.
ReadySet is a SQL caching engine designed to help developers enhance the performance and scalability of their existing database-backed applications. W
Vector is a high-performance, end-to-end (agent & aggregator) observability data pipeline that puts you in control of your observability data
Quickstart β’ Docs β’ Guides β’ Integrations β’ Chat β’ Download What is Vector? Vector is a high-performance, end-to-end (agent & aggregator) observabilit
Xiu - A simple and secure live media server in pure Rust (RTMP/HTTP-FLV/HLS/Relay).π¦
Xiu is a simple and secure live media server written by pure Rust, it now supports popular live protocols like RTMP/HLS/HTTP-FLV (and maybe other protocols in the future), you can deploy it as a stand-alone server or a cluster using the relay feature.
Parse and encoding of data using the SCTE-35 standard.
SCTE-35 lib and parser for Rust Work in progress! This library provide access to parse and encoding of data using the SCTE-35 standard. This standard
chain nats.io servers with transformation & processing pipelines
NATS proxy service Simple tool to forward specific topics from one nats.io cluster to the same server or another. Provides support to process messages
A library to create zip files on a non-seekable writer
A library to create zip files on a non-seekable writer
Quickwit - the next-gen search & analytics engine built for logs
Quickwit is the next-gen search & analytics engine built for logs. It is a highly reliable & cost-efficient alternative to Elasticsearch.
RisingWave is a cloud-native streaming database that uses SQL as the interface language.
RisingWave is a cloud-native streaming database that uses SQL as the interface language. It is designed to reduce the complexity and cost of building real-time applications. RisingWave consumes streaming data, performs continuous queries, and updates results dynamically. As a database system, RisingWave maintains results inside its own storage and allows users to access data efficiently.
A rust library for creating and managing logs of arbitrary binary data
A rust library for creating and managing logs of arbitrary binary data. Presently it's used to collect sensor data. But it should generally be helpful in cases where you need to store timeseries data, in a nearly (but not strictly) append-only fashion.
SWC Transform to prefix logs. Useful for adding file and line number to logs
SWC Transform to prefix logs. Useful for adding file and line number to logs
Simple async codec for rkyv. Reuses streaming buffer for maximum speed
rkyv_codec Simple async codec for rkyv. Reuses streaming buffer for maximum speed! This crate provides a makeshift adaptor for streaming &ArchivedObj
Streaming data over unix sockets, in Rust
Unix-socket based client/server In order to dig into SΕzu channels, I had to dig into the workings of unix sockets. What this repo contains a small so
An easy-to-use, high-performance Interledger implementation written in Rust
Interledger implementation in Rust πΈ Requirements All crates require Rust 2018 edition and are tested on the following channels: stable Connecting to
A panic hook for wasm32-unknown-unknown that logs panics with console.error
console_error_panic_hook This crate lets you debug panics on wasm32-unknown-unknown by providing a panic hook that forwards panic messages to console.
tectonicdb is a fast, highly compressed standalone database and streaming protocol for order book ticks.
tectonicdb crate docs.rs crate.io tectonicdb tdb-core tdb-server-core tdb-cli tectonicdb is a fast, highly compressed standalone database and streamin
Rust-advent - Learning Rust by solving advent of code challenges (Streaming live on Twitch every Monday)
Rust advent π¦ π Learning Rust by implementing solutions for Advent of Code problems. π₯ HEY, we are live-streaming our attempts to solve the exercis
Meta-repository for Miscreant: misuse-resistant symmetric encryption library with AES-SIV (RFC 5297) and AES-PMAC-SIV support
The best crypto you've never heard of, brought to you by Phil Rogaway A misuse resistant symmetric encryption library designed to support authenticate
Cover your tracks during Linux Exploitation by leaving zero traces on system logs and filesystem timestamps. π»π
moonwalk Cover your tracks during Linux Exploitation / Penetration Testing by leaving zero traces on system logs and filesystem timestamps. π Table o
Firecracker takes your HTTP logs and uses them to map your API flows and to detect anomalies in them.
Who is BLST and what do we do? BLST (Business Logic Security Testing) is a startup company that's developing an automatic penetration tester, replacin
Rapidly Search and Hunt through Windows Event Logs
Rapidly Search and Hunt through Windows Event Logs Chainsaw provides a powerful βfirst-responseβ capability to quickly identify threats within Windows
A real-time event-oriented data-hub
Redcar A real-time event-oriented data-hub, inspired by the data hub. It is: Universal: the front end uses gRPC to provide services. Fast: benchmarked
All-batteries included GStreamer WebRTC producer
webrtcsink All-batteries included GStreamer WebRTC producer, that tries its best to do The Right Thingβ’. Use case The webrtcbin element in GStreamer i
suidsnoop is a tool based on eBPF LSM programs that logs whenever a suid binary is executed and implements custom allow/deny lists.
suidsnoop Log suid binaries and enforce per-uid suid policy. suidsnoop is a tool for logging whenever a suid binary is executed on your system and opt
An example repository on how to start building graph applications on streaming data. Just clone and start building π» πͺ
An example repository on how to start building graph applications on streaming data. Just clone and start building π» πͺ
New generation decentralized data warehouse and streaming data pipeline
World's first decentralized real-time data warehouse, on your laptop Docs | Demo | Tutorials | Examples | FAQ | Chat Get Started Watch this introducto
Some tools for streaming frames to rpi-rgb-led-matrix using ZeroMQ, written in Rust.
led_matrix_zmq Some tools for streaming frames to rpi-rgb-led-matrix using ZeroMQ, written in Rust. This repository includes: Rust client and server l
Command-line program to manage PS battle logs. WIP.
psbattletools psbattletools is a command-line tool written in Rust for manipulating PokΓ©mon Showdown battle logs. Installation psbattletools currently
A highly efficient daemon for streaming data from Kafka into Delta Lake
A highly efficient daemon for streaming data from Kafka into Delta Lake
Rapidly Search and Hunt through Windows Event Logs
Rapidly Search and Hunt through Windows Event Logs Chainsaw provides a powerful βfirst-responseβ capability to quickly identify threats within Windows
Transform Linux Audit logs for SIEM usage
Linux Audit β Usable, Robust, Easy Logging TLDR: Instead of audit events that look like thisβ¦ type=EXECVE msg=audit(1626611363.720:348501): argc=3 a0=
Real-time UI for bots, microservices, and IoT
Real-time UI for bots, microservices, and IoT
Parses go-ethereum logs and pipes them to telegram
parrot Middleware that accepts logs via stdin and redirects them to Telegram, based on a configurable set of conditions.
A Modern Real-Time Data Processing & Analytics DBMS with Cloud-Native Architecture, built to make the Data Cloud easy
A Modern Real-Time Data Processing & Analytics DBMS with Cloud-Native Architecture, built to make the Data Cloud easy
A Modern Real-Time Data Processing & Analytics DBMS with Cloud-Native Architecture, built to make the Data Cloud easy
A Modern Real-Time Data Processing & Analytics DBMS with Cloud-Native Architecture, built to make the Data Cloud easy
A Modern Real-Time Data Processing & Analytics DBMS with Cloud-Native Architecture, written in Rust
Datafuse Modern Real-Time Data Processing & Analytics DBMS with Cloud-Native Architecture Datafuse is a Real-Time Data Processing & Analytics DBMS wit
GStreamer HTTP Live Streaming Plugin
A highly configurable GStreamer HLS sink plugin. Based on the hlssink2 element. The flexhlssink is written in Rust and has various options to configure the HLS output playlist generation.
High-level RTSP multimedia streaming library, in Rust
High-level RTSP multimedia streaming library, in Rust. Good support for ONVIF RTSP/1.0 IP surveillance cameras, as needed by Moonfire NVR. Works around brokenness in cheap closed-source cameras.
Streaming STOMP client for Rust
tokio-stomp An async STOMP client (and maybe eventually, server) for Rust, using the Tokio stack. It aims to be fast and fully-featured with a simple
Fluvio is a high-performance distributed streaming platform that's written in Rust
Fluvio is a high-performance distributed streaming platform that's written in Rust, built to make it easy to develop real-time applications.
A high-performance, high-reliability observability data pipeline.
Quickstart β’ Docs β’ Guides β’ Integrations β’ Chat β’ Download What is Vector? Vector is a high-performance, end-to-end (agent & aggregator) observabilit
A highly efficient daemon for streaming data from Kafka into Delta Lake
kafka-delta-ingest The kafka-delta-ingest project aims to build a highly efficient daemon for streaming data through Apache Kafka into Delta Lake. Thi
Streaming Network Overlay Connection Arbitration Tunnel
SNOCAT Streaming Network Overlay Connection Arbitration Tunnel snocat is a framework for forwarding streams across authenticated, encrypted QUIC tunne
A community curated list of Rust Language streamers
Awesome Rust Streaming This is a community curated list of livestreams about the programming language Rust. Don't see a stream that you like? Feel fre
Easy Hadoop Streaming and MapReduce interfaces in Rust
Efflux Efflux is a set of Rust interfaces for MapReduce and Hadoop Streaming. It enables Rust developers to run batch jobs on Hadoop infrastructure wh
Play your favorite live streams from command line
Streamlib Streamlib is a meta-player for media streams. The streamlib CLI works against a curated library of video and audio streams, and enables quer
A simple CLI for UPnP media file streaming
Slingr A simple CLI for streaming media files over a local network to UPnP media renderers. Designed to work with cheap HDMI/DLNA/UPnP/Miracast Dongle
Utility that takes logs from anywhere and sends them to Telegram.
logram Utility that takes logs from anywhere and sends them to Telegram. Supports log collection from files, journald and docker containers. More abou
A high-performance observability data pipeline.
Get Started β’ Docs β’ Guides β’ Integrations β’ Chat β’ Download What is Vector? Vector is a high-performance, end-to-end (agent & aggregator) observabili
Materialize simplifies application development with streaming data. Incrementally-updated materialized views - in PostgreSQL and in real time. Materialize is powered by Timely Dataflow.
Materialize is a streaming database for real-time applications. Get started Check out our getting started guide. About Materialize lets you ask questi
Polaris is a music streaming application, designed to let you enjoy your music collection from any computer or mobile device.
Polaris is a music streaming application, designed to let you enjoy your music collection from any computer or mobile device. Polaris works by streami