Arrow User-Defined Functions Framework on WebAssembly.

RisingWave Labs

Last update: Dec 14, 2023

Related tags

Data processing arrow-udf-wasm

Overview

Arrow User-Defined Functions Framework on WebAssembly

Example

Build the WebAssembly module:

cargo build --release -p arrow-udf-wasm-example --target wasm32-wasi

Run the example:

cargo run --example wasm -- target/wasm32-wasi/release/arrow_udf_wasm_example.wasm

Run the Python example:

cargo run --example python

Build the Python WebAssembly module:

PYO3_NO_PYTHON=1 cargo build --release -p arrow-udf-python --target wasm32-wasi
mkdir arrow-udf-python/target/wasm32-wasi/wasi-deps/bin
cp target/wasm32-wasi/release/arrow_udf_python.wasm arrow-udf-python/target/wasm32-wasi/wasi-deps/bin/python.wasm

Run the Python WebAssembly example:

cargo run --release --example python_wasm

You might also like...

Kalker (or "kalk") is a calculator program/website that supports user-defined variables, functions, derivation, and integration

Kalker (or "kalk") is a calculator program/website that supports user-defined variables, functions, derivation, and integration. It runs on Windows, macOS, Linux, Android, and in web browsers (with WebAssembly).

1.2k Dec 27, 2022

EXPERIMENTAL: Bitcoin Core Prometheus exporter based on User-Space, Statically Defined Tracing and eBPF.

bitcoind-observer An experimental Prometheus metric exporter for Bitcoin Core based on Userspace, Statically Defined Tracing and eBPF. This demo is ba

24 Nov 8, 2022

Serialize/DeSerialize for Rust built-in types and user defined types (complex struct types)

2 May 3, 2022

A user-friendly TUI for secure file transfers, with arrow-key and VIM-style navigation

gsftp SFTP with an interactive text-based user interface (TUI). Transfer files through an encrypted connection with a visual interface, so you can see

3 Jul 7, 2022

Apache Arrow in WebAssembly

WASM Arrow This package compiles the Rust library of Apache Arrow to WebAssembly. This might be a viable alternative to the pure JavaScript library. R

61 Jan 1, 2023

Const equivalents of many [`bytemuck`] functions, and a few additional const functions.

Const equivalents of many bytemuck functions, and a few additional const functions. constmuck uses bytemuck's traits, so any type that implements thos

6 Nov 4, 2021

interactcli-rs is a command-line program framework used to solve the problem of the integration of command-line and interactive modes, including functions such as unification of command-line interactive modes and sub-command prompts. The framework integrates clap and shellwords.

interactcli-rs 简体中文 interactcli-rs is a command-line program framework used to solve the problem of the integration of command-line and interactive mo

12 Nov 5, 2022

🎭 A CLI task runner defined by a simple markdown file

mask is a CLI task runner which is defined by a simple markdown file. It searches for a maskfile.md in the current directory which it then parses for

756 Dec 30, 2022

Shellfirm - Intercept any risky patterns (default or defined by you) and prompt you a small challenge for double verification

shellfirm Opppppsss you did it again? 😱 😱 😰 Protect yourself from yourself! rm -rf * git reset --hard before saving? kubectl delete ns which going

652 Dec 29, 2022

omekasy is a command line application that converts alphanumeric characters in your input to various styles defined in Unicode.

omekasy is a command line application that converts alphanumeric characters in your input to various styles defined in Unicode. omekasy means "dress up" in Japanese.

105 Nov 16, 2022

A demo repo that shows how to use the latest component model feature in wasmtime to implement a key-value capability defined in a WIT file.

Key-Value Component Demo This repo serves as an example of how to use the latest wasm runtime wasmtime and its component-model feature to build and ex

3 Dec 20, 2022

Patch binary file using IDA signatures and defined replacement bytes in YAML.

fabricbin Patch binary file using IDA signatures and defined replacement bytes in YAML. Install: cargo install --git https://github.com/makindotcc/fab

3 Oct 24, 2023

Dash is a CLI tool that rapidly sets up new projects by running a series of pre-defined commands.

Dash Dash is a CLI tool that rapidly sets up new projects by running a series of pre-defined commands. Features Quick Initialization: Initialize the c

4 Nov 7, 2023

A template project to demonstrate how to run WebAssembly functions as sidecar microservices in dapr

Demo and tutorials Live Demo | Tutorial article | Tutorial video 1. Introduction DAPR is a portable, event-driven runtime that makes it easy for any d

184 Dec 29, 2022

An asynchronous runtime compatible with WebAssembly and non-WebAssembly targets.

Promise x Tokio = Prokio An asynchronous runtime compatible with WebAssembly and non-WebAssembly targets. Rationale When designing components and libr

29 Feb 6, 2023

Distributed compute platform implemented in Rust, and powered by Apache Arrow.

Ballista: Distributed Compute Platform Overview Ballista is a distributed compute platform primarily implemented in Rust, powered by Apache Arrow. It

2.3k Jan 3, 2023

transmute-free Rust library to work with the Arrow format

Arrow2: Transmute-free Arrow This repository contains a Rust library to work with the Arrow format. It is a re-write of the official Arrow crate using

708 Dec 30, 2022

Distributed compute platform implemented in Rust, and powered by Apache Arrow.

Ballista: Distributed Compute Platform Overview Ballista is a distributed compute platform primarily implemented in Rust, powered by Apache Arrow. It

2.3k Jan 3, 2023

A Rust DataFrame implementation, built on Apache Arrow

Rust DataFrame A dataframe implementation in Rust, powered by Apache Arrow. What is a dataframe? A dataframe is a 2-dimensional tabular data structure

287 Nov 11, 2022

Owner

RisingWave Labs

Innovating the distributed SQL streaming database in the cloud.

GitHub

Arrow User-Defined Functions Framework on WebAssembly.

Related tags

Overview

Arrow User-Defined Functions Framework on WebAssembly

Example

You might also like...

Kalker (or "kalk") is a calculator program/website that supports user-defined variables, functions, derivation, and integration

EXPERIMENTAL: Bitcoin Core Prometheus exporter based on User-Space, Statically Defined Tracing and eBPF.

Serialize/DeSerialize for Rust built-in types and user defined types (complex struct types)

A user-friendly TUI for secure file transfers, with arrow-key and VIM-style navigation

Apache Arrow in WebAssembly

Const equivalents of many [`bytemuck`] functions, and a few additional const functions.

interactcli-rs is a command-line program framework used to solve the problem of the integration of command-line and interactive modes, including functions such as unification of command-line interactive modes and sub-command prompts. The framework integrates clap and shellwords.

🎭 A CLI task runner defined by a simple markdown file

Shellfirm - Intercept any risky patterns (default or defined by you) and prompt you a small challenge for double verification

omekasy is a command line application that converts alphanumeric characters in your input to various styles defined in Unicode.

A demo repo that shows how to use the latest component model feature in wasmtime to implement a key-value capability defined in a WIT file.

Patch binary file using IDA signatures and defined replacement bytes in YAML.

Dash is a CLI tool that rapidly sets up new projects by running a series of pre-defined commands.

A template project to demonstrate how to run WebAssembly functions as sidecar microservices in dapr

An asynchronous runtime compatible with WebAssembly and non-WebAssembly targets.

Distributed compute platform implemented in Rust, and powered by Apache Arrow.

transmute-free Rust library to work with the Arrow format

Distributed compute platform implemented in Rust, and powered by Apache Arrow.

A Rust DataFrame implementation, built on Apache Arrow

Owner

RisingWave Labs

Official Rust implementation of Apache Arrow

Apache Arrow DataFusion and Ballista query engines

Fill Apache Arrow record batches from an ODBC data source in Rust.

Apache Arrow is a multi-language toolbox for accelerated data interchange and in-memory processing

Polars is a blazingly fast DataFrames library implemented in Rust using Apache Arrow Columnar Format as memory model.

Integration between arrow-rs and extendr

🦖 Evolve your fixed length data files into Apache Arrow tables, fully parallelized!

Orkhon: ML Inference Framework and Server Runtime

Xaynet represents an agnostic Federated Machine Learning framework to build privacy-preserving AI applications.

Bytewax is an open source Python framework for building highly scalable dataflows.