Reverse proxy for HTTP microservices and STDIO. Openfass watchdog which can run webassembly with wasmer-gpu written in rust.

yanghaku

Last update: Sep 15, 2022

Related tags

Network programming rust gpu proxy cuda webassembly wasm openfaas faas-framework wasmer wasmer-gpu

Overview

faas-watchdog-wasmer-gpu

The of-watchdog implements an HTTP server listening on port 8080, and acts as a reverse proxy for running functions and microservices. It can be used independently, or as the entrypoint for a container with OpenFaaS.

This version can run webassembly with wasmer-gpu implemented in rust.

The behavior is same as of-watchdog, and add the mode wasm to support new feature.

Wasm Mode (mode=wasm) (default)

Running WebAssembly instance in thread pool, a function is served as a thread in process.

Compute resource isolation
- CPU: now only use one thead in thread pool to run functions.
- Memory: strong memory isolation. todo: 64bit memory support
- GPU: now it can use cuda. todo: resource limitation
FileSystem
- use wasm_root as file system root for webassembly liking chroot.
- when multi webassembly instances access the same file in wasm_root, we use the copy on write strategy liking fork
Network
- pending

Configuration

For the full configuration you can see in watchdog

The extra environment variable for wasm mode:

key	description	default
`wasm_root`	The file system root for webassembly instance	`/`
`use_cuda`	If enable cuda support	`false`
`min_scale`	min replicas for function instances, also is the init replicas	`1`
`max_scale`	max replicas for function instances	`4096`
`wasm_c_target`	(`compiler` feature only) compile target	host target
`wasm_c_cpu_features`	(`compiler` feature only) compile target cpu features	host default

example

You can download some example wasm module file in wasm-cuda-simple-examples

Then run:

fprocess=/wasm_root/bin/device use_cuda=true ./watchdog

Status:

mode	status
"streaming"
"serializing"
"http"
"static"
"wasm"

A proxy implement with http / socks5 in-bound and vmess out-bound, written in Rust and tokio.rs

tokio-vmess an Asynchronous proxy implement with http / socks5 in-bound and vmess out-bound, written in Rust and tokio Run example first, Fill out the

7 Oct 3, 2022

♻ A simple and efficient Gemini-to-HTTP proxy written in Rust.

September A simple and efficient Gemini-to-HTTP proxy written in Rust. Usage Docker $ docker run -d [ -e ROOT="gemini://fuwn.me" ] [ -e PORT="8080"] [

10 Jul 2, 2022

UDP proxy with Proxy Protocol and mmproxy support

udppp UDP proxy with Proxy Protocol and mmproxy support. Features Async Support Proxy Protocol V2 SOCKET preserve client IP addresses in L7 proxies(mm

10 Dec 18, 2022

Web3-proxy: a fast caching and load balancing proxy for web3 (Ethereum or similar) JsonRPC servers.

web3-proxy Web3-proxy is a fast caching and load balancing proxy for web3 (Ethereum or similar) JsonRPC servers. Signed transactions (eth_sendRawTrans

55 Jan 8, 2023

Hudsucker is a MITM HTTP/S proxy written in Rust.

hudsucker Hudsucker is a MITM HTTP/S proxy written in Rust. Features Modify HTTP/S requests Modify HTTP/S responses Modify websocket messages Usage Fo

86 Dec 25, 2022

Proxy sentry request to a sentry server using a tunnel/proxy endpoint

Sentry Tunnel This is a proxy that forwards tunneled sentry requests to the real sentry server. The implementation is based on the explanation provide

14 Dec 20, 2022

Volo is a high-performance and strong-extensibility Rust RPC framework that helps developers build microservices.

1.3k Jan 2, 2023

A remote shell, TCP tunnel and HTTP proxy for Replit.

Autobahn A remote shell, TCP tunnel and HTTP proxy for Replit. Hybrid SSH/HTTP server for Replit. Based on leon332157/replish. Autobahn runs a WebSock