WASI-NN Experiment
(API Docs)
Experiments with wasmtime, the wasi-nn proposal, and tract.
Getting Started
To use this experiment, you will first need to compile the guest code to WebAssembly.
$ cargo build --target wasm32-unknown-unknown --package guest
We can then use the host application to load the WebAssembly module and run the model it contains.
$ cargo --package host -- target/wasm32-unknown-unknown/debug/guest.wasm
During development, I use cargo watch and this one-liner to automatically recompile and re-run the guest after every change:
$ cargo watch --clear \
-x "check --workspace" \
-x "test --workspace" \
-x "doc --workspace --document-private-items" \
-x "build --package guest --target wasm32-unknown-unknown" \
-x "run --package host -- target/wasm32-unknown-unknown/debug/guest.wasm"
License
This project is licensed under either of
- Apache License, Version 2.0, (LICENSE-APACHE or http://www.apache.org/licenses/LICENSE-2.0)
- MIT license (LICENSE-MIT or http://opensource.org/licenses/MIT)
at your option.
It is recommended to always use cargo-crev to verify the trustworthiness of each of your dependencies, including this one.
Contribution
Unless you explicitly state otherwise, any contribution intentionally submitted for inclusion in the work by you, as defined in the Apache-2.0 license, shall be dual licensed as above, without any additional terms or conditions.
The intent of this crate is to be free of soundness bugs. The developers will do their best to avoid them, and welcome help in analysing and fixing them.
55 Dec 26, 2022
27 Dec 30, 2022
6.1k Dec 30, 2022
1.2k Jan 5, 2023
1 Feb 14, 2022
1 Feb 14, 2022
103 Dec 25, 2022
1 Apr 9, 2022
6 Dec 10, 2022
2 Dec 9, 2021
5 Jun 12, 2023
2 Apr 20, 2022
2 Jan 4, 2022
5 Oct 5, 2021
3.1k Dec 26, 2022
14.1k Jan 8, 2023
28 Jan 2, 2023
219 Jan 3, 2023
30 Nov 25, 2022