Efficient ML solutions for long-tailed demands.

Overview

MegFlow

GitHub license ubuntu macos

MegFlow 是一个面向视觉应用的流式计算框架, 目标是简单、高性能、帮助机器学习应用快速落地。

Features

  • 基于 async-std[features=tokio1] 的高效异步运行时调度器
  • 简洁的基于 toml 的建图描述格式
  • 支持静态、动态、共享子图
  • 支持 Rust/Python 多语言共存(会 Python 即可)
  • 支持资源管理(多层级跨任务共享)
  • 支持异常处理(异常任务会终止所在静态图)
  • 支持 demux/reorder/transform 等通用函数式组件
  • Python 插件内置有栈协程,不依赖 asyncio
  • 基础测试工具,支持插件沙盒,用于单测插件

HowTo

Current Support List

系统环境 支持情况
Windows 10 WSL ubuntu18.04 ✔️
x86 Ubuntu16.04 有 GPU ✔️
x86 Ubuntu18.04 无 GPU ✔️
x86 macos ✔️
ARM /
Python 版本 支持情况
3.6 ✔️
3.7 ✔️
3.8 ✔️
3.9 /

Built-in Applications

  • 猫猫围栏
  • 电梯电动车报警

Coming Soon

  • 进程级别的节点、子图支持
  • 插件自动化测试部署
  • 调试工具,建图实时预览 profile 工具
  • 性能监控,inspect 工具
  • 更多内置应用和组件

Contact Us

  • Issue: github.com/MegEngine/MegFlow/issues
  • Email: [email protected]
  • Forum: discuss.megengine.org.cn
  • QQ Group: 1029741705
  • OPENI: openi.org.cn/MegEngine

License

Acknowledgement

MegFlow 模型和推理学习了这些项目:

MegFlow Python 使用了下列项目:

MegFlow Rust 使用了以下项目:

Comments
  • 如何在MegFLow的框架下利用Flask等框架传输纯文本数据?

    如何在MegFLow的框架下利用Flask等框架传输纯文本数据?

    detail | 详细描述

    目前看官方的教程,只有ImageServer和VideoServer,两者必须要传输Image或者Video数据,虽然有extra_data能够解析URL,但是无法只传输纯文本信息。

    希望官方教程增加在MegFlow框架下,利用Flask等Web框架作为source的示例代码,方便自定义传输数据的类型

    enhancement help wanted 
    opened by wanghan0501 4
  • MegFlow 后续可以支持在win平台运行吗?

    MegFlow 后续可以支持在win平台运行吗?

    platform | 软硬件环境

    win 10 i5-10210U MX330

    error log | 日志或报错信息

    ERROR: megflow-0.1.0-py37-none-linux_x86_64.whl is not a supported wheel on this platform.

    opened by Qianlu5110 3
  • MacOS build and run examples failed

    MacOS build and run examples failed

    error log | 日志或报错信息

    cargo run --example run_with_plugins -- -p logical_test Compiling unicode-segmentation v1.8.0 Compiling unicode-width v0.1.8 Compiling vec_map v0.8.2 Compiling os_str_bytes v2.4.0 Compiling strsim v0.10.0 Compiling proc-macro-error-attr v1.0.4 Compiling proc-macro-error v1.0.4 Compiling textwrap v0.12.1 Compiling heck v0.3.3 Compiling clap_derive v3.0.0-beta.2 Compiling clap v3.0.0-beta.2 Compiling flow-rs v0.1.0 (/Users/weixiaobin/Repos/github/MegFlow/flow-rs) Finished dev [unoptimized + debuginfo] target(s) in 16.46s Running /Users/xxx/Repos/github/MegFlow/target/debug/examples/run_with_plugins -p logical_test thread 'main' panicked at 'module megflow not found: PyErr { type: <class 'ModuleNotFoundError'>, value: ModuleNotFoundError("No module named 'megflow'"), traceback: None }', flow-rs/src/loader/python/mod.rs:139:51 note: run with RUST_BACKTRACE=1 environment variable to display a backtrace [1] 15835 abort cargo run --example run_with_plugins -- -p logical_test

    context | 编译/运行环境

    MacOS Big Sur 11.5.2 (20G95) master 00de1fff1315e1c17ff23988905a36ddc3a8a222 python 3.8.10

    how to reproduce | 复现步骤

    1. brew install rust
    2. cd MegFlow; cargo build; cd flow-python; python setup.py install
    3. cd examples; cargo run --example run_with_plugins -- -p logical_test
    opened by xbwee1024 3
  • build(deps): bump tokio from 1.10.0 to 1.13.1 in /flow-debugger

    build(deps): bump tokio from 1.10.0 to 1.13.1 in /flow-debugger

    Bumps tokio from 1.10.0 to 1.13.1.

    Release notes

    Sourced from tokio's releases.

    Tokio v1.13.1

    1.13.1 (November 15, 2021)

    This release fixes a data race when sending and receiving on a closed oneshot channel (RUSTSEC-2021-0124).

    Fixed

    • sync: fix a data race between oneshot::Sender::send and awaiting a oneshot::Receiver when the oneshot has been closed (#4226)

    Tokio v1.13.0

    1.13.0 (October 29, 2021)

    Fixed

    • sync: fix Notify to clone the waker before locking its waiter list (#4129)
    • tokio: add riscv32 to non atomic64 architectures (#4185)

    Added

    • net: add poll_{recv,send}_ready methods to udp and uds_datagram (#4131)
    • net: add try_*, readable, writable, ready, and peer_addr methods to split halves (#4120)
    • sync: add blocking_lock to Mutex (#4130)
    • sync: add watch::Sender::send_replace (#3962, #4195)
    • sync: expand Debug for Mutex<T> impl to unsized T (#4134)
    • tracing: instrument time::Sleep (#4072)
    • tracing: use structured location fields for spawned tasks (#4128)

    Changed

    • io: add assert in copy_bidirectional that poll_write is sensible (#4125)
    • macros: use qualified syntax when polling in select! (#4192)
    • runtime: handle block_on wakeups better (#4157)
    • task: allocate callback on heap immediately in debug mode (#4203)
    • tokio: assert platform-minimum requirements at build time (#3797)

    Documented

    • docs: conversion of doc comments to indicative mood (#4174)
    • docs: add returning on the first error example for try_join! (#4133)
    • docs: fixing broken links in tokio/src/lib.rs (#4132)
    • signal: add example with background listener (#4171)
    • sync: add more oneshot examples (#4153)
    • time: document Interval::tick cancel safety (#4152)

    #3797: tokio-rs/tokio#3797 #3962: tokio-rs/tokio#3962

    ... (truncated)

    Commits

    Dependabot compatibility score

    Dependabot will resolve any conflicts with this PR as long as you don't alter it yourself. You can also trigger a rebase manually by commenting @dependabot rebase.


    Dependabot commands and options

    You can trigger Dependabot actions by commenting on this PR:

    • @dependabot rebase will rebase this PR
    • @dependabot recreate will recreate this PR, overwriting any edits that have been made to it
    • @dependabot merge will merge this PR after your CI passes on it
    • @dependabot squash and merge will squash and merge this PR after your CI passes on it
    • @dependabot cancel merge will cancel a previously requested merge and block automerging
    • @dependabot reopen will reopen this PR if it is closed
    • @dependabot close will close this PR and stop Dependabot recreating it. You can achieve the same result by closing it manually
    • @dependabot ignore this major version will close this PR and stop Dependabot creating any more for this major version (unless you reopen the PR or upgrade to it yourself)
    • @dependabot ignore this minor version will close this PR and stop Dependabot creating any more for this minor version (unless you reopen the PR or upgrade to it yourself)
    • @dependabot ignore this dependency will close this PR and stop Dependabot creating any more for this dependency (unless you reopen the PR or upgrade to it yourself)
    • @dependabot use these labels will set the current labels as the default for future PRs for this repo and language
    • @dependabot use these reviewers will set the current reviewers as the default for future PRs for this repo and language
    • @dependabot use these assignees will set the current assignees as the default for future PRs for this repo and language
    • @dependabot use this milestone will set the current milestone as the default for future PRs for this repo and language

    You can disable automated security fix PRs for this repo from the Security Alerts page.

    dependencies rust 
    opened by dependabot[bot] 2
  • 猫猫围栏注册服务运行成功后无法打开网页

    猫猫围栏注册服务运行成功后无法打开网页

    运行环境:win11 wsl2 ubuntu2004

    运行状态如下

    2021-10-09 16:03:35.197 | INFO     | cat_finder.redis_proxy:__init__:24 - init redis pool...
    2021-10-09 16:03:35.197 | INFO     | cat_finder.det:__init__:21 - loading YOLOX detection...
    2021-10-09 16:03:39.074 | INFO     | cat_finder.det:__init__:36 -  YOLOX loaded.
    2021-10-09 16:03:39.074 | INFO     | cat_finder.reid_image:__init__:22 - loading Image Reid...
    2021-10-09 16:03:39.283 | DEBUG    | warehouse.reid_alignedreid.lite:inference:60 - ReID infer time: 0.0719s
    2021-10-09 16:03:39.284 | INFO     | cat_finder.reid_image:__init__:31 - Image Reid loaded.
    

    使用cURL发送post请求可以得到结果,但是浏览器无法打开网页 image

    opened by tangzhongsi 2
  • Dumping 'logical_test.png' failed

    Dumping 'logical_test.png' failed

    error log | 日志或报错信息

    $ megflow_run -p ./logical_test/ -c ./logical_test/logical_test.toml --dump
    thread '<unnamed>' panicked at 'called `Result::unwrap()` on an `Err` value: No such file or directory (os error 2)', flow-python/src/lib.rs:153:66
    note: run with `RUST_BACKTRACE=1` environment variable to display a backtrace
    Aborted (core dumped)
    

    context | 编译/运行环境

    Ubuntu 20.04.4 LTS 64-bits
    python 3.8
    cuda11.3
    
    

    how to reproduce | 复现步骤

    1. build Megflow from source
    2. cd MegFlow/flow-python/examples
    3. megflow_run -p ./logical_test/ -c ./logical_test/logical_test.toml --dump
    opened by GWwangshuo 1
  • Bytes server

    Bytes server

    • Add BytesServer, bytes in bytes out.
    • Add server example flow-plugins/examples/bytes_server.toml
    • Add client example flow-python/examples/application/misc/bytes_client.py
    • Support https://github.com/MegEngine/MegFlow/issues/40
    opened by tpoisonooo 1
  • feat(flow-rs): use ffmpeg dylib

    feat(flow-rs): use ffmpeg dylib

    pyo3 问题, 对 macos 支持还在修复。

    • 修改 ffmpeg 为 .so 或 .dylib 调用,满足 LGPL 要求
    • 建图支持 dict ,即 Python 支持 map_reduce 类用法
    • 调整 Python 相关目录结构,区分应用范例和 megflow 本身用法的示例
    • 新增编译选项 open-camera,可以在 VideoServer 输入 /dev/video0 直接打开摄像头,此时不需要 RTSP
    • github 文档调整风格,支持到 docusaurus 风格转换。即一份文档可以两种部署
    opened by tpoisonooo 1
  • build(deps): bump tar from 4.4.17 to 4.4.19 in /flow-debugger/debugger-ui

    build(deps): bump tar from 4.4.17 to 4.4.19 in /flow-debugger/debugger-ui

    Bumps tar from 4.4.17 to 4.4.19.

    Commits
    • 9a6faa0 4.4.19
    • 70ef812 drop dirCache for symlink on all platforms
    • 3e35515 4.4.18
    • 52b09e3 fix: prevent path escape using drive-relative paths
    • bb93ba2 fix: reserve paths properly for unicode, windows
    • 2f1bca0 fix: prune dirCache properly for unicode, windows
    • See full diff in compare view

    Dependabot compatibility score

    Dependabot will resolve any conflicts with this PR as long as you don't alter it yourself. You can also trigger a rebase manually by commenting @dependabot rebase.


    Dependabot commands and options

    You can trigger Dependabot actions by commenting on this PR:

    • @dependabot rebase will rebase this PR
    • @dependabot recreate will recreate this PR, overwriting any edits that have been made to it
    • @dependabot merge will merge this PR after your CI passes on it
    • @dependabot squash and merge will squash and merge this PR after your CI passes on it
    • @dependabot cancel merge will cancel a previously requested merge and block automerging
    • @dependabot reopen will reopen this PR if it is closed
    • @dependabot close will close this PR and stop Dependabot recreating it. You can achieve the same result by closing it manually
    • @dependabot ignore this major version will close this PR and stop Dependabot creating any more for this major version (unless you reopen the PR or upgrade to it yourself)
    • @dependabot ignore this minor version will close this PR and stop Dependabot creating any more for this minor version (unless you reopen the PR or upgrade to it yourself)
    • @dependabot ignore this dependency will close this PR and stop Dependabot creating any more for this dependency (unless you reopen the PR or upgrade to it yourself)
    • @dependabot use these labels will set the current labels as the default for future PRs for this repo and language
    • @dependabot use these reviewers will set the current reviewers as the default for future PRs for this repo and language
    • @dependabot use these assignees will set the current assignees as the default for future PRs for this repo and language
    • @dependabot use this milestone will set the current milestone as the default for future PRs for this repo and language

    You can disable automated security fix PRs for this repo from the Security Alerts page.

    dependencies 
    opened by dependabot[bot] 1
  • build(deps): bump json5 and react-scripts in /flow-debugger/debugger-ui

    build(deps): bump json5 and react-scripts in /flow-debugger/debugger-ui

    Bumps json5 to 2.2.3 and updates ancestor dependency react-scripts. These dependencies need to be updated together.

    Updates json5 from 0.5.1 to 2.2.3

    Release notes

    Sourced from json5's releases.

    v2.2.3

    v2.2.2

    • Fix: Properties with the name __proto__ are added to objects and arrays. (#199) This also fixes a prototype pollution vulnerability reported by Jonathan Gregson! (#295).

    v2.2.1

    • Fix: Removed dependence on minimist to patch CVE-2021-44906. (#266)

    v2.2.0

    • New: Accurate and documented TypeScript declarations are now included. There is no need to install @types/json5. (#236, #244)

    v2.1.3 [code, diff]

    • Fix: An out of memory bug when parsing numbers has been fixed. (#228, #229)

    v2.1.2

    • Fix: Bump minimist to v1.2.5. (#222)

    v2.1.1

    • New: package.json and package.json5 include a module property so bundlers like webpack, rollup and parcel can take advantage of the ES Module build. (#208)
    • Fix: stringify outputs \0 as \\x00 when followed by a digit. (#210)
    • Fix: Spelling mistakes have been fixed. (#196)

    v2.1.0

    • New: The index.mjs and index.min.mjs browser builds in the dist directory support ES6 modules. (#187)

    v2.0.1

    • Fix: The browser builds in the dist directory support ES5. (#182)

    v2.0.0

    • Major: JSON5 officially supports Node.js v6 and later. Support for Node.js v4 has been dropped. Since Node.js v6 supports ES5 features, the code has been rewritten in native ES5, and the dependence on Babel has been eliminated.

    • New: Support for Unicode 10 has been added.

    • New: The test framework has been migrated from Mocha to Tap.

    • New: The browser build at dist/index.js is no longer minified by default. A minified version is available at dist/index.min.js. (#181)

    • Fix: The warning has been made clearer when line and paragraph separators are

    ... (truncated)

    Changelog

    Sourced from json5's changelog.

    v2.2.3 [code, diff]

    v2.2.2 [code, diff]

    • Fix: Properties with the name __proto__ are added to objects and arrays. (#199) This also fixes a prototype pollution vulnerability reported by Jonathan Gregson! (#295).

    v2.2.1 [code, diff]

    • Fix: Removed dependence on minimist to patch CVE-2021-44906. (#266)

    v2.2.0 [code, diff]

    • New: Accurate and documented TypeScript declarations are now included. There is no need to install @types/json5. (#236, #244)

    v2.1.3 [code, diff]

    • Fix: An out of memory bug when parsing numbers has been fixed. (#228, #229)

    v2.1.2 [code, diff]

    • Fix: Bump minimist to v1.2.5. (#222)

    v2.1.1 [code, [diff][d2.1.1]]

    ... (truncated)

    Commits
    • c3a7524 2.2.3
    • 94fd06d docs: update CHANGELOG for v2.2.3
    • 3b8cebf docs(security): use GitHub security advisories
    • f0fd9e1 docs: publish a security policy
    • 6a91a05 docs(template): bug -> bug report
    • 14f8cb1 2.2.2
    • 10cc7ca docs: update CHANGELOG for v2.2.2
    • 7774c10 fix: add proto to objects and arrays
    • edde30a Readme: slight tweak to intro
    • 97286f8 Improve example in readme
    • Additional commits viewable in compare view

    Updates react-scripts from 2.1.8 to 5.0.1

    Changelog

    Sourced from react-scripts's changelog.

    3.0.0 and Newer Versions

    Please refer to CHANGELOG.md for the newer versions.

    Commits

    Dependabot will resolve any conflicts with this PR as long as you don't alter it yourself. You can also trigger a rebase manually by commenting @dependabot rebase.


    Dependabot commands and options

    You can trigger Dependabot actions by commenting on this PR:

    • @dependabot rebase will rebase this PR
    • @dependabot recreate will recreate this PR, overwriting any edits that have been made to it
    • @dependabot merge will merge this PR after your CI passes on it
    • @dependabot squash and merge will squash and merge this PR after your CI passes on it
    • @dependabot cancel merge will cancel a previously requested merge and block automerging
    • @dependabot reopen will reopen this PR if it is closed
    • @dependabot close will close this PR and stop Dependabot recreating it. You can achieve the same result by closing it manually
    • @dependabot ignore this major version will close this PR and stop Dependabot creating any more for this major version (unless you reopen the PR or upgrade to it yourself)
    • @dependabot ignore this minor version will close this PR and stop Dependabot creating any more for this minor version (unless you reopen the PR or upgrade to it yourself)
    • @dependabot ignore this dependency will close this PR and stop Dependabot creating any more for this dependency (unless you reopen the PR or upgrade to it yourself)
    • @dependabot use these labels will set the current labels as the default for future PRs for this repo and language
    • @dependabot use these reviewers will set the current reviewers as the default for future PRs for this repo and language
    • @dependabot use these assignees will set the current assignees as the default for future PRs for this repo and language
    • @dependabot use this milestone will set the current milestone as the default for future PRs for this repo and language

    You can disable automated security fix PRs for this repo from the Security Alerts page.

    dependencies javascript 
    opened by dependabot[bot] 1
  • build(deps): bump tokio from 1.14.0 to 1.18.4

    build(deps): bump tokio from 1.14.0 to 1.18.4

    Bumps tokio from 1.14.0 to 1.18.4.

    Release notes

    Sourced from tokio's releases.

    Tokio v1.18.3

    1.18.3 (September 27, 2022)

    This release removes the dependency on the once_cell crate to restore the MSRV of the 1.18.x LTS release. (#5048)

    #5048: tokio-rs/tokio#5048

    Tokio v1.18.2

    1.18.2 (May 5, 2022)

    Add missing features for the winapi dependency. (#4663)

    #4663: tokio-rs/tokio#4663

    Tokio v1.18.1

    1.18.1 (May 2, 2022)

    The 1.18.0 release broke the build for targets without 64-bit atomics when building with tokio_unstable. This release fixes that. (#4649)

    #4649: tokio-rs/tokio#4649

    Tokio v1.18.0

    1.18.0 (April 27, 2022)

    This release adds a number of new APIs in tokio::net, tokio::signal, and tokio::sync. In addition, it adds new unstable APIs to tokio::task (Ids for uniquely identifying a task, and AbortHandle for remotely cancelling a task), as well as a number of bugfixes.

    Fixed

    • blocking: add missing #[track_caller] for spawn_blocking (#4616)
    • macros: fix select macro to process 64 branches (#4519)
    • net: fix try_io methods not calling Mio's try_io internally (#4582)
    • runtime: recover when OS fails to spawn a new thread (#4485)

    Added

    • net: add UdpSocket::peer_addr (#4611)
    • net: add try_read_buf method for named pipes (#4626)
    • signal: add SignalKind Hash/Eq impls and c_int conversion (#4540)
    • signal: add support for signals up to SIGRTMAX (#4555)
    • sync: add watch::Sender::send_modify method (#4310)
    • sync: add broadcast::Receiver::len method (#4542)
    • sync: add watch::Receiver::same_channel method (#4581)
    • sync: implement Clone for RecvError types (#4560)

    Changed

    ... (truncated)

    Commits

    Dependabot compatibility score

    Dependabot will resolve any conflicts with this PR as long as you don't alter it yourself. You can also trigger a rebase manually by commenting @dependabot rebase.


    Dependabot commands and options

    You can trigger Dependabot actions by commenting on this PR:

    • @dependabot rebase will rebase this PR
    • @dependabot recreate will recreate this PR, overwriting any edits that have been made to it
    • @dependabot merge will merge this PR after your CI passes on it
    • @dependabot squash and merge will squash and merge this PR after your CI passes on it
    • @dependabot cancel merge will cancel a previously requested merge and block automerging
    • @dependabot reopen will reopen this PR if it is closed
    • @dependabot close will close this PR and stop Dependabot recreating it. You can achieve the same result by closing it manually
    • @dependabot ignore this major version will close this PR and stop Dependabot creating any more for this major version (unless you reopen the PR or upgrade to it yourself)
    • @dependabot ignore this minor version will close this PR and stop Dependabot creating any more for this minor version (unless you reopen the PR or upgrade to it yourself)
    • @dependabot ignore this dependency will close this PR and stop Dependabot creating any more for this dependency (unless you reopen the PR or upgrade to it yourself)
    • @dependabot use these labels will set the current labels as the default for future PRs for this repo and language
    • @dependabot use these reviewers will set the current reviewers as the default for future PRs for this repo and language
    • @dependabot use these assignees will set the current assignees as the default for future PRs for this repo and language
    • @dependabot use this milestone will set the current milestone as the default for future PRs for this repo and language

    You can disable automated security fix PRs for this repo from the Security Alerts page.

    dependencies rust 
    opened by dependabot[bot] 1
  • build(deps): bump tokio from 1.10.0 to 1.16.1 in /flow-debugger

    build(deps): bump tokio from 1.10.0 to 1.16.1 in /flow-debugger

    Bumps tokio from 1.10.0 to 1.16.1.

    Release notes

    Sourced from tokio's releases.

    Tokio v1.16.1

    1.16.1 (January 28, 2022)

    This release fixes a bug in #4428 with the change #4437.

    #4428: tokio-rs/tokio#4428 #4437: tokio-rs/tokio#4437

    Tokio v1.16.0

    Fixes a soundness bug in io::Take (#4428). The unsoundness is exposed when leaking memory in the given AsyncRead implementation and then overwriting the supplied buffer:

    impl AsyncRead for Buggy {
        fn poll_read(
            self: Pin<&mut Self>,
            cx: &mut Context<'_>,
            buf: &mut ReadBuf<'_>
        ) -> Poll<Result<()>> {
          let new_buf = vec![0; 5].leak();
          *buf = ReadBuf::new(new_buf);
          buf.put_slice(b"hello");
          Poll::Ready(Ok(()))
        }
    }
    

    Also, this release includes improvements to the multi-threaded scheduler that can increase throughput by up to 20% in some cases (#4383).

    Fixed

    • io: soundness don't expose uninitialized memory when using io::Take in edge case (#4428)
    • fs: ensure File::write results in a write syscall when the runtime shuts down (#4316)
    • process: drop pipe after child exits in wait_with_output (#4315)
    • rt: improve error message when spawning a thread fails (#4398)
    • rt: reduce false-positive thread wakups in the multi-threaded scheduler (#4383)
    • sync: don't inherit Send from parking_lot::*Guard (#4359)

    Added

    • net: TcpSocket::linger() and set_linger() (#4324)
    • net: impl UnwindSafe for socket types (#4384)
    • rt: impl UnwindSafe for JoinHandle (#4418)
    • sync: watch::Receiver::has_changed() (#4342)
    • sync: oneshot::Receiver::blocking_recv() (#4334)
    • sync: RwLock blocking operations (#4425)

    Unstable

    ... (truncated)

    Commits

    Dependabot compatibility score

    Dependabot will resolve any conflicts with this PR as long as you don't alter it yourself. You can also trigger a rebase manually by commenting @dependabot rebase.


    Dependabot commands and options

    You can trigger Dependabot actions by commenting on this PR:

    • @dependabot rebase will rebase this PR
    • @dependabot recreate will recreate this PR, overwriting any edits that have been made to it
    • @dependabot merge will merge this PR after your CI passes on it
    • @dependabot squash and merge will squash and merge this PR after your CI passes on it
    • @dependabot cancel merge will cancel a previously requested merge and block automerging
    • @dependabot reopen will reopen this PR if it is closed
    • @dependabot close will close this PR and stop Dependabot recreating it. You can achieve the same result by closing it manually
    • @dependabot ignore this major version will close this PR and stop Dependabot creating any more for this major version (unless you reopen the PR or upgrade to it yourself)
    • @dependabot ignore this minor version will close this PR and stop Dependabot creating any more for this minor version (unless you reopen the PR or upgrade to it yourself)
    • @dependabot ignore this dependency will close this PR and stop Dependabot creating any more for this dependency (unless you reopen the PR or upgrade to it yourself)
    • @dependabot use these labels will set the current labels as the default for future PRs for this repo and language
    • @dependabot use these reviewers will set the current reviewers as the default for future PRs for this repo and language
    • @dependabot use these assignees will set the current assignees as the default for future PRs for this repo and language
    • @dependabot use this milestone will set the current milestone as the default for future PRs for this repo and language

    You can disable automated security fix PRs for this repo from the Security Alerts page.

    dependencies rust 
    opened by dependabot[bot] 1
  • build(deps): bump express from 4.17.1 to 4.18.2 in /flow-debugger/debugger-ui

    build(deps): bump express from 4.17.1 to 4.18.2 in /flow-debugger/debugger-ui

    Bumps express from 4.17.1 to 4.18.2.

    Release notes

    Sourced from express's releases.

    4.18.2

    4.18.1

    • Fix hanging on large stack of sync routes

    4.18.0

    ... (truncated)

    Changelog

    Sourced from express's changelog.

    4.18.2 / 2022-10-08

    4.18.1 / 2022-04-29

    • Fix hanging on large stack of sync routes

    4.18.0 / 2022-04-25

    ... (truncated)

    Commits

    Dependabot compatibility score

    Dependabot will resolve any conflicts with this PR as long as you don't alter it yourself. You can also trigger a rebase manually by commenting @dependabot rebase.


    Dependabot commands and options

    You can trigger Dependabot actions by commenting on this PR:

    • @dependabot rebase will rebase this PR
    • @dependabot recreate will recreate this PR, overwriting any edits that have been made to it
    • @dependabot merge will merge this PR after your CI passes on it
    • @dependabot squash and merge will squash and merge this PR after your CI passes on it
    • @dependabot cancel merge will cancel a previously requested merge and block automerging
    • @dependabot reopen will reopen this PR if it is closed
    • @dependabot close will close this PR and stop Dependabot recreating it. You can achieve the same result by closing it manually
    • @dependabot ignore this major version will close this PR and stop Dependabot creating any more for this major version (unless you reopen the PR or upgrade to it yourself)
    • @dependabot ignore this minor version will close this PR and stop Dependabot creating any more for this minor version (unless you reopen the PR or upgrade to it yourself)
    • @dependabot ignore this dependency will close this PR and stop Dependabot creating any more for this dependency (unless you reopen the PR or upgrade to it yourself)
    • @dependabot use these labels will set the current labels as the default for future PRs for this repo and language
    • @dependabot use these reviewers will set the current reviewers as the default for future PRs for this repo and language
    • @dependabot use these assignees will set the current assignees as the default for future PRs for this repo and language
    • @dependabot use this milestone will set the current milestone as the default for future PRs for this repo and language

    You can disable automated security fix PRs for this repo from the Security Alerts page.

    dependencies javascript 
    opened by dependabot[bot] 1
  • build(deps): bump qs and express in /flow-debugger/debugger-ui

    build(deps): bump qs and express in /flow-debugger/debugger-ui

    Bumps qs and express. These dependencies needed to be updated together. Updates qs from 6.5.2 to 6.5.3

    Changelog

    Sourced from qs's changelog.

    6.5.3

    • [Fix] parse: ignore __proto__ keys (#428)
    • [Fix] utils.merge: avoid a crash with a null target and a truthy non-array source
    • [Fix] correctly parse nested arrays
    • [Fix] stringify: fix a crash with strictNullHandling and a custom filter/serializeDate (#279)
    • [Fix] utils: merge: fix crash when source is a truthy primitive & no options are provided
    • [Fix] when parseArrays is false, properly handle keys ending in []
    • [Fix] fix for an impossible situation: when the formatter is called with a non-string value
    • [Fix] utils.merge: avoid a crash with a null target and an array source
    • [Refactor] utils: reduce observable [[Get]]s
    • [Refactor] use cached Array.isArray
    • [Refactor] stringify: Avoid arr = arr.concat(...), push to the existing instance (#269)
    • [Refactor] parse: only need to reassign the var once
    • [Robustness] stringify: avoid relying on a global undefined (#427)
    • [readme] remove travis badge; add github actions/codecov badges; update URLs
    • [Docs] Clean up license text so it’s properly detected as BSD-3-Clause
    • [Docs] Clarify the need for "arrayLimit" option
    • [meta] fix README.md (#399)
    • [meta] add FUNDING.yml
    • [actions] backport actions from main
    • [Tests] always use String(x) over x.toString()
    • [Tests] remove nonexistent tape option
    • [Dev Deps] backport from main
    Commits
    • 298bfa5 v6.5.3
    • ed0f5dc [Fix] parse: ignore __proto__ keys (#428)
    • 691e739 [Robustness] stringify: avoid relying on a global undefined (#427)
    • 1072d57 [readme] remove travis badge; add github actions/codecov badges; update URLs
    • 12ac1c4 [meta] fix README.md (#399)
    • 0338716 [actions] backport actions from main
    • 5639c20 Clean up license text so it’s properly detected as BSD-3-Clause
    • 51b8a0b add FUNDING.yml
    • 45f6759 [Fix] fix for an impossible situation: when the formatter is called with a no...
    • f814a7f [Dev Deps] backport from main
    • Additional commits viewable in compare view

    Updates express from 4.17.1 to 4.18.2

    Release notes

    Sourced from express's releases.

    4.18.2

    4.18.1

    • Fix hanging on large stack of sync routes

    4.18.0

    ... (truncated)

    Changelog

    Sourced from express's changelog.

    4.18.2 / 2022-10-08

    4.18.1 / 2022-04-29

    • Fix hanging on large stack of sync routes

    4.18.0 / 2022-04-25

    ... (truncated)

    Commits

    Dependabot will resolve any conflicts with this PR as long as you don't alter it yourself. You can also trigger a rebase manually by commenting @dependabot rebase.


    Dependabot commands and options

    You can trigger Dependabot actions by commenting on this PR:

    • @dependabot rebase will rebase this PR
    • @dependabot recreate will recreate this PR, overwriting any edits that have been made to it
    • @dependabot merge will merge this PR after your CI passes on it
    • @dependabot squash and merge will squash and merge this PR after your CI passes on it
    • @dependabot cancel merge will cancel a previously requested merge and block automerging
    • @dependabot reopen will reopen this PR if it is closed
    • @dependabot close will close this PR and stop Dependabot recreating it. You can achieve the same result by closing it manually
    • @dependabot ignore this major version will close this PR and stop Dependabot creating any more for this major version (unless you reopen the PR or upgrade to it yourself)
    • @dependabot ignore this minor version will close this PR and stop Dependabot creating any more for this minor version (unless you reopen the PR or upgrade to it yourself)
    • @dependabot ignore this dependency will close this PR and stop Dependabot creating any more for this dependency (unless you reopen the PR or upgrade to it yourself)
    • @dependabot use these labels will set the current labels as the default for future PRs for this repo and language
    • @dependabot use these reviewers will set the current reviewers as the default for future PRs for this repo and language
    • @dependabot use these assignees will set the current assignees as the default for future PRs for this repo and language
    • @dependabot use this milestone will set the current milestone as the default for future PRs for this repo and language

    You can disable automated security fix PRs for this repo from the Security Alerts page.

    dependencies javascript 
    opened by dependabot[bot] 1
  • build(deps): bump decode-uri-component from 0.2.0 to 0.2.2 in /flow-debugger/debugger-ui

    build(deps): bump decode-uri-component from 0.2.0 to 0.2.2 in /flow-debugger/debugger-ui

    Bumps decode-uri-component from 0.2.0 to 0.2.2.

    Release notes

    Sourced from decode-uri-component's releases.

    v0.2.2

    • Prevent overwriting previously decoded tokens 980e0bf

    https://github.com/SamVerschueren/decode-uri-component/compare/v0.2.1...v0.2.2

    v0.2.1

    • Switch to GitHub workflows 76abc93
    • Fix issue where decode throws - fixes #6 746ca5d
    • Update license (#1) 486d7e2
    • Tidelift tasks a650457
    • Meta tweaks 66e1c28

    https://github.com/SamVerschueren/decode-uri-component/compare/v0.2.0...v0.2.1

    Commits

    Dependabot compatibility score

    Dependabot will resolve any conflicts with this PR as long as you don't alter it yourself. You can also trigger a rebase manually by commenting @dependabot rebase.


    Dependabot commands and options

    You can trigger Dependabot actions by commenting on this PR:

    • @dependabot rebase will rebase this PR
    • @dependabot recreate will recreate this PR, overwriting any edits that have been made to it
    • @dependabot merge will merge this PR after your CI passes on it
    • @dependabot squash and merge will squash and merge this PR after your CI passes on it
    • @dependabot cancel merge will cancel a previously requested merge and block automerging
    • @dependabot reopen will reopen this PR if it is closed
    • @dependabot close will close this PR and stop Dependabot recreating it. You can achieve the same result by closing it manually
    • @dependabot ignore this major version will close this PR and stop Dependabot creating any more for this major version (unless you reopen the PR or upgrade to it yourself)
    • @dependabot ignore this minor version will close this PR and stop Dependabot creating any more for this minor version (unless you reopen the PR or upgrade to it yourself)
    • @dependabot ignore this dependency will close this PR and stop Dependabot creating any more for this dependency (unless you reopen the PR or upgrade to it yourself)
    • @dependabot use these labels will set the current labels as the default for future PRs for this repo and language
    • @dependabot use these reviewers will set the current reviewers as the default for future PRs for this repo and language
    • @dependabot use these assignees will set the current assignees as the default for future PRs for this repo and language
    • @dependabot use this milestone will set the current milestone as the default for future PRs for this repo and language

    You can disable automated security fix PRs for this repo from the Security Alerts page.

    dependencies javascript 
    opened by dependabot[bot] 1
Releases(v0.3.5)
  • v0.3.5(Jan 10, 2022)

  • v0.1.0-beta3(Nov 12, 2021)

    What's Changed

    • Add web client (flv.js inside) tutorial to show video result
    • Fix readthedocs link error
    • Add en README
    • Add megflow_quickstart
    • Add Dockerfile.github-release to build py3.6~py3.9 .whl

    New Contributors

    • @chentyjpm made their first contribution in https://github.com/MegEngine/MegFlow/pull/38

    Full Changelog: https://github.com/MegEngine/MegFlow/compare/v0.1.0-beta2...v0.1.0-beta3

    Source code(tar.gz)
    Source code(zip)
    megflow-0.1.0-py36-none-linux_x86_64.whl(42.57 MB)
    megflow-0.1.0-py37-none-linux_x86_64.whl(42.57 MB)
    megflow-0.1.0-py38-none-linux_aarch64.whl(77.86 MB)
    megflow-0.1.0-py38-none-linux_x86_64.whl(42.58 MB)
    megflow-0.1.0-py39-none-linux_x86_64.whl(42.58 MB)
  • v0.1.0-beta2(Oct 20, 2021)

    • 完成 ARM jetson nano/ 鲲鹏 上的自测
    • 增加 pipeline 级测试功能
    • tutorial 增加串联建图、动态 batching
    • 初步增加 debugger 工具,可以基于 Web UI 完成图优化
    • 优化内部动态图创建、销毁过程
    • 优化打包脚本和 CI
    • 修复 python examples 一些 API 使用错误

    What's Changed

    • fix(memd): fix inference call by @tpoisonooo in https://github.com/MegEngine/MegFlow/pull/22
    • ci(action): add pylint and doc link check by @tpoisonooo in https://github.com/MegEngine/MegFlow/pull/19
    • docs(build): remove cargo after build success by @tpoisonooo in https://github.com/MegEngine/MegFlow/pull/23
    • Tutorial02 by @tpoisonooo in https://github.com/MegEngine/MegFlow/pull/24
    • docs(examples): update cat_finder video usage by @tpoisonooo in https://github.com/MegEngine/MegFlow/pull/25
    • Support arm by @tpoisonooo in https://github.com/MegEngine/MegFlow/pull/28
    • feat(project): release 0.1.0beta2 by @tpoisonooo in https://github.com/MegEngine/MegFlow/pull/30

    Full Changelog: https://github.com/MegEngine/MegFlow/compare/v0.1.0-beta1...v0.1.0-beta2

    Source code(tar.gz)
    Source code(zip)
    megflow-0.1.0-py36-none-linux_x86_64.whl(40.07 MB)
    megflow-0.1.0-py37-none-linux_x86_64.whl(40.07 MB)
    megflow-0.1.0-py38-none-linux_x86_64.whl(40.07 MB)
  • v0.1.0-beta1(Sep 19, 2021)

    • docker 增加 tuna 源。源码/docker build 受网络影响仍然比较严重,增加 prebuilt release
    • 增加 tutorial01 把分类模型搭建成服务
    • 修改了超多文档,CI 中增加 pylint 和 doc link check

    What's Changed

    • docs(build): add Dockerfile and prebuilt doc by @tpoisonooo in https://github.com/MegEngine/MegFlow/pull/3
    • Python whl add wrapper by @tpoisonooo in https://github.com/MegEngine/MegFlow/pull/4
    • docs(project): revert prebuilt whl; support macos by @tpoisonooo in https://github.com/MegEngine/MegFlow/pull/5
    • docs(Python): rewrite whl pack script by @tpoisonooo in https://github.com/MegEngine/MegFlow/pull/6
    • ci(build): action add macos by @tpoisonooo in https://github.com/MegEngine/MegFlow/pull/7
    • [DOCs] Fix link typo in README of electric_bicycle by @ysh329 in https://github.com/MegEngine/MegFlow/pull/8
    • Add logo by @tpoisonooo in https://github.com/MegEngine/MegFlow/pull/9
    • Update how-to-build-from-source.zh.md deal with Command 'cargo' not found by @kalcohol in https://github.com/MegEngine/MegFlow/pull/10
    • Update how-to-build-from-source.zh.md by @Easonzero in https://github.com/MegEngine/MegFlow/pull/11
    • Add tutorial 01 by @tpoisonooo in https://github.com/MegEngine/MegFlow/pull/12
    • docs(build): add build on win10 by @tpoisonooo in https://github.com/MegEngine/MegFlow/pull/13
    • Update doc by @tpoisonooo in https://github.com/MegEngine/MegFlow/pull/14
    • ci(docker): add tuna source by @tpoisonooo in https://github.com/MegEngine/MegFlow/pull/18
    • fix(build): add docker config by @tpoisonooo in https://github.com/MegEngine/MegFlow/pull/20
    • docs(project): add prebuilt .whl by @tpoisonooo in https://github.com/MegEngine/MegFlow/pull/21

    New Contributors

    • @ysh329 made their first contribution in https://github.com/MegEngine/MegFlow/pull/8
    • @kalcohol made their first contribution in https://github.com/MegEngine/MegFlow/pull/10
    • @Easonzero made their first contribution in https://github.com/MegEngine/MegFlow/pull/11

    Full Changelog: https://github.com/MegEngine/MegFlow/compare/v0.1.0-beta0...v0.1.0-beta1

    Source code(tar.gz)
    Source code(zip)
    megflow-0.1.0-py3.6-none-linux_x86_64.whl(39.93 MB)
    megflow-0.1.0-py3.7-none-linux_x86_64.whl(39.93 MB)
    megflow-0.1.0-py3.8-none-linux_x86_64.whl(39.93 MB)
  • v0.1.0-beta0(Sep 7, 2021)

    release beta

    | 系统 | 支持情况 | | - | - | | Windows 10 WSL ubuntu18.04 | ✔️ | | x86 Ubuntu16.04 有 GPU | ✔️ | | x86 Ubuntu18.04 无 GPU | ✔️ | | x86 macos | ✔️ |

    | Python 版本 | 支持情况 | | - | - | | 3.6 | ✔️ | | 3.7 | ✔️ | | 3.8 | ✔️ |

    初始化项目

    Rust 新增

    • toml 建图
    • 进程内子图共享、异常处理
    • 计算图性能统计接口
    • Image/Video Server
    • Python 共存

    Python 新增

    • 3 个 Examples
      • logical_test
      • cat_finder
      • MEMD
    • 1 个 github action、ubuntu 环境 Dockerfile
    • py3.6/3.7/3.8 版本 prebuilt 脚本

    New Contributors

    • @BBuf made their first contribution in https://github.com/MegEngine/MegFlow/pull/1

    Full Changelog: https://github.com/MegEngine/MegFlow/commits/v0.1.0-beta0

    Source code(tar.gz)
    Source code(zip)
Owner
旷视天元 MegEngine
旷视天元 MegEngine
Narwhal and Tusk A DAG-based Mempool and Efficient BFT Consensus.

This repo contains a prototype of Narwhal and Tusk. It supplements the paper Narwhal and Tusk: A DAG-based Mempool and Efficient BFT Consensus.

Facebook Research 134 Dec 8, 2022
HNSW ANN from the paper "Efficient and robust approximate nearest neighbor search using Hierarchical Navigable Small World graphs"

hnsw Hierarchical Navigable Small World Graph for fast ANN search Enable the serde feature to serialize and deserialize HNSW. Tips A good default for

Rust Computer Vision 93 Dec 30, 2022
A Rust🦀 implementation of CRAFTML, an Efficient Clustering-based Random Forest for Extreme Multi-label Learning

craftml-rs A Rust implementation of CRAFTML, an Efficient Clustering-based Random Forest for Extreme Multi-label Learning (Siblini et al., 2018). Perf

Tom Dong 15 Nov 6, 2022
🚀 efficient approximate nearest neighbor search algorithm collections library written in Rust 🦀 .

?? efficient approximate nearest neighbor search algorithm collections library written in Rust ?? .

Hora-Search 2.3k Jan 3, 2023
An efficient implementation of Partitioned Label Trees & its variations for extreme multi-label classification

Omikuji An efficient implementation of Partitioned Label Trees (Prabhu et al., 2018) and its variations for extreme multi-label classification, writte

Tom Dong 73 Nov 7, 2022
Efficient argmin & argmax (in 1 function)

ArgMinMax Efficient argmin & argmax (in 1 function) with SIMD (SSE, AVX(2), AVX512, NEON) for f16, f32, f64, i8, i16, i32, i64, u8, u16, u32, u64. ??

Jeroen Van Der Donckt 33 Feb 12, 2023
Easy c̵̰͠r̵̛̠ö̴̪s̶̩̒s̵̭̀-t̶̲͝h̶̯̚r̵̺͐e̷̖̽ḁ̴̍d̶̖̔ ȓ̵͙ė̶͎ḟ̴͙e̸̖͛r̶̖͗ë̶̱́ṉ̵̒ĉ̷̥e̷͚̍ s̷̹͌h̷̲̉a̵̭͋r̷̫̊ḭ̵̊n̷̬͂g̵̦̃ f̶̻̊ơ̵̜ṟ̸̈́ R̵̞̋ù̵̺s̷̖̅ţ̸͗!̸̼͋

Rust S̵̓i̸̓n̵̉ I̴n̴f̶e̸r̵n̷a̴l mutability! Howdy, friendly Rust developer! Ever had a value get m̵̯̅ð̶͊v̴̮̾ê̴̼͘d away right under your nose just when

null 294 Dec 23, 2022
Leetcode Solutions in Rust, Advent of Code Solutions in Rust and more

RUST GYM Rust Solutions Leetcode Solutions in Rust AdventOfCode Solutions in Rust This project demostrates how to create Data Structures and to implem

Larry Fantasy 635 Jan 3, 2023
👄 The most accurate natural language detection library in the Rust ecosystem, suitable for long and short text alike

Table of Contents What does this library do? Why does this library exist? Which languages are supported? How good is it? Why is it better than other l

Peter M. Stahl 569 Jan 3, 2023
argmax is a library that allows Rust applications to avoid Argument list too long errors (E2BIG) by providing a std::process::Command wrapper with a

argmax argmax is a library that allows Rust applications to avoid Argument list too long errors (E2BIG) by providing a std::process::Command wrapper w

David Peter 22 Nov 20, 2022
lingua-rs Python binding. An accurate natural language detection library, suitable for long and short text alike.

lingua-py lingua-rs Python binding. An accurate natural language detection library, suitable for long and short text alike. Installation pip install l

messense 7 Dec 30, 2022
🧠 A command-line utility for switching git branches more easily. Switch branches interactively or use a fuzzy search to find that long-forgotten branch name.

git-smart-checkout A git command extension for switching git branches more efficiently. About Interactively switch branches or fuzzy search for that f

Cezar Craciun 51 Dec 29, 2022
You have been an apprentice to a powerful sorcerer for as long as you can remember.

You have been an apprentice to a powerful sorcerer for as long as you can remember. However you dream of becoming a rancher, raising animals in your own pen.

null 3 Jun 22, 2022
My utils for long-lived, fault-tolerant rust tasks

Sisyphus Utilities for long-running, resilient tasks. This library contains code I wrote, found useful, and want to keep using. It aims to provide sys

James Prestwich 25 Dec 30, 2022
Is the GIL seeing someone else? How's about repetitively calling and seeing how long it takes to answer?

GIL Knocker pip install gilknocker When you thought the GIL was available, and you find yourself suspecting it might be spending time with another. Yo

Miles Granger 4 Jan 18, 2023
This Repo Contains my Week Long Journey Trying to Learn Rust Programming Language 🦀.

the-rust-way This Repo Contains my Week Long Journey Trying to Learn Rust Programming Language ?? . ?? Thanks to all Wonderful Contributors Thanks a l

Kanishk Pachauri 7 Oct 20, 2022
Ideas => Creations, a multi-language CMS(Content Management System) based on Rust Web stacks, with long-term upgrade and maintenance.

Ideas => Creations 中文 RustHub: Rust ideas yesterday, shining creations today! This repository holds source code used to run https://rusthub.org, it's

rusthub.org 4 May 9, 2023
Fast tool to scan for valid 7-long imgur ids for the ArchiveTeam imgur efforts (not affiliated or endorsed)

imgur_id7 Fast tool to scan for valid 7-long imgur ids for the ArchiveTeam imgur efforts (not affiliated or endorsed) Optionally uses supplied http pr

Robin Rolf 6 Jun 3, 2023
Tumour-only somatic mutation calling using long reads

smrest smrest is a prototype somatic mutation caller for single molecule long reads. It uses haplotype phasing patterns for tumour samples that have a

Jared Simpson 16 Mar 1, 2024
Radiate is a parallel genetic programming engine capable of evolving solutions to many problems as well as training learning algorithms.

Radiate Coming from Evolutionary Radiation. Evolutionary radiation is a rapid increase in the number of species with a common ancestor, characterized

kalivas 109 Dec 18, 2022