Another Async IO Framework based on io_uring

KuiBaDB

Last update: Oct 31, 2022

Related tags

Utilities rust async asyncio await async-await io-uring rust-async kuibadb

Overview

kbio, the Async IO Framework based on io_uring, is used in KuiBaDB to implement async io.

Features

Support multi-threading concurrent task submission.
Very Fast.
Implement AsyncRead/AsyncWrite trait introduced in tokio.

Examples

async fn read_body(stream: &mut Sock, content: &mut Vec<u8>) -> io::Result<()> {
    let len = stream.read_u32().await?;
    let msglen = len as usize - size_of::<u32>();
    content.reserve(msglen);
    unsafe {
        content.set_len(msglen);
    }
    stream.read_exact(content.as_mut_slice()).await?;
    return Ok(());
}

See examples in examples/ and the source code of KuiBaDB for more details.

Simple async codec for rkyv. Reuses streaming buffer for maximum speed

rkyv_codec Simple async codec for rkyv. Reuses streaming buffer for maximum speed! This crate provides a makeshift adaptor for streaming &ArchivedObj

19 Jun 14, 2022

You can name anonymous Future from async fn without dyn or Box!

rename-future You can name anonymous Future from async fn without dyn or Box! PLEASE READ THIS THIS PROJECT NOT YET WELL TESTED! DON'T USE THIS IN PRO

54 Sep 17, 2022

The most fundamental type for async synchronization: an intrusive linked list of futures

wait-list This crate provides WaitList, the most fundamental type for async synchronization. WaitList is implemented as an intrusive linked list of fu

7 Oct 26, 2022

Async variant of Tonic's `interceptor` function

Tonic Async Interceptor This crate contains AsyncInterceptor, an async variant of Tonic's Interceptor. Other than accepting an async interceptor funct

4 Dec 20, 2022

Use winit like the async runtime you've always wanted

async-winit Use winit like the async runtime you've always wanted. winit is actually asynchronous, contrary to popular belief; it's just not async. It

17 Apr 23, 2023

Rust library for one-time async initialization

async-lazy An async version of once_cell::sync::Lazy, std::sync::OnceLock or lazy_static. Uses tokio's sychronization primitives. This crate offers an

5 Jun 9, 2023

An efficient async condition variable for lock-free algorithms

async-event An efficient async condition variable for lock-free algorithms, a.k.a. "eventcount". Overview Eventcount-like primitives are useful to mak

3 Jul 10, 2023

🗑Async-dropper is probably the least-worst ad-hoc AysncDrop implementation you've seen so far.

🗑 async-dropper async-dropper is probably the least-worst ad-hoc AsyncDrop implementation you've seen, and it works in two ways: async_dropper::simpl

18 Aug 6, 2023

A safe sync/async multi-producer, multi-consumer channel

Loole A safe async/sync multi-producer multi-consumer channel. Producers can send and consumers can receive messages asynchronously or synchronously:

50 Oct 6, 2023

Comments

Integration with Tokio

After thinking about it, it's not a good practice to use kbio alone. In this case, Walker.Wake() occurs in kbio's own thread, and it needs a cross thread communication to submit task to Tokio runtime.

It is better to directly replace Tokio IO::driver from Mio to io-uring, in this way, IO tasks are directly submitted to the current thread. Iouring and wake() will also occur on the same thread. At this time, cross thread thread communication will generally only occur in the case of work steal.

opened by hidva 1

Remove the polling when there is no free slot

Curently we will keep polling when there is no free slot.

if let Some(slot) = future.uring.submit(sqe) {
    // ...
} else {
    // There is no free slot.
    // We expect that wake_by_ref() will put the task at tail of task queue.
    // But Tokio will put the task at "next task" slot, so it will run again immediately.
    cx.waker().wake_by_ref();
    return Poll::Pending;
}

I am working to remove the polling. I will save the waker in the free list when there is no slot, and invoke waker.wake() when others release the slot.

opened by hidva 0