EasyReader
The main goal of this library is to allow long navigations through the lines of large files, freely moving forwards and backwards or getting random lines without having to consume an iterator.
Currently with Rust's standard library is possible to read a file line by line only through Lines (https://doc.rust-lang.org/std/io/trait.BufRead.html#method.lines), with which is impossible (or very expensive) to read backwards and to get random lines. Also, being an iterator, every line that has already been read is consumed and to get back to the same line you need to reinstantiate the reader and consume all the lines until the desired one (eg. in the case of the last line, all).
Notes:
EasyReader by default does not generate an index, it just searches for line terminators from time to time, this allows it to be used with very large files without "startup" times and excessive RAM consumption. However, the lack of an index makes the reading slower and does not allow to take random lines with a perfect distribution, for these reasons there's a method to generate it; the start time will be slower, but all the following readings will use it and will therefore be faster (excluding the index build time, reading times are a bit longer but still comparable to those of a sequential forward reading through Lines) and in the random reading case the lines will be taken with a perfect distribution. By the way, it's not advisable to generate the index for very large files, as an excessive RAM consumption could occur.
Example: basic usage
use easy_reader::EasyReader;
use std::{
fs::File,
io::{
self,
Error
}
};
fn easy() -> Result<(), Error> {
let file = File::open("resources/test-file-lf")?;
let mut reader = EasyReader::new(file)?;
// Generate index (optional)
reader.build_index();
// Move through the lines
println!("First line: {}", reader.next_line()?.unwrap());
println!("Second line: {}", reader.next_line()?.unwrap());
println!("First line: {}", reader.prev_line()?.unwrap());
println!("Random line: {}", reader.random_line()?.unwrap());
// Iteration through the entire file (reverse)
reader.eof();
while let Some(line) = reader.prev_line()? {
println!("{}", line);
}
// You can always start/restart reading from the end of file (EOF)
reader.eof();
println!("Last line: {}", reader.prev_line()?.unwrap());
// Or the begin of file (BOF)
reader.bof();
println!("First line: {}", reader.next_line()?.unwrap());
Ok(())
}
Example: read random lines endlessly
use easy_reader::EasyReader;
use std::{
fs::File,
io::{
self,
Error
}
};
fn easy() -> Result<(), Error> {
let file = File::open("resources/test-file-lf")?;
let mut reader = EasyReader::new(file)?;
// Generate index (optional)
reader.build_index();
loop {
println!("{}", reader.random_line()?.unwrap());
}
}
13.9k Jan 2, 2023
268 Dec 29, 2022
34 Dec 20, 2022
322 Dec 26, 2022
805 Dec 28, 2022
72 Dec 16, 2022
569 Jan 3, 2023
496 Jan 8, 2023
14 Sep 5, 2022
31 Dec 31, 2022
170 Dec 24, 2022
10 Apr 28, 2022
26 Dec 30, 2022
2 Jul 5, 2018
7 Mar 3, 2023
12 Jul 24, 2022
331 Dec 28, 2022
310 Dec 29, 2022
28 Dec 12, 2022