8 Repositories
Rust robots Libraries
A lightweight async Web crawler in Rust, optimized for concurrent scraping while respecting `robots.txt` rules.
🕷️ crawly A lightweight and efficient web crawler in Rust, optimized for concurrent scraping while respecting robots.txt rules. 🚀 Features Concurren
5 Aug 29, 2023
A simple command line tool which quickly audits the Disallow entries of a site's robots.txt.
Domo Arigato A simple command line tool which quickly audits the Disallow entries of a site's robots.txt. Disallow entries can be used to stop search
20 Apr 17, 2023
Rust implementation of behavior trees.
Bonsai 盆栽 Rust implementation of Behavior Trees Contents Quick intro to Behavior Trees Concepts Examples Development Guide Kanban Board Honorable Ment
119 Dec 27, 2022
Texting Robots: A Rust native `robots.txt` parser with thorough unit testing
Texting Robots Crate texting_robots is a library for parsing robots.txt files. A key design goal of this crate is to have a thorough test suite tested
20 Aug 17, 2022
rbdt is a python library (written in rust) for parsing robots.txt files for large scale batch processing.
rbdt 🚨 🚨 🚨 🚨 rbdt is a work in progress, currently being extracted out of another (private) project for the purpose of open sourcing and better so
0 Nov 9, 2021
Build controllers for the Webots robot simulator in Rust
Webots controllers in Rust Status: experimental This is a reference project that shows how to build controllers for the Webots robot simulator using t
14 Oct 11, 2022
Open-source Autonomy Software in Rust-lang with gRPC for the Roomba series robot vacuum cleaners
CleanIt Open-source Autonomy Software in Rust-lang with gRPC for the Roomba series robot vacuum cleaners Motivation Motivation is to build a complete
216 Dec 13, 2022
A native Rust port of Google's robots.txt parser and matcher C++ library.
robotstxt A native Rust port of Google's robots.txt parser and matcher C++ library. Native Rust port, no third-part crate dependency Zero unsafe code
72 Dec 11, 2022