๐ŸŒŠ ~ seaward is a crawler which searches for links or a specified word in a website.

Overview

๐ŸŒŠ seaward

crates.io

Installation

cargo install seaward

On NetBSD a pre-compiled binary is available from the official repositories. To install it, simply run:

pkgin install seaward

Overview

Seaward is used to discover every link on a web page (and its linked pages) without duplicates or to search for a word starting from the given URL.

If you want to save the links inside a file, you can run seaward <URL> --silent > file.txt, and if you experience many timeout errors try using a higher timeout with -t. With the -d 0 option you crawl only the web page passed in the <URL> parameter, with -d 1 also the pages linked to it (always within the same web site) and so on.

Usage

seaward -h

This will display every option.

seaward: 1.0.0

seaward is a crawler which searches for links or a specified word in a website.
Use -h for short descriptions and --help for more details.

Project home page: https://github.com/M3nny/seaward


Usage: seaward [OPTIONS] <URL>

Arguments:
  <URL>  Base url to start with.

Options:
  -w, --word <WORD>    Case insensitive word to search.
  -d, --depth <DEPTH>  Set how many times a link has to be followed.
      --silent         Display output only.
  -h, --help           Print help (see more with '--help')
  -V, --version        Print version

Timeout:
  -t, --timeout <TIMEOUT>  Set a request timeout in seconds (default: 3s).
      --warmup <WARMUP>    Set how many requests to make to find the best timeout automatically.

Examples

Example_url

Example_word

You might also like...
A word-guessing game from your terminal ๐ŸŸฉโฌ›๐ŸŸฉ๐ŸŸจ๐ŸŸฉ

Poodle Not a ๐Ÿฉ (Poodle), but a word-guessing game from your terminal ๐ŸŸฉ โฌ› ๐ŸŸฉ ๐ŸŸจ ๐ŸŸฉ Features โœ… In Rust ๐Ÿฆ€ โœ… Attempt logs โœ… Rules of the original game

try to find the correct word with only first letter and unknown letter count.

MOTUS Current dictionaries are provided in french and can contain some words not included in the official Motus dictionary. Additionally, dictionaries

This is a multilingual word learning software.
This is a multilingual word learning software.

Ladder This is a multilingual word learning software. How to add words to the software The project contains the words.json file, json contains learn a

๐Ÿ”ฅ ๐Ÿ“  (fwdt)
๐Ÿ”ฅ ๐Ÿ“ (fwdt) "few word do trick" is a cross platform manual fast logger

Few Word Do Trick (fwdt) Few Word Do Trick (fwdt) is a cross-platform general purpose fast logger for humans that supports incomplete csvs for a bette

Toki pona word look-up in the CLI
Toki pona word look-up in the CLI

seme toki pona word look-up in the CLI note the UCSUR are just a square for me because my font doesn't support them, but if yours does you should see

UpVent Website (Powered by Rust + Svelte & Fernet Branca).

UpVent Website Source Build Status Description This is the source code for the UpVent's website under upvent.codes. Development occurs on the master b

Use the osu!direct button on the osu! website to download beatmaps directly to osu
Use the osu!direct button on the osu! website to download beatmaps directly to osu

osum!direct-web Use the osu!direct button on the osu! website to download beatmaps directly to osu! - without osu! supporter. Badges Usage Run the app

Navigating around TUM with excellence โ€“ An API and website to search for rooms, buildings and other places
Navigating around TUM with excellence โ€“ An API and website to search for rooms, buildings and other places

NavigaTUM NavigaTUM is a non-official tool developed by students for students, that aims to help you get around at TUM. Feel free to contribute. Featu

๐Ÿ“ธ website screenshots as a service
๐Ÿ“ธ website screenshots as a service

website-screenshot ๐Ÿ“ธ website screenshots as a service Features ๐Ÿ’ซ powered by Rust ๐Ÿš€ blazing fast ๐Ÿ‘ฎ โ€โ€ built-in ratelimiter ๐Ÿ‘œ built-in storage prov

Comments
  • NetBSD package

    NetBSD package

    Hi,

    I've just packaged seaward for NetBSD and assigned myself as maintainer. I'm currently finishing a few updates but, will merge it into the main branch tonight.

    Please consider hosting Cargo.lock in the repository (included in this PR). We have a awk script that reads the lockfile and gathers all the dependency crates. Without the lockfile, I need to do this manually. Thanks!

    Evidence :)

    2023-07-13-204045_1366x768_scrot

    opened by 0323pin 2
Releases(1.0.1)
Owner
trying to debug my code...
null
A command-line utility which aligns a block of text within the terminal (or a specified number of columns), written in Rust.

align: a command line utility for aligning text. โญ Overview Aligns text within the terminal (or a specified number of columns). The text is treated as

Khalil Ouali 6 Aug 11, 2023
A CLI tool based on the crypto-crawler-rs library to crawl trade, level2, level3, ticker, funding rate, etc.

carbonbot A CLI tool based on the crypto-crawler-rs library to crawl trade, level2, level3, ticker, funding rate, etc. Run To quickly get started, cop

null 8 Dec 21, 2022
A lightweight async Web crawler in Rust, optimized for concurrent scraping while respecting `robots.txt` rules.

??๏ธ crawly A lightweight and efficient web crawler in Rust, optimized for concurrent scraping while respecting robots.txt rules. ?? Features Concurren

CrystalSoft 5 Aug 29, 2023
A small, memory efficient crawler written in Rust.

Atra - The smaller way to crawl !!This read me will we reworked in a few days. Currently I am working on a better version and a wiki for the config fi

Felix Engl 3 Mar 23, 2024
Lists Steam applications that have specified a Steam Play compatibility tool

proton-usage Lists Steam applications that have specified a Steam Play compatibility tool. Useful for when you want to remove/uninstall unused compati

Chris 10 Nov 13, 2022
CLI application to run clang-format on a set of files specified using globs in a JSON configuration file.

run_clang_format CLI application for running clang-format for an existing .clang-format file on a set of files, specified using globs in a .json confi

martin 6 Dec 16, 2022
CLI application to run clang-tidy on a set of files specified using globs in a JSON configuration file.

run-clang-tidy CLI application for running clang-tidy for an existing .clang-tidy file on a set of files, specified using globs in a .json configurati

martin 7 Nov 4, 2022
An interface for managing collections of labeled items and generating random subsets with specified restrictions

An interface for managing collections of labeled items and generating random subsets with specified restrictions

Kaio Vieira 3 Oct 30, 2022
Command-line HTTP client for sending a POST request to specified URI on each stdin line.

line2httppost Simple tool to read lines from stdin and post each line as separate POST request to a specified URL (TCP connection is reused though). G

Vitaly Shukela 3 Jan 3, 2023
A command-line tool to easily kill processes running on a specified port.

killport killport is a command-line utility for killing processes listening on specific ports. It's designed to be simple, fast, and effective. The to

Francisco Jimรฉnez Cabrera 6 Mar 29, 2023