Submit sbatch jobs without the need to create a script

Last update: Nov 23, 2022

Overview

ssubmit

Submit sbatch jobs without having to create a submission script

Motivation
Install
Usage

Motivation

This project is motivated by the fact that I want to just be able to submit commands as jobs and I don't want to fluff around with making a submission script.

ssubmit wraps that whole process and lets you live your best lyf #blessed.

Install

Precompiled binary

Run this little scriptlet or download for you system from the releases page.

VERSION="0.1.1"  # ssubmit version you want
OS=$(uname -s)                                                                                                       
if [ "$OS" = "Linux" ]; then                                                                                         
    triple="x86_64-unknown-linux-musl"                                                                              
elif [ "$OS" = "Darwin" ]; then                                                                                        
    triple="x86_64-apple-darwin"                                                         
else                                                      
    echo "ERROR: $OS not a recognised operating system"
fi              
if [ -n "$triple" ]; then   
    URL="https://github.com/mbhall88/ssubmit/releases/download/${VERSION}/ssubmit-${VERSION}-${triple}.tar.gz"
    wget "$URL" -O - | tar -xzf -
    ./ssubmit --help             
fi

Cargo

$ cargo install ssubmit

Build from source

$ git clone https://github.com/mbhall88/ssubmit.git
$ cd ssubmit
$ cargo build --release
$ target/release/ssubmit -h

Usage

Submit an rsync job named "foo" and request 350MB of memory and a one week time limit

$ ssubmit -m 350m -t 1w foo "rsync -az src/ dest/"

Submit a job that needs 8 CPUs

out.paf" -- -c 8">

$ ssubmit -m 16g -t 1d align "minimap2 -t 8 ref.fa query.fq > out.paf" -- -c 8

The basic anatomy of a ssubmit call is

ssubmit [OPTIONS] 
    
     [-- 
    
     ...]

NAME is the name of the job (the --job-name parameter in sbatch).

COMMAND is what you want to be executed by the job. It must be quoted (siungle or double).

REMAINDER is any (optional) sbatch-specific parameters you want to pass on. These must follow a -- after COMMAND.

Memory

Memory (-m,--mem) is intended to be a little more user-friendly than the sbatch --mem option. For example, you can pass -m 0.5g and ssubmit will interpret and convert this as 500M. However, -m 1.7G will be rounded up to 2G. One place where this option differs from sbatch is that if you don't give units, it will be interpreted as bytes - i.e., -m 1000 will be converted to 1K. Units are case insensitive.

Time

As with memory, time (-t,--time) is intended to be simple. If you want a time limit of three days, then just pass -t 3d. Want two and a half hours? Then -t 2h30m works. If you want to just use the default limit of your cluster, then just pass -t 0. You can also just pass the time format sbatch uses and this will be seamlessly passed on. For a full list of support time units, check out the duration-str repo.

Dry run

You can see what ssubmit would do without actually submitting a job using dry run (-n,--dry-run). This will print the sbatch command and also the submission script that would have been provided.

=====

You might also like...

Pass cloudflare IUAM using headless chrome without hassle.

FlarelessHeadlessChrome Pass cloudflare turnstile challenge using patched chrome binary (Windows/Linux x64). How it works Currently, with new headless

3 Oct 24, 2023

A boiler plate code to create dynamic link library in rust.

🔭 rust-dll-bp This is a boiler plate code that will be generated as a dll binary. I personally cache this here for me but if you're intend to create

9 Nov 7, 2022

Create That Project. Project Creation That Rocks 🎸🧱.

Create That Project Config Example Install $ cargo install ctp Basic Info In any file or even in the commands sections of your config file you can pla

5 Dec 20, 2021

📦 Crate Protocol allows anyone to create, manage, and trade a tokenized basket of assets, which we refer to as a Crate.

📦 Crate Protocol Crate Protocol allows anyone to create, manage, and trade a tokenized basket of assets, which we refer to as a Crate. A Crate is alw

63 Oct 31, 2022

🥳Yet another crate to create native nodejs addons :)

nodex Yet another crate to create native nodejs addons :) This crate aims to make creating native nodejs addons very easy and comfortable. It is in a

4 Mar 29, 2022

CLI to create redirections in CloudFlare to Zoom meetings.

boteco boteco is a CLI to create redirections in CloudFlare to Zoom meetings. Requirements CloudFlare page rules In the domain you want to use, you ne

3 Jan 3, 2023

This tool allows you to create the files needed for a Visual Studio project so that you can continue coding on a Mac for C++ with Visual Studio Code and then submit the Visual Studio project for Class Assignments

This tool allows you to create the files needed for a Visual Studio project so that you can continue coding on a Mac for C++ with Visual Studio Code and then submit the Visual Studio project for Class Assignments

3 Jan 18, 2023

ABQ is a universal test runner that runs test suites in parallel. It’s the best tool for splitting test suites into parallel jobs locally or on CI

🌐 abq.build 🐦 @rwx_research 💬 discord 📚 documentation ABQ is a universal test runner that runs test suites in parallel. It’s the best tool f

13 Apr 7, 2023

Obtain (wildcard) certificates from let's encrypt using dns-01 without the need for API access to your DNS provider.

Agnos Presentation Agnos is a single-binary program allowing you to easily obtain certificates (including wildcards) from Let's Encrypt using DNS-01 c

246 Dec 20, 2022

Cargo-BOJ: test and submit solutions to BOJ problems

Cargo-BOJ Test and submit solutions to BOJ (Baekjoon Online Judge) problems. Defaults are geared towards Rust solutions, but non-Rust usage is support

5 Apr 3, 2023

Utility for barcoderdev/unitypackage_godot, submit issues there.

unitypackage_util Requires barcoderdev/FBX2glTF to extract FBX in GLTF(glb) format. Place the binary in the same folder, or in PATH. Usage: unitypacka

4 May 25, 2023

Terminal UI for leetcode. Lets you browse questions through different topics. View, solve, run and submit questions from TUI.

Leetcode TUI Use Leetcode in your terminal. Why this TUI: My motivation for creating leetcode-tui stemmed from my preference for tools that are lightw

8 Aug 10, 2023

A simple script (in Rust lang) to create HTML from SVD

A simple script to create HTML from an SVD file This is a simple script written in Rust language to create a single HTML file from an SVD file. It's r

14 Aug 22, 2022

A Rust-based shell script to create a folder structure to use for a single class every semester. Mostly an excuse to use Rust.

A Rust Course Folder Shell Script PROJECT IN PROGRESS (Spring 2022) When completed, script will create a folder structure of the following schema: [ro

1 Apr 10, 2022

Everything you need to know about cross compiling Rust programs!

rust-cross Everything you need to know about cross compiling Rust programs! If you want to set up your Rust toolchain as a cross compiler, you have co

2.3k Jan 2, 2023

REST API server that abstracts the need to write CRUD methods by exposing a standardized API to interact with a Postgres database

Basiliq Exposing a Postgres database via a REST API that follows the JSON:API specs. All in all, a tasty API. What is Basiliq Quickstart Ready to use

54 Apr 21, 2022

Imagine the information security compliance guideline says you need an antivirus but you run Arch Linux

libredefender Imagine the information security compliance guideline says you need an antivirus but you run Arch Linux. libredefender is an antivirus p

83 Dec 26, 2022

Display a random Shiba from your terminal whenever you feel the need to. Because why not?

Shiba CLI Command-line interface (CLI) to display a random Shiba Inu whenever needed, by just running shiba on your terminal. How To Use • How Does It

17 Sep 25, 2022

Tells you how many years you need to wait until your subatomic xeon crystal synchronizer has doubled in plasma inversion efficiency on the Goldberg-Moleman scale or whatever.

about Tells you how many years you need to wait until your subatomic xeon crystal synchronizer has doubled in plasma inversion efficiency on the Goldb

2 Dec 3, 2021

Submit sbatch jobs without the need to create a script

Related tags

Overview

ssubmit

Motivation

Install

Precompiled binary

Cargo

Build from source

Usage

Memory

Time

Dry run

You might also like...

Pass cloudflare IUAM using headless chrome without hassle.

A boiler plate code to create dynamic link library in rust.

Create That Project. Project Creation That Rocks 🎸🧱.

📦 Crate Protocol allows anyone to create, manage, and trade a tokenized basket of assets, which we refer to as a Crate.

🥳Yet another crate to create native nodejs addons :)

CLI to create redirections in CloudFlare to Zoom meetings.

This tool allows you to create the files needed for a Visual Studio project so that you can continue coding on a Mac for C++ with Visual Studio Code and then submit the Visual Studio project for Class Assignments

ABQ is a universal test runner that runs test suites in parallel. It’s the best tool for splitting test suites into parallel jobs locally or on CI

Obtain (wildcard) certificates from let's encrypt using dns-01 without the need for API access to your DNS provider.

Cargo-BOJ: test and submit solutions to BOJ problems

Utility for barcoderdev/unitypackage_godot, submit issues there.

Terminal UI for leetcode. Lets you browse questions through different topics. View, solve, run and submit questions from TUI.

A simple script (in Rust lang) to create HTML from SVD

A Rust-based shell script to create a folder structure to use for a single class every semester. Mostly an excuse to use Rust.

Everything you need to know about cross compiling Rust programs!

REST API server that abstracts the need to write CRUD methods by exposing a standardized API to interact with a Postgres database

Imagine the information security compliance guideline says you need an antivirus but you run Arch Linux

Display a random Shiba from your terminal whenever you feel the need to. Because why not?

Tells you how many years you need to wait until your subatomic xeon crystal synchronizer has doubled in plasma inversion efficiency on the Goldberg-Moleman scale or whatever.

Releases(0.2.0)

0.2.0(Jul 7, 2022)

Changed

0.1.1(Jan 19, 2022)

Added

Owner

Michael Hall

Rust bindings for libjuice. Look at datachannel-rs if you need more batteries.

Quick templates script for codeforces contests.

A little command-line script written in Rust to interface with Discord webhooks.

dm-jitaux is a Rust-based JIT compiler using modified auxtools, dmasm and Inkwell LLVM wrapper for boosting Byond DM performance without any hassle!

A tiny crate mimicking Elixir's pipe operator for Rust without macros.

Build fast, reward everyone, and scale without friction.

proc macros for generating mut and non-mut methods without duplicating code

Allow raw pointer access without those pesky unsafe blocks everywhere!

HTTP microservice using Axum and Reqwest to request the Google Translate TTS endpoint without rate limits

Expand threaded messages without "Also sent to the channel"