7 Repositories
Rust morphological Libraries
Viterbi-based accelerated tokenizer (Python wrapper)
๐ python-vibrato ๐ค Vibrato is a fast implementation of tokenization (or morphological analysis) based on the Viterbi algorithm. This is a Python wra
20 Dec 29, 2022
๐ฅ Vaporetto is a fast and lightweight pointwise prediction based tokenizer. This is a Python wrapper for Vaporetto.
๐ python-vaporetto ๐ฅ Vaporetto is a fast and lightweight pointwise prediction based tokenizer. This is a Python wrapper for Vaporetto. Installation
17 Dec 22, 2022
An official Sudachi clone in Rust ๐ฆ
sudachi.rs - English README 2021-12-09 UPDATE: 0.6.2 Release Try it: pip install --update 'sudachipy=0.6.2' sudachi.rs is a Rust implementation of Su
175 Dec 30, 2022
Vaporetto: a fast and lightweight pointwise prediction based tokenizer
๐ฅ VAporetto: POintwise pREdicTion based TOkenizer Vaporetto is a fast and lightweight pointwise prediction based tokenizer. Overview This repository
184 Dec 22, 2022
A Japanese Morphological Analyzer written in pure Rust
Yoin - A Japanese Morphological Analyzer yoin is a Japanese morphological analyze engine written in pure Rust. mecab-ipadic is embedded in yoin. :) $
21 Apr 30, 2022
An official Sudachi clone in Rust (incomplete) ๐ฆ
2021-07-07 UPDATE: The official Sudachi team will take over this project (cf. ๆฅๆฌ่ชๅฝขๆ ็ด ่งฃๆๅจ SudachiPy ใฎ ็พ็ถใจไปๅพใซใคใใฆ - Speaker Deck) sudachi.rs An official S
173 Dec 29, 2022
A morphological analysis library.
Lindera A Japanese morphological analysis library in Rust. This project fork from fulmicoton's kuromoji-rs. Lindera aims to build a library which is e
240 Dec 27, 2022