RusTTS is an unofficial Coqui TTS implementation

Related tags

Miscellaneous rustts
Overview

RusTTS

RusTTS is an unofficial Coqui TTS implementation.

Currently, only the YourTTS for VC has been implemented.

So, feel free to contribute us to make it better.

Milestones

  • YourTTS + TTS
  • YourTTS + VC

Import from Pretrained Models

Currently, only the YourTTS for VC has been implemented.

YourTTS + VC

import os
import torch

# Create a model directory
os.makedirs('assets/', exist_ok=True)

# Load the pretrained models & variables
# NOTE: use the variables from `YourTTS_zeroshot_VC_demo.ipynb`
# NOTE: https://github.com/edresson/yourtts#colab-demos
SE_speaker_manager = ...
model = ...

driving_spec = ...
y_lengths = ...
driving_emb = ...
target_emb = ...

# Convert the pretrained model of speaker_encoder
# NOTE: Please mark ResNetSpeakerEncoder::l2_norm => true
model_speaker_encoder = torch.jit.trace(
    SE_speaker_manager.speaker_encoder,
    torch.randn(1, 129150),  # dummy
)
model_speaker_encoder.save('assets/speaker_encoder.pt')

# Convert the pretrained model of Vits (YourTTS)
class VoiceConversion(nn.Module):
    def __init__(self, model):
        super().__init__()
        self.model = model
        
    def forward(self, *args):
        return self.model.voice_conversion(*args)

model_voice_conversion = VoiceConversion(model)
model_voice_conversion = torch.jit.trace(
    model_voice_conversion,
    (driving_spec, y_lengths, driving_emb, target_emb,),  # maybe dummy
)
model_voice_conversion.save('assets/vits.pt')
You might also like...
An implementation of Joker Calculus in Rust

Joker Calculus An implementation of Joker Calculus in Rust Based on paper Joker Calculus, by Daniel Fischer, William Alexander Morris and Sven Nilsen

A language server implementation for the WGSL shading language

wgsl-analyzer wgsl-analyzer is a language server plugin for the WGSL Shading language. It comes with a VS Code plugin located in ./editors/code, but d

dustls, a pure-rust DTLS implementation

dustls, a pure-rust DTLS implementation A DTLSv1.2 implementation in Rust, reusing rustls for cryptographic primitives and most message payload format

Default implementation of the Wayland protocol for use with wl

Wayland An implementation of core Wayland interfaces and convenience functions for accelerating the development of Wayland clients and servers using t

Mild RSA implementation written in Rust for a class.

rust_rsa About this repo This is my Rust implementation of the RSA encryption standard, based on this book. This is for my CS 3000 - Advanced Algorith

A clean implementation of Reso using Rust.

A clean implementation of Reso using Rust. The principle of Reso Rust is almost identical to Reso, only missing some functionality

An experimental implementation of gitbom in Rust

gitbom-rs "An experimental implementation of GitBOM in Rust" NOTICE: This project is still a work in progress and is not ready for any use beyond expe

An implementation of Code Generation and Factoring for Fast Evaluation of Low-order Spherical Harmonic Products and Squares

sh_product An implementation of Code Generation and Factoring for Fast Evaluation of Low-order Spherical Harmonic Products and Squares (paper by John

Rust implementation for parsing StarCraft .chk files.

bwmap Rust implementation for parsing StarCraft .chk files. bounding.net uses this library to parse StarCraft and StarCraft: Brood War maps and store

Comments
  • Running the example uses up all available memory until killed by the system

    Running the example uses up all available memory until killed by the system

    Hi, when I try to run the example (cargo run --example tts -- "Hello Mr. my yesterday"), the process eats up all available memory on my system (~10 GB) and then is killed by system. Is this a bug or do I just don’t have enough RAM? :) I’m on Arch Linux, kernel version 5.16.11, Rust 1.59.

    opened by knochenhans 4
  • Question about usage

    Question about usage

    well this might be a stupid question but why do I get a male voice when I replace the english woman's samples with the one from Coqui TTS - Double Decoder Consistency v2 Samples. just the samples downloaded from the sample page here https://erogol.github.io/ddc-samples/

    :)

    opened by The-Mr-L 14
Owner
Ho Kim
✈️ U can fly higher
Ho Kim
HTTP microservice using Axum and Reqwest to request the Google Translate TTS endpoint without rate limits

HTTP microservice using Axum and Reqwest to request the Google Translate TTS endpoint without rate limits

Gnome! 5 Oct 5, 2022
Unofficial Bitwarden compatible server written in Rust, formerly known as bitwarden_rs

Alternative implementation of the Bitwarden server API written in Rust and compatible with upstream Bitwarden clients*, perfect for self-hosted deploy

Daniel García 21.5k Jan 8, 2023
[Unofficial] Azure SDK for Rust

[Unofficial] Azure SDK for Rust This repository is for the development of the unofficial Azure SDK for Rust. It is unofficial because it is not yet su

Microsoft Azure 390 Dec 30, 2022
An (unofficial) Rust library for querying db-ip.com data

db_ip An (unofficial) library for querying db-ip.com CSV databases in safe Rust. This library is not affiliated with or endorsed by db-ip.com. Be advi

Finn Bear 4 Dec 2, 2022
Unofficial python bindings for the rust llm library. 🐍❤️🦀

llm-rs-python: Python Bindings for Rust's llm Library Welcome to llm-rs, an unofficial Python interface for the Rust-based llm library, made possible

Lukas Kreussel 7 May 20, 2023
unFlow is a Design as Code implementation, a DSL for UX & backend modeling. DSL to Sketch file, Sketch to DSL, DSL to code.

unflow 是一个低代码、无代码设计语言。unFlow is a Design as Code implementation, a DSL for UX & backend modeling. DSL to Sketch file, Sketch to DSL, DSL to code.

Inherd OS Team (硬核开源小组) 70 Nov 27, 2022
The official rust implementation of the SpamProtectionBot API

SpamProtection-rs Table of contents About Supported Rust version Features How to use Credits License About SpamProtection-Rust is a Rust wrapper for I

Intellivoid 0 Feb 26, 2022
RusTiny -- A Rust implementation of Tiny+ language

RusTiny -- A Rust implementation of Tiny+ language 编译器实践 基本要求: 参考《编译原理及实践》的TINY语言编译器(已上传到群中)完成TINY+ 语言(见附录 A)的解释器:即给定满足 TINY+语言的源代码输入,你的解 释器可以给出对其的解释执

M4tsuri 2 May 22, 2022
kindly is a simple Rust implementation of a set-user-ID-root program, similar to sudo but in a much reduced way.

kindly is a simple Rust implementation of a set-user-ID-root program, similar to sudo but in a much reduced way.

Vinícius Miguel 26 Dec 5, 2022
A minimal RedDSA implementation for use in Zebra and zcashd.

A minimal RedDSA implementation for use in Zcash. Two specializations of RedDSA are used in Zcash: RedJubjub and RedPallas. For each of these, two par

Zcash Foundation 3 Jul 30, 2022