File size: 2,129 Bytes
00b69ac f8c25ab 00b69ac f8c25ab | 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 39 40 41 42 43 44 45 | ---
language:
- en
- zh
license: other
license_name: bilibili-model-use-license-agreement
license_link: https://github.com/ictnlp/FreezeEmpath/blob/main/licenses/IndexTTS2.txt
tags:
- speech
- audio-to-audio
- freezeempath
---
# IndexTTS2-derived waveform decoder for FreezeEmpath
This package converts FreezeEmpath speech tokens into 22,050 Hz mono waveforms, using components from [IndexTTS2](https://github.com/index-tts/index-tts), Amphion/MaskGCT, and NVIDIA BigVGAN.
[FreezeEmpath model](https://huggingface.co/ICTNLP/FreezeEmpath) · [Code and instructions](https://github.com/ictnlp/FreezeEmpath) · [Paper](https://arxiv.org/abs/2604.18159)
## Contents and use
- `config.yaml`: semantic codec and flow-matching configuration.
- `semantic_codec.safetensors`: semantic codec weights.
- `s2mel.pth`: flow-matching model weights.
- `bigvgan_generator.pt`: vocoder weights.
- `style.pt`, `prompt_condition.pt`, `ref_mel.pt`: fixed voice conditions used by the released example.
Use the FreezeEmpath GitHub code and its bundled BigVGAN architecture configuration:
```bash
python inference/codes2wav.py \
--cfg_path checkpoints/indextts2_codes2wav/config.yaml \
--model_dir checkpoints/indextts2_codes2wav \
--input_file outputs/answers.jsonl \
--output_dir outputs/wav --seed 42
```
The input must contain `prediction_units` speech tokens generated by `inference/infer.py --s2s`; this package is not a standalone text-to-speech interface. The example uses a fixed voice, not user-selected speaker prompts.
## License
This IndexTTS2-derived package is subject to the [bilibili Model Use License Agreement](https://github.com/ictnlp/FreezeEmpath/blob/main/licenses/IndexTTS2.txt). Individual BigVGAN and Amphion components retain their upstream MIT notices. See [third-party notices](https://github.com/ictnlp/FreezeEmpath/blob/main/THIRD_PARTY_NOTICES.md).
Any modifications made to the original model in this Derivative Work are not endorsed, warranted, or guaranteed by the original right-holder of the original model, and the original right-holder disclaims all liability related to this Derivative Work.
|