---
license: mit
language:
- id
- en
library_name: pytorch
tags:
- audio-source-separation
- speech-separation
- convtasnet
- asteroid
- itera
datasets:
- librimix
- custom-indonesian-noisy-speech
metrics:
- si-sdr
base_model: JorisCos/ConvTasNet_Libri2Mix_sepnoisy_8k
pipeline_tag: audio-to-audio
---

## Fine-tuned model: [FransXav/ConvTasNet-IF-Itera-SepNoisy8k-FT](https://huggingface.co/FransXav/ConvTasNet-IF-Itera-SepNoisy8k-FT)

Model ini adalah versi *fine-tuned* dari [`JorisCos/ConvTasNet_Libri2Mix_sepnoisy_8k`](https://huggingface.co/JorisCos/ConvTasNet_Libri2Mix_sepnoisy_8k).

### Description:
Model ini di-*fine-tuning* oleh peneliti dari **Teknik Informatika, Institut Teknologi Sumatera (ITERA)**. Proses *fine-tuning* menggunakan skrip yang tersedia di [repositori GitHub proyek](https://github.com/fransiskus-121140010/itera-informatics-convtasnet-ft). Model dilatih pada dataset *custom* yang terdiri dari campuran audio vokal berbahasa Indonesia dengan beragam *noise*.

### Fine-tuning config:
```yaml
# Konfigurasi yang digunakan selama fine-tuning
data:
  root: "data/processed/"
  sample_rate: 8000
  segment_seconds: 4
  num_workers: 4

training:
  project_name: "itera-speech-separation-ft"
  model_name: "ConvTasNet-ITERA-FT" # Nama yang digunakan selama training
  epochs: 50
  batch_size: 8
  learning_rate: 0.0005
  gradient_clip_val: 0.5
  precision: "16-mixed"
  early_stopping_patience: 5

model:
  freeze_encoder_decoder: false

remix:
  dynamic: true
  snr_low: 0.0
  snr_high: 10.0
```

## Results

Evaluasi pada test set internal kami menunjukkan hasil sebagai berikut:
```yaml
si_sdr:
    baseline_score: -30.2842
    fine_tuned_score: -24.9016
    improvement: +5.3826
```

### License Notice

This work, "[NAMA_USERNAME_ANDA]/itera-informatics-convtasnet-ft", is a derivative of [`JorisCos/ConvTasNet_Libri2Mix_sepnoisy_8k`](https://huggingface.co/JorisCos/ConvTasNet_Libri2Mix_sepnoisy_8k). The original work is a derivative of:
> * [LibriSpeech ASR corpus](https://www.openslr.org/12) by Vassil Panayotov, used under [CC BY 4.0](https://creativecommons.org/licenses/by/4.0/);
> * The WSJ0 Hipster Ambient Mixtures dataset by [Whisper.ai](https://whisper.ai/), used under [CC BY-NC 4.0](https://creativecommons.org/licenses/by-nc/4.0/).
>
> The original work is licensed under [Attribution-ShareAlike 3.0 Unported](https://creativecommons.org/licenses/by-sa/3.0/) by Joris Cosentino.

This derivative work is licensed under the **[MIT License](https://opensource.org/licenses/MIT)** by the project authors at Institut Teknologi Sumatera.