LASAFT-Net-v2
Listen, Attend and Separate by Attentively aggregating Frequency Transformation
Woosung Choi, Yeong-Seok Jeong, Jinsung Kim, Jaehwa Chung, Soonyoung Jung, and Joshua D. Reiss
Demonstration (under construction)
Experimental Results
- Musdb 18
| model | vocals | drums | bass | other | AVG |
|---|---|---|---|---|---|
| Meta-TasNet | 6.40 | 5.91 | 5.58 | 4.19 | 5.52 |
| AMSS-Net | 6.78 | 5.92 | 5.10 | 4.51 | 5.58 |
| LaSAFT-Net-v1 | 7.33 | 5.68 | 5.63 | 4.87 | 5.88 |
| LASAFT-Net-v2 | 7.57 | 6.13 | 5.28 | 4.87 | 5.96 |
- MDX Challenge (Leaderboard A)
| model | model type | vocals | drums | bass | other | AVG |
|---|---|---|---|---|---|---|
| KUILAB-MDX-Net | dedicated (1 source/ 1 model) | 8.901 | 7.173 | 7.232 | 5.636 | 7.236 |
| LaSAFT-Net-v1 (light) | conditioned (4 sources/ 1 model) | 7.275 | 5.935 | 5.823 | 4.557 | 5.897 |
| LASAFT-Net-v2 (light) | conditioned (4 sources/ 1 model) | 7.324 | 5.976 | 5.884 | 4.642 | 5.957 |
How to reproduce
1. Environment
- Ubuntu 20.04
- wandb for logging
You must create .env file by copying .env.sample to set environmental variables.
wandb_api_key=[Your Key] # "xxxxxxxxxxxxxxxxxxxxxxxx"
data_dir=[Your Path] # "/home/ielab/repos/musdbHQ"
- about
wandb_api_key- we currently only support wandb for logging.
- for
wandb_api_key, visit wandb, go tosetting, and then copy your api key
- about
data_dir- the absolute path where datasets are stored
2. Installation (cuda)
conda env create -f environment.yaml -n lasaftv2
conda activate lasaftv2
pip install -r requirements.txt
4.9k Jan 03, 2023
30 Nov 28, 2022
96 Sep 15, 2022
21 Apr 09, 2022
189 Dec 02, 2022
442 Jan 04, 2023
13 Nov 07, 2022
1 Dec 01, 2021
9 Nov 04, 2022
49 Dec 29, 2022
62 Dec 30, 2022
36 Dec 24, 2022
165 Dec 21, 2022
174 Dec 27, 2022
31 Dec 27, 2022
19 Dec 15, 2022
65 Dec 22, 2022
14 Oct 31, 2022
11 Dec 12, 2022
123 Dec 23, 2022