QA Roberta Ru SaaS
Question answering on russian with XLMRobertaLarge as a service. Thanks for the model to Alexander Kaigorodov.
Stack
- Flask
- Gunicorn
Build image
sudo docker build . --tag qa-roberta-ru-saas
Run on CPU and predict
sudo docker run --rm -p 8080:8080 --name qa-roberta-ru-saas qa-roberta-ru-saas
curl -H "Content-Type: application/json" --data @tests/app/data/test_input.json 0.0.0.0:8080/predict
Run on GPU
Change device to cuda:0 in config before docker build:
device: cuda:0
After build:
sudo docker run --rm --gpus 0 -p 8080:8080 --name qa-roberta-ru-saas qa-roberta-ru-saas
To run with restart:
sudo docker run --gpus 0 -p 8080:8080 --restart always --name qa-roberta-ru-saas qa-roberta-ru-saas
To stop it later:
docker update --restart unless-stopped qa-roberta-ru-saas
To run tests:
pytest tests/
To run app without docker container
PYTHONPATH=. python app/app_main.py
TODO:
- GPU/CPU support
- Support of context longer than 512 bpe
- Predict on long context with sliding window
4 Aug 13, 2021
45 Jan 05, 2023
2.4k Dec 31, 2022
117 Dec 29, 2022
15 Dec 07, 2022
2 Jul 04, 2022
10 Sep 26, 2022
68 Dec 29, 2022
3 Jun 14, 2022
19 Dec 26, 2022
315 Nov 21, 2022
1.3k Dec 22, 2022
1 Jan 04, 2022
1.2k Dec 16, 2022
1.4k Jan 02, 2023
1 Jan 12, 2022
4 Jul 24, 2022
12 Oct 09, 2022
1.7k Dec 27, 2022
4 Dec 26, 2021