Natural Language Processing course resources
This github contains practical assignments for Natural Language Processing course by Higher School of Economics: https://www.coursera.org/learn/language-processing. In this course you will learn how to solve common NLP problems using classical and deep learning approaches.
From a practical side, we expect your familiarity with Python, since we will use it for all assignments in the course. Two of the assignments will also involve TensorFlow. You will work with many other libraries, including NLTK, Scikit-learn, and Gensim. You have several options on how to set it up.
1. Running on Google Colab
Google has released its own flavour of Jupyter called Colab, which has free GPUs!
Here's how you can use it:
- Open https://colab.research.google.com, click Sign in in the upper right corner, use your Google credentials to sign in.
- Click GITHUB tab, paste https://github.com/hse-aml/natural-language-processing and press Enter
- Choose the notebook you want to open, e.g. week1/week1-MultilabelClassification.ipynb
- Click File -> Save a copy in Drive... to save your progress in Google Drive
- If you need a GPU, click Runtime -> Change runtime type and select GPU in Hardware accelerator box
- Execute the following code in the first cell that downloads dependencies (change for your week number):
! wget https://raw.githubusercontent.com/hse-aml/natural-language-processing/master/setup_google_colab.py -O setup_google_colab.py
import setup_google_colab
# please, uncomment the week you're working on
# setup_google_colab.setup_week1()
# setup_google_colab.setup_week2()
# setup_google_colab.setup_week3()
# setup_google_colab.setup_week4()
# setup_google_colab.setup_project()
# setup_google_colab.setup_honor()
- If you run many notebooks on Colab, they can continue to eat up memory, you can kill them with
! pkill -9 python3and check with! nvidia-smithat GPU memory is freed.
Known issues:
- No support for
ipywidgets, so we cannot use fancytqdmprogress bars. For now, we use a simplified version of a progress bar suitable for Colab. - Blinking animation with
IPython.display.clear_output(). It's usable, but still looking for a workaround. - If you see an error "No module named 'common'", make sure you've uncommented the assignment-specific line in step 6, restart your kernel and execute all cells again
2. Running locally
Two options here:
-
Use the Docker container of our course. It already has all libraries, that you will need. The setup for you is very simple: install Docker application depending on your OS, download our container image, run everything within the container. Please, see this detailed Docker tutorial.
-
Manually install all the libraries depending on your OS (each task contains a list of needed libraries in the very beginning). If you use Windows/MacOS you might find useful Anaconda distribution which allows to install easily most of the needed libraries. However, some tools, like StarSpace for week 2, are not compatible with Windows, so it's likely that you will have to use Docker anyways, if you go for these tasks.
It might take a significant amount of time and resources to run the assignments code, but we expect that an average laptop is enough to accomplish the tasks. All assignments were tested in the Docker on Mac with 8GB RAM. If you have memory errors, that could be caused by not tested configurations or inefficient code. Consider reporting these cases or double-checking your code.
If you want to run the code of the course on the AWS machine, we've prepared the AWS tutorial here.
5.1k Jan 09, 2023
4.8k Dec 30, 2022
60 Dec 12, 2022
295 Jan 07, 2023
10 Apr 30, 2022
11 Sep 15, 2022
2 Nov 05, 2021
2 Oct 10, 2022
102 Dec 07, 2022
1 Jan 14, 2022
20 Apr 30, 2022
7 Jan 15, 2022
2 Jun 10, 2022
27 Dec 14, 2022
20 Jul 14, 2022
10 Jul 01, 2022
6.2k Dec 31, 2022
26 Sep 20, 2022
1 Jan 05, 2022
612 Jan 04, 2023