Tanzania News API

News API consisting various sources from Tanzania.

Fork the project

Clone the project

git clone https://github.com/<username>/news-api.git

cd news-api

Setup to run locally

Create virtual environment

py -m venv .venv

Activate virtual environment

• Windows

.venv/scripts/activate

• Bash

source .venv/bin/activate

Install required packages

Make sure you are in the right directory.

• cd scraper

pip install -r requirements.txt

Setup a MongoDB and provide a connection string

# .env

MONGO_DETAILS=mongodb://127.0.0.1:12707

Scrawl a particular website

ITV and Dar24 are sites with spiders available for now.

To scrape

scrapy crawl <spider-name>

Spider names

• ITV - itv
• Dar24 - dar24