#Amazon-web-scraper

This is a python program, which use scrapy python framework to crawl all pages of the product and scrap products data. This program scrap product data, such as price, discounted price and link to the product. And store each data into the sql database, for easily accessible.

#How to run the program.

To run this program, open the terminal on the program location

And type -

         1. cd amazonscraper
         2. scrapy crawl amazon -a product=laptops -O laptops.json
                       
                       #OR
                       
         1. cd amazonscraper
         2. scrapy crawl amazon -a product=laptops

Where '-a' is a argument and '-O' is the output file type.

#Method

In the first method, the products data are stored in database as well as in a json file.

And in the second method, the product data are stored only in the database.