A list of Python Bots used to extract data from several websites. Data extraction is for products on e-commerce (ecommerce) websites. Data fetched is such as the product images, title, price range, price, type of data etc. List of Website: https://www.qoovee.com/en/ https://merxu.com/en/ https://daraz.com/ https://www.nihaojewelry.com/ https://www.ecplaza.net/mask--product https://www.exportportal.com/ https://www.mallory.com/ https://www.townandcountryhardware.com/ https://www.like123.com/en/ https://www.ishopping.pk/ http://global.gmarket.co.kr/ https://shoptheglobe.co/ https://www.rannthai.com/ https://www.industrybuying.com/ https://www.ralali.com/ https://globaltradeplaza.com/ https://www.wholesalebox.in/ https://madeinindonesia.com/ https://dubaiyellowpagesonline.com/ https://www.qualitymill.com/ https://www.grainger.com/ https://www.abraa.com/ Python Libraries: Selenium, Beautiful Soup, Pandas, Scrapy, Requests, Urllib & Credentials etc. ___________________________________ This Project was based on a Python Internship Summer 2021 Dated: June-July 2021
A list of Python Bots used to extract data from several websites
Overview
Script for scrape user data like "id,username,fullname,followers,tweets .. etc" by Twitter's search engine .
TwitterScraper Script for scrape user data like "id,username,fullname,followers,tweets .. etc" by Twitter's search engine . Screenshot Data Users Only
19 Nov 17, 2022
Web Scraping Framework
Grab Framework Documentation Installation $ pip install -U grab See details about installing Grab on different platforms here http://docs.grablib.
2.3k Jan 04, 2023
Subscrape - A Python scraper for substrate chains
subscrape A Python scraper for substrate chains that uses Subscan. Usage copy co
14 Dec 15, 2022
This tool can be used to extract information from any website
WEB-INFO- This tool can be used to extract information from any website Install Termux and run the command --- $ apt-get update $ apt-get upgrade $ pk
1 Oct 24, 2021
A Pixiv web crawler module
Pixiv-spider A Pixiv spider module WARNING It's an unfinished work, browsing the code carefully before using it. Features 0004 - Readme.md updated, co
1 Nov 14, 2021
Ebay Webscraper for Getting Average Product Price
Ebay-Webscraper-for-Getting-Average-Product-Price The code in this repo is used to determine the average price of an item on Ebay given a valid search
17 Jan 05, 2023
tweet random sand cat pictures
sandcatbot setup pip3 install --user -r requirements.txt cp sandcatbot.example.conf sandcatbot.conf vim sandcatbot.conf running the first parameter i
8 Aug 07, 2022
The open-source web scrapers that feed the Los Angeles Times California coronavirus tracker.
The open-source web scrapers that feed the Los Angeles Times' California coronavirus tracker. Processed data ready for analysis is available at datade
51 Dec 14, 2022
mlscraper: Scrape data from HTML pages automatically with Machine Learning
🤖 Scrape data from HTML websites automatically with Machine Learning
798 Dec 29, 2022
A web crawler for recording posts in "sina weibo"
Web Crawler for "sina weibo" A web crawler for recording posts in "sina weibo" Introduction This script helps collect attributes of posts in "sina wei
4 Aug 20, 2022
Scrapes proxies and saves them to a text file
Proxy Scraper Scrapes proxies from https://proxyscrape.com and saves them to a file. Also has a customizable theme system Made by nell and Lamp
2 Dec 22, 2021
Simple proxy scraper made by using ProxyScrape's api.
What is Moon? Moon is a lightweight and fast proxy scraper made by using ProxyScrape's api. What can i do with this? You can use proxies for varietys
1 Jul 04, 2022
Examine.com supplement research scraper!
ExamineScraper Examine.com supplement research scraper! Why I want to be able to search pages for a specific term. For example, I want to be able to s
15 Dec 06, 2022
京东秒杀商品抢购Python脚本
Jd_Seckill 非常感谢原作者 https://github.com/zhou-xiaojun/jd_mask 提供的代码 也非常感谢 https://github.com/wlwwu/jd_maotai 进行的优化 主要功能 登陆京东商城（www.jd.com） cookies登录 (需要自
1.5k Jan 03, 2023
Consulta de CPF e CNPJ na Receita Federal com Web-Scraping
Repositório contendo scripts Python que realizam a consulta de CPF e CNPJ diretamente no site da Receita Federal.
5 Nov 29, 2021
A package designed to scrape data from Yahoo Finance.
yahoostock A package designed to scrape data from Yahoo Finance. Installation The most simple installation method is through PIP. pip install yahoosto
2 May 28, 2022
Scrap-mtg-top-8 - A top 8 mtg scraper using python
Scrap-mtg-top-8 - A top 8 mtg scraper using python
1 Jan 24, 2022
TikTok Username Swapper/Claimer/etc
TikTok-Turbo TikTok Username Swapper/Claimer/etc I wanted to create it as fast as possible but i eventually gave up and recoded it many many many many
12 Dec 19, 2022
Free-Game-Scraper is a useful script that allows you to track down free games and DLCs on many platforms.
Game Scraper Free-Game-Scraper is a useful script that allows you to track down free games and DLCs on many platforms. Join the discord About The Proj
2 Mar 28, 2022
Here I provide the source code for doing web scraping using the python library, it is Selenium.
Here I provide the source code for doing web scraping using the python library, it is Selenium.
1 Nov 13, 2021