This is a script that scrapes the longitude and latitude on food.grab.com

Related tags

Web Crawlinggrab
Overview

grab

This is a script that scrapes the longitude and latitude for any restaurant in Manila on food.grab.com, location can be adjusted.

Search Result page

Preview

Prerequisites

  • Python
  • Selenium
  • Chrome Browser and Chrome Driver
  • VPN and the Browser extension for the VPN should be installed in your Chrome browser.
  • Beautiful Soup.
  • Change the driver path in the script to match yours.

Notes

  • Avoid making too many requests. There is a limit and a blocker for webscraping implemented by grab.com that's why you need to increase the timeout.
  • Vpn location can be any country in Asia.
  • Selenium is highly unstable, so at times you might get some errors. Do not fret :) just restart the script.
  • Running the driver as Headless strangely doesn't work properly because of the proxy problem and since i am using a vpn extension you need to use actual proxy addresses to get it working. So the GUI has to pop up. 👀
  • You can adjust the sliced_links depending on how many restaurants longitude and latitude you want to scrape.

Output

Number of pages loaded is  1
Number of pages loaded is  2
Number of pages loaded is  3
['https://food.grab.com/ph/en/restaurant/mcdonald-s-sta-cruz-church-delivery/AWiD5JwQfYWaYaQC4nY4', 'https://food.grab.com/ph/en/restaurant/greenwich-morayta-delivery/2-CYKTRUDUNNVAFE', 'https://food.grab.com/ph/en/restaurant/mang-inasal-morayta-delivery/2-CZDEV76BTREHKE', 'https://food.grab.com/ph/en/restaurant/wendy-s-dapitan-available-for-long-distance-delivery-delivery/PHGFSTI0000017w', 'https://food.grab.com/ph/en/restaurant/angel-s-pizza-legarda-available-for-long-distance-delivery-delivery/PHGFSTI000000zw', 'https://food.grab.com/ph/en/restaurant/jollibee-raon-delivery/2-CZC1EZEYACBTCX', 'https://food.grab.com/ph/en/restaurant/kfc-sta-cruz-delivery/2-CYUZC8BTGJ51GJ', 'https://food.grab.com/ph/en/restaurant/chowking-sta-cruz-manila-delivery/2-CYMHN7DWAGL2WE', 'https://food.grab.com/ph/en/restaurant/coco-fresh-tea-juice-grabkitchen-sampaloc-delivery/2-C2DDLZNZVTV2TA', 'https://food.grab.com/ph/en/restaurant/subway-medical-center-manila-available-for-long-distance-delivery-delivery/PHGFSTI000003e8', 'https://food.grab.com/ph/en/restaurant/yellow-cab-pizza-espana-available-for-long-distance-delivery-delivery/2-CYKCVZNZJTDFLE', 'https://food.grab.com/ph/en/restaurant/three-j-lugawan-earnshaw-street-available-for-long-distance-delivery-delivery/2-C2JTJFEKWCKZLE', 'https://food.grab.com/ph/en/restaurant/army-navy-burger-burrito-ust-dapitan-available-for-long-distance-delivery-delivery/PHGFSTI000000ym', 'https://food.grab.com/ph/en/restaurant/kenny-rogers-roasters-manila-delco-available-for-long-distance-delivery-delivery/2-CYMFVAK2CU5KN6', 'https://food.grab.com/ph/en/restaurant/zark-s-burgers-ust-available-for-long-distance-delivery-delivery/2-C2VZMEUEPGADDA', 'https://food.grab.com/ph/en/restaurant/happilee-korean-kitchen-grabkitchen-sampaloc-available-for-long-distance-delivery-delivery/2-C2JECYXXKF2ATA', 'https://food.grab.com/ph/en/restaurant/boodle-inasal-x-happy-thirstday-sampaloc-available-for-long-distance-delivery-delivery/2-C2J3BF3DSA2YRX', 'https://food.grab.com/ph/en/restaurant/pares-kimchi-intramuros-available-for-long-distance-delivery-delivery/2-CZNKLEUUMBTHCA', 'https://food.grab.com/ph/en/restaurant/something-healthy-ust-available-for-long-distance-delivery-delivery/2-CYVGEUCHNF3ZJN', 'https://food.grab.com/ph/en/restaurant/shakey-s-pizza-espana-delivery/2-CYK2GKKXEKTULJ', 'https://food.grab.com/ph/en/restaurant/papa-john-s-pizza-tri-loyola-building-available-for-long-distance-delivery-delivery/2-CYTZE7BTVVEVDA', 'https://food.grab.com/ph/en/restaurant/pizza-hut-cm-recto-available-for-long-distance-delivery-delivery/2-CYLCMEJHCNTCGJ', 'https://food.grab.com/ph/en/restaurant/macao-imperial-tea-pacific-suites-delivery/PHGFSTI000003fv', 'https://food.grab.com/ph/en/restaurant/turks-recto-delivery/2-CYUJJNU2N6KFTA', 'https://food.grab.com/ph/en/restaurant/serenitea-ust-lacson-available-for-long-distance-delivery-delivery/2-CZJTAAXDGEJABA', 'https://food.grab.com/ph/en/restaurant/food-house-by-madla-ust-delivery/2-CZKJC241LXA1TN', 'https://food.grab.com/ph/en/restaurant/mister-kabab-grabkitchen-sampaloc-available-for-long-distance-delivery-delivery/2-C2JEE7UARFJYEN', 'https://food.grab.com/ph/en/restaurant/grabkitchen-mix-and-match-sampaloc-available-for-long-distance-delivery-delivery/2-C2JTEVCUFFAYA6', 'https://food.grab.com/ph/en/restaurant/dosirakuya-korean-street-food-tondo-available-for-long-distance-delivery-delivery/2-C2MEPBJBLYU2DA', 'https://food.grab.com/ph/en/restaurant/tutong-s-laksa-sampaloc-available-for-long-distance-delivery-delivery/2-C23URRLCNJUTVT', 'https://food.grab.com/ph/en/restaurant/i-love-milktea-tayuman-delivery/2-C2TKT3DVJYUELX', 'https://food.grab.com/ph/en/restaurant/erlinda-s-foodhouse-loyola-street-delivery/2-C2WCFGMANYXTAA', 'https://food.grab.com/ph/en/restaurant/big-scoop-p-guevarra-st-delivery/2-C2UWRYJBTX4JSE', 'https://food.grab.com/ph/en/restaurant/mipanda-milk-tea-hub-lacson-available-for-long-distance-delivery-delivery/2-C2MUNFEKGYAHET', 'https://food.grab.com/ph/en/restaurant/caution-bistro-manila-available-for-long-distance-delivery-delivery/2-C2WFT2UYEUBDCX', 'https://food.grab.com/ph/en/restaurant/24-7-wings-ust-available-for-long-distance-delivery-delivery/2-CYUYBF42AU5ELJ', 'https://food.grab.com/ph/en/restaurant/baliwag-lechon-manok-laong-laan-manila-available-for-long-distance-delivery-delivery/2-C2CGNKTYGA4ZL6', 'https://food.grab.com/ph/en/restaurant/hong-kong-noodles-dimsum-house-quiapo-available-for-long-distance-delivery-delivery/PHGFSTI000001d8', 'https://food.grab.com/ph/en/restaurant/selecta-ice-cream-shop-sta-cruz-delivery/2-CYWFLCNBKFCZJJ', 'https://food.grab.com/ph/en/restaurant/starbucks-puerta-de-isabel-ii-delivery/2-CY42TKKBTKM3LE']
You have scraped 40 links
{'latitude': 14.599870428571428, 'longitude': 120.9797005}
{'latitude': 14.605052185873603, 'longitude': 120.98803399294457}
{'latitude': 14.605344959550562, 'longitude': 120.9881068}
{'latitude': 14.611880266666667, 'longitude': 120.9884545}
{'latitude': 14.599262918622557, 'longitude': 120.9900343411054}
{'latitude': 14.6007231, 'longitude': 120.98439648}
{'latitude': 14.599968222336393, 'longitude': 120.98002192}
{'latitude': 14.599834675, 'longitude': 120.980555425}
Scraping Top Repositories for Topics on GitHub,

0.-Webscrapping-using-python Scraping Top Repositories for Topics on GitHub, Web scraping is the process of extracting and parsing data from websites

Dev Aravind D Satprem 2 Mar 18, 2022
Async Python 3.6+ web scraping micro-framework based on asyncio

Ruia 🕸️ Async Python 3.6+ web scraping micro-framework based on asyncio. ⚡ Write less, run faster. Overview Ruia is an async web scraping micro-frame

howie.hu 1.6k Jan 01, 2023
Scrapy uses Request and Response objects for crawling web sites.

Requests and Responses¶ Scrapy uses Request and Response objects for crawling web sites. Typically, Request objects are generated in the spiders and p

Md Rashidul Islam 1 Nov 03, 2021
Distributed Crawler Management Framework Based on Scrapy, Scrapyd, Django and Vue.js

Gerapy Distributed Crawler Management Framework Based on Scrapy, Scrapyd, Scrapyd-Client, Scrapyd-API, Django and Vue.js. Documentation Documentation

Gerapy 2.9k Jan 03, 2023
A Python Oriented tool to Scrap WhatsApp Group Link using Google Dork it Scraps Whatsapp Group Links From Google Results And Gives Working Links.

WaGpScraper A Python Oriented tool to Scrap WhatsApp Group Link using Google Dork it Scraps Whatsapp Group Links From Google Results And Gives Working

Muhammed Rizad 27 Dec 18, 2022
ChromiumJniGenerator - Jni Generator module extracted from Chromium project

ChromiumJniGenerator - Jni Generator module extracted from Chromium project

allenxuan 4 Jun 12, 2022
Web Scraping Framework

Grab Framework Documentation Installation $ pip install -U grab See details about installing Grab on different platforms here http://docs.grablib.

2.3k Jan 04, 2023
A Scrapper with python

Scrapper-en-python Scrapper des données signifie récuperer des données pour les traiter ou les analyser. En python, il y'a 2 grands moyens de scrapper

Lun4rIum 1 Dec 05, 2021
Web-scraping - A bot using Python with BeautifulSoup that scraps IRS website by form number and returns the results as json

Web-scraping - A bot using Python with BeautifulSoup that scraps IRS website (prior form publication) by form number and returns the results as json. It provides the option to download pdfs over a ra

1 Jan 04, 2022
High available distributed ip proxy pool, powerd by Scrapy and Redis

高可用IP代理池 README | 中文文档 本项目所采集的IP资源都来自互联网,愿景是为大型爬虫项目提供一个高可用低延迟的高匿IP代理池。 项目亮点 代理来源丰富 代理抓取提取精准 代理校验严格合理 监控完备,鲁棒性强 架构灵活,便于扩展 各个组件分布式部署 快速开始 注意,代码请在release

SpiderClub 5.2k Jan 03, 2023
A web Scraper for CSrankings.com that scrapes University and Faculty list for a particular country

A look into what we're building Demo.mp4 Prerequisites Python 3 Node v16+ Steps to run Create a virtual environment. Activate the virtual environment.

2 Jun 06, 2022
Pelican plugin that adds site search capability

Search: A Plugin for Pelican This plugin generates an index for searching content on a Pelican-powered site. Why would you want this? Static sites are

22 Nov 21, 2022
Instagram_scrapper - This project allow you to scrape the list of followers, following or both from a public Instagram account, and create a csv or excel file easily.

Instagram_scrapper This project allow you to scrape the list of followers, following or both from a public Instagram account, and create a csv or exce

Lakhdar Belkharroubi 5 Oct 17, 2022
🥫 The simple, fast, and modern web scraping library

About gazpacho is a simple, fast, and modern web scraping library. The library is stable, actively maintained, and installed with zero dependencies. I

Max Humber 692 Dec 22, 2022
A Happy and lightweight Python Package that searches Google News RSS Feed and returns a usable JSON response and scrap complete article - No need to write scrappers for articles fetching anymore

GNews 🚩 A Happy and lightweight Python Package that searches Google News RSS Feed and returns a usable JSON response 🚩 As well as you can fetch full

Muhammad Abdullah 273 Dec 31, 2022
让中国用户使用git从github下载的速度提高1000倍!

序言 github上有很多好项目,但是国内用户连github却非常的慢.每次都要用插件或者其他工具来解决. 这次自己做一个小工具,输入github原地址后,就可以自动替换为代理地址,方便大家更快速的下载. 安装 pip install cit 主要功能与用法 主要功能 change 将目标地址转换为

35 Aug 29, 2022
This tool crawls a list of websites and download all PDF and office documents

This tool crawls a list of websites and download all PDF and office documents. Then it analyses the PDF documents and tries to detect accessibility issues.

AccessibilityLU 7 Sep 30, 2022
A web scraper for nomadlist.com, made to avoid website restrictions.

Gypsylist gypsylist.py is a web scraper for nomadlist.com, made to avoid website restrictions. nomadlist.com is a website with a lot of information fo

Alessio Greggi 5 Nov 24, 2022
Command line program to download documents from web portals.

command line document download made easy Highlights list available documents in json format or download them filter documents using string matching re

16 Dec 26, 2022
This Scrapy project uses Redis and Kafka to create a distributed on demand scraping cluster

This Scrapy project uses Redis and Kafka to create a distributed on demand scraping cluster.

IST Research 1.1k Jan 06, 2023