Webservice wrapper for hhursev/recipe-scrapers (python library to scrape recipes from websites)

Overview

recipe-scrapers-webservice

This is a wrapper for hhursev/recipe-scrapers which provides the api as a webservice, to be consumed as a microservice by other languages.

Usage

docker compose

version: "2.1"
services:
  recipe-scrapers-webservice:
    image: ghcr.io/steve192/recipe-scrapers-webservice
    container_name: recipe-scrapers-webservice
    ports:
      - 9090:9090
    restart: unless-stopped

docker cli

    docker run -d \
        --name=recipe-scrapers-webservice \
        -p 9090:9090 \
        --restart unless-stopped \
        ghcr.io/steve192/recipe-scrapers-webservice

Routes

/api/v1/scrape-recipe?url=
responds with

{
	"author": "AuthorHere",
	"category": "CategoryHere",
	"cook_time": "100",
	"cuisine": "French",
	"host": "recipehost.com",
	"imgage": "https://recipehost.com/image-for-recipe.jpg",
	"ingredients": ["10 g Ingredients1", "20g Ingredients2"],
	"instructions": "Instructions to the recipe\nSeparated by newlines",
	"language": "de",
	"links": [],
	"nutrients": {
		"calories": "631 kcal",
		"carbohydrateContent": "69 g",
		"fatContent": "26 g",
		"proteinContent": "14 g",
		"saturatedFatContent": "6 g",
		"servingSize": "504",
		"sodiumContent": "2 g",
		"sugarContent": "5 g"
	},
	"prep_time": "",
	"ratings": "",
	"title": "Title to a delicious recipe",
	"total_time": 30,
	"yields": "2 serving(s)"
}
Comments
  • build(deps): update recipe-scrapers requirement from ~=14.6 to ~=14.25

    build(deps): update recipe-scrapers requirement from ~=14.6 to ~=14.25

    Updates the requirements on recipe-scrapers to permit the latest version.

    Release notes

    Sourced from recipe-scrapers's releases.

    14.25.0

    Adds support for:

    Thank you, @​brett @​NijeboerFrank!

    Commits
    • baf3403 Bump version to 14.25.0
    • 607ab04 Add Project Gezond scraper (Dutch Website) (#691)
    • 05a04a8 add sunset.com (#690)
    • 0967f5e Bump version to 14.24.0
    • f45155f Remove some outdated quirk/workaround handling code for schema.org data in mo...
    • e2bda68 Update amazingribs scraper (#688)
    • f278c94 tox: permit positional arguments when running 'unittest'-based unit tests (#686)
    • b95290c Add handletheheat.com (#680)
    • 3594e02 Add southerncastiron (#679)
    • d6e0fe7 pre-commit configuration: migrate source of flake8 from gitlab.com (no-longer...
    • Additional commits viewable in compare view

    Dependabot will resolve any conflicts with this PR as long as you don't alter it yourself. You can also trigger a rebase manually by commenting @dependabot rebase.


    Dependabot commands and options

    You can trigger Dependabot actions by commenting on this PR:

    • @dependabot rebase will rebase this PR
    • @dependabot recreate will recreate this PR, overwriting any edits that have been made to it
    • @dependabot merge will merge this PR after your CI passes on it
    • @dependabot squash and merge will squash and merge this PR after your CI passes on it
    • @dependabot cancel merge will cancel a previously requested merge and block automerging
    • @dependabot reopen will reopen this PR if it is closed
    • @dependabot close will close this PR and stop Dependabot recreating it. You can achieve the same result by closing it manually
    • @dependabot ignore this major version will close this PR and stop Dependabot creating any more for this major version (unless you reopen the PR or upgrade to it yourself)
    • @dependabot ignore this minor version will close this PR and stop Dependabot creating any more for this minor version (unless you reopen the PR or upgrade to it yourself)
    • @dependabot ignore this dependency will close this PR and stop Dependabot creating any more for this dependency (unless you reopen the PR or upgrade to it yourself)
    dependencies python 
    opened by dependabot[bot] 1
  • build(deps): update recipe-scrapers requirement from ~=14.6 to ~=14.24

    build(deps): update recipe-scrapers requirement from ~=14.6 to ~=14.24

    Updates the requirements on recipe-scrapers to permit the latest version.

    Release notes

    Sourced from recipe-scrapers's releases.

    14.24.0

    Adds support for:

    • #679 - southerncastiron.com
    • #680 - handletheheat.com

    Fixes:

    • #661 - TypeError on mob.co.uk
    • #687 - Site updates for amazingribs.com

    Credits: @​brett @​jayaddison

    Commits
    • 0967f5e Bump version to 14.24.0
    • f45155f Remove some outdated quirk/workaround handling code for schema.org data in mo...
    • e2bda68 Update amazingribs scraper (#688)
    • f278c94 tox: permit positional arguments when running 'unittest'-based unit tests (#686)
    • b95290c Add handletheheat.com (#680)
    • 3594e02 Add southerncastiron (#679)
    • d6e0fe7 pre-commit configuration: migrate source of flake8 from gitlab.com (no-longer...
    • c954e1a Bump version to 14.23.0
    • 05d51d7 Address the lecker and simplycookit scrapers issues.
    • 9a798ee added simplycookit scraper (#618)
    • Additional commits viewable in compare view

    Dependabot will resolve any conflicts with this PR as long as you don't alter it yourself. You can also trigger a rebase manually by commenting @dependabot rebase.


    Dependabot commands and options

    You can trigger Dependabot actions by commenting on this PR:

    • @dependabot rebase will rebase this PR
    • @dependabot recreate will recreate this PR, overwriting any edits that have been made to it
    • @dependabot merge will merge this PR after your CI passes on it
    • @dependabot squash and merge will squash and merge this PR after your CI passes on it
    • @dependabot cancel merge will cancel a previously requested merge and block automerging
    • @dependabot reopen will reopen this PR if it is closed
    • @dependabot close will close this PR and stop Dependabot recreating it. You can achieve the same result by closing it manually
    • @dependabot ignore this major version will close this PR and stop Dependabot creating any more for this major version (unless you reopen the PR or upgrade to it yourself)
    • @dependabot ignore this minor version will close this PR and stop Dependabot creating any more for this minor version (unless you reopen the PR or upgrade to it yourself)
    • @dependabot ignore this dependency will close this PR and stop Dependabot creating any more for this dependency (unless you reopen the PR or upgrade to it yourself)
    dependencies python 
    opened by dependabot[bot] 1
  • build(deps): bump alpine from 3.15 to 3.17.0

    build(deps): bump alpine from 3.15 to 3.17.0

    Bumps alpine from 3.15 to 3.17.0.

    Dependabot compatibility score

    Dependabot will resolve any conflicts with this PR as long as you don't alter it yourself. You can also trigger a rebase manually by commenting @dependabot rebase.


    Dependabot commands and options

    You can trigger Dependabot actions by commenting on this PR:

    • @dependabot rebase will rebase this PR
    • @dependabot recreate will recreate this PR, overwriting any edits that have been made to it
    • @dependabot merge will merge this PR after your CI passes on it
    • @dependabot squash and merge will squash and merge this PR after your CI passes on it
    • @dependabot cancel merge will cancel a previously requested merge and block automerging
    • @dependabot reopen will reopen this PR if it is closed
    • @dependabot close will close this PR and stop Dependabot recreating it. You can achieve the same result by closing it manually
    • @dependabot ignore this major version will close this PR and stop Dependabot creating any more for this major version (unless you reopen the PR or upgrade to it yourself)
    • @dependabot ignore this minor version will close this PR and stop Dependabot creating any more for this minor version (unless you reopen the PR or upgrade to it yourself)
    • @dependabot ignore this dependency will close this PR and stop Dependabot creating any more for this dependency (unless you reopen the PR or upgrade to it yourself)
    dependencies docker 
    opened by dependabot[bot] 1
  • build(deps): bump alpine from 3.15 to 3.16.3

    build(deps): bump alpine from 3.15 to 3.16.3

    Bumps alpine from 3.15 to 3.16.3.

    Dependabot compatibility score

    Dependabot will resolve any conflicts with this PR as long as you don't alter it yourself. You can also trigger a rebase manually by commenting @dependabot rebase.


    Dependabot commands and options

    You can trigger Dependabot actions by commenting on this PR:

    • @dependabot rebase will rebase this PR
    • @dependabot recreate will recreate this PR, overwriting any edits that have been made to it
    • @dependabot merge will merge this PR after your CI passes on it
    • @dependabot squash and merge will squash and merge this PR after your CI passes on it
    • @dependabot cancel merge will cancel a previously requested merge and block automerging
    • @dependabot reopen will reopen this PR if it is closed
    • @dependabot close will close this PR and stop Dependabot recreating it. You can achieve the same result by closing it manually
    • @dependabot ignore this major version will close this PR and stop Dependabot creating any more for this major version (unless you reopen the PR or upgrade to it yourself)
    • @dependabot ignore this minor version will close this PR and stop Dependabot creating any more for this minor version (unless you reopen the PR or upgrade to it yourself)
    • @dependabot ignore this dependency will close this PR and stop Dependabot creating any more for this dependency (unless you reopen the PR or upgrade to it yourself)
    dependencies docker 
    opened by dependabot[bot] 1
  • build(deps): update recipe-scrapers requirement from ~=14.6 to ~=14.23

    build(deps): update recipe-scrapers requirement from ~=14.6 to ~=14.23

    Updates the requirements on recipe-scrapers to permit the latest version.

    Release notes

    Sourced from recipe-scrapers's releases.

    14.23.0

    Adds support for:

    • creativecanning.com
    • lecker.de
    • simply-cookit.com

    Removes support for:

    • sallys-blog.de

    Updates a bunch of preexisting scrapers with #676.

    Creds @​vabene1111 @​hhursev

    Commits
    • c954e1a Bump version to 14.23.0
    • 05d51d7 Address the lecker and simplycookit scrapers issues.
    • 9a798ee added simplycookit scraper (#618)
    • 2e58592 Fix lecker.de articles (#611)
    • fa31236 Reduce the amount of wording in the GitHub 'new issue' templates (#651)
    • fa61cf2 System health. Scrapers needed polishing (#676)
    • 1582886 Exclude macos and win py 3.11 from matrix again
    • 628b375 Use Python 3.11 in CI. Run macos and win w/ python 3.11 - don't mark whole jo...
    • 1d07ae9 Update README and bump version
    • 954c5c6 Issue 646/scraper weightwatchers (#657)
    • Additional commits viewable in compare view

    Dependabot will resolve any conflicts with this PR as long as you don't alter it yourself. You can also trigger a rebase manually by commenting @dependabot rebase.


    Dependabot commands and options

    You can trigger Dependabot actions by commenting on this PR:

    • @dependabot rebase will rebase this PR
    • @dependabot recreate will recreate this PR, overwriting any edits that have been made to it
    • @dependabot merge will merge this PR after your CI passes on it
    • @dependabot squash and merge will squash and merge this PR after your CI passes on it
    • @dependabot cancel merge will cancel a previously requested merge and block automerging
    • @dependabot reopen will reopen this PR if it is closed
    • @dependabot close will close this PR and stop Dependabot recreating it. You can achieve the same result by closing it manually
    • @dependabot ignore this major version will close this PR and stop Dependabot creating any more for this major version (unless you reopen the PR or upgrade to it yourself)
    • @dependabot ignore this minor version will close this PR and stop Dependabot creating any more for this minor version (unless you reopen the PR or upgrade to it yourself)
    • @dependabot ignore this dependency will close this PR and stop Dependabot creating any more for this dependency (unless you reopen the PR or upgrade to it yourself)
    dependencies python 
    opened by dependabot[bot] 1
  • build(deps): update recipe-scrapers requirement from ~=14.6 to ~=14.21

    build(deps): update recipe-scrapers requirement from ~=14.6 to ~=14.21

    Updates the requirements on recipe-scrapers to permit the latest version.

    Release notes

    Sourced from recipe-scrapers's releases.

    14.21.0

    Housekeeping / development / maintenance release :broom:

    • Introduce tox as a standard mechanism to run isolated unit tests and linting workflows (#650)
    • Introduce pyproject.toml for project metadata (#655)
    • Remove the test_settings_module (#663)
    • Remove pytest and unittest-parallel development-time dependencies (#659, #660, 991b1d1784711bf1276ab74763e4e11c46649ee1)
    • Switch unit test scraper setup from per-test-method to per-test-case (#668)
    • Refactor the SchemaOrg parser (#671)
    • Fixup: incorrect start-URL in scraper test (b5f84adc0cfd2da2d645e43a321b39c7da10d4e8)

    This release should have little-to-no effect on usage of the library (it's intended to be backwards compatible) - however, bug / issue reports appreciated, as always!

    Commits
    • e23154a Bump version to 14.21.0
    • e7f7a90 Refactor: schema.org parser (#671)
    • 743d7cd Revert "Fixup: remove overwrite of schema.org data with 'mainEntity' contents...
    • aacd321 Modernization: introduce pyproject.toml for setuptools configuration (#655)
    • 2c3e0e8 Unit tests: move scraper construction from setUp (per-method) to setUpClass (...
    • b5f84ad Fixup: test-mode startURL for test_gousto
    • 557cfd9 Fixup: remove overwrite of schema.org data with 'mainEntity' contents during ...
    • d839b76 Cleanup: remove test_settings_module (#663)
    • 1526b32 Consolidate linting configuration (#662)
    • 991b1d1 Fixup / cleanup: remove unittest-parallel from tox.ini (related to f986c6ed6a...
    • Additional commits viewable in compare view

    Dependabot will resolve any conflicts with this PR as long as you don't alter it yourself. You can also trigger a rebase manually by commenting @dependabot rebase.


    Dependabot commands and options

    You can trigger Dependabot actions by commenting on this PR:

    • @dependabot rebase will rebase this PR
    • @dependabot recreate will recreate this PR, overwriting any edits that have been made to it
    • @dependabot merge will merge this PR after your CI passes on it
    • @dependabot squash and merge will squash and merge this PR after your CI passes on it
    • @dependabot cancel merge will cancel a previously requested merge and block automerging
    • @dependabot reopen will reopen this PR if it is closed
    • @dependabot close will close this PR and stop Dependabot recreating it. You can achieve the same result by closing it manually
    • @dependabot ignore this major version will close this PR and stop Dependabot creating any more for this major version (unless you reopen the PR or upgrade to it yourself)
    • @dependabot ignore this minor version will close this PR and stop Dependabot creating any more for this minor version (unless you reopen the PR or upgrade to it yourself)
    • @dependabot ignore this dependency will close this PR and stop Dependabot creating any more for this dependency (unless you reopen the PR or upgrade to it yourself)
    dependencies python 
    opened by dependabot[bot] 1
  • build(deps): update recipe-scrapers requirement from ~=14.6 to ~=14.20

    build(deps): update recipe-scrapers requirement from ~=14.6 to ~=14.20

    Updates the requirements on recipe-scrapers to permit the latest version.

    Release notes

    Sourced from recipe-scrapers's releases.

    14.20.0

    • Remove META_HTTP_EQUIV setting (#644)
    • Remove TEST_MODE setting (#645)
    • Remove 'v12-like' settings module (#653)
    • Add omnivores cookbook (#647)
    • Add maangchi (#656)
    • Fix justonecookbook (#649)

    Thank you, @​wengtad!

    Commits
    • 93de8af Bump version to 14.20.0
    • 90a507a feat: add maangchi (#656)
    • df71ec3 fix: incomplete justonecookbook (#649)
    • cc913ac feat: add omnivores cookbook (#647)
    • 89a0a67 Cleanup: remove 'v12-like' settings module (#653)
    • 9321d9a Cleanup: remove TEST_MODE setting (#645)
    • cf7870f Cleanup: remove META_HTTP_EQUIV setting (#644)
    • c250e06 Bump version to 14.19.0
    • 8553024 Continuous integration: re-enable coveralls test coverage upload (#637)
    • c074623 Ad-hoc solution for wrong ingredients amount in hellofresh when serving size ...
    • Additional commits viewable in compare view

    Dependabot will resolve any conflicts with this PR as long as you don't alter it yourself. You can also trigger a rebase manually by commenting @dependabot rebase.


    Dependabot commands and options

    You can trigger Dependabot actions by commenting on this PR:

    • @dependabot rebase will rebase this PR
    • @dependabot recreate will recreate this PR, overwriting any edits that have been made to it
    • @dependabot merge will merge this PR after your CI passes on it
    • @dependabot squash and merge will squash and merge this PR after your CI passes on it
    • @dependabot cancel merge will cancel a previously requested merge and block automerging
    • @dependabot reopen will reopen this PR if it is closed
    • @dependabot close will close this PR and stop Dependabot recreating it. You can achieve the same result by closing it manually
    • @dependabot ignore this major version will close this PR and stop Dependabot creating any more for this major version (unless you reopen the PR or upgrade to it yourself)
    • @dependabot ignore this minor version will close this PR and stop Dependabot creating any more for this minor version (unless you reopen the PR or upgrade to it yourself)
    • @dependabot ignore this dependency will close this PR and stop Dependabot creating any more for this dependency (unless you reopen the PR or upgrade to it yourself)
    dependencies python 
    opened by dependabot[bot] 1
  • build(deps): update recipe-scrapers requirement from ~=14.6 to ~=14.19

    build(deps): update recipe-scrapers requirement from ~=14.6 to ~=14.19

    Updates the requirements on recipe-scrapers to permit the latest version.

    Release notes

    Sourced from recipe-scrapers's releases.

    14.19.0

    Fixes Recipe-scraper does not return the correct amount of ingredients for Hellofresh

    Commits
    • c250e06 Bump version to 14.19.0
    • 8553024 Continuous integration: re-enable coveralls test coverage upload (#637)
    • c074623 Ad-hoc solution for wrong ingredients amount in hellofresh when serving size ...
    • f0d45d0 Bump version to 14.18.0
    • b02a25a Bump version to 14.17.2
    • 6093969 import from dataclasses (#642)
    • 4326635 Add LeanAndGreenRecipes (#636)
    • e1bfb74 feat: add rosanna pansino (#639)
    • f55e235 Maintenance: update bs4 string searches to use 'string' parameter instead of ...
    • 860fb89 Bump version to 14.17.1
    • Additional commits viewable in compare view

    Dependabot will resolve any conflicts with this PR as long as you don't alter it yourself. You can also trigger a rebase manually by commenting @dependabot rebase.


    Dependabot commands and options

    You can trigger Dependabot actions by commenting on this PR:

    • @dependabot rebase will rebase this PR
    • @dependabot recreate will recreate this PR, overwriting any edits that have been made to it
    • @dependabot merge will merge this PR after your CI passes on it
    • @dependabot squash and merge will squash and merge this PR after your CI passes on it
    • @dependabot cancel merge will cancel a previously requested merge and block automerging
    • @dependabot reopen will reopen this PR if it is closed
    • @dependabot close will close this PR and stop Dependabot recreating it. You can achieve the same result by closing it manually
    • @dependabot ignore this major version will close this PR and stop Dependabot creating any more for this major version (unless you reopen the PR or upgrade to it yourself)
    • @dependabot ignore this minor version will close this PR and stop Dependabot creating any more for this minor version (unless you reopen the PR or upgrade to it yourself)
    • @dependabot ignore this dependency will close this PR and stop Dependabot creating any more for this dependency (unless you reopen the PR or upgrade to it yourself)
    dependencies python 
    opened by dependabot[bot] 1
  • build(deps): update recipe-scrapers requirement from ~=14.6 to ~=14.17

    build(deps): update recipe-scrapers requirement from ~=14.6 to ~=14.17

    Updates the requirements on recipe-scrapers to permit the latest version.

    Release notes

    Sourced from recipe-scrapers's releases.

    14.17.0

    This probably should've been 14.16.1 now that I think about it (bugfixes only, no new scrapers) - oops. We've not always adhered to that I suppose.

    • reishunger.de: bugfixes and add support for multi-method recipes (#616)
    • Use isodate library to attempt ISO 8601 duration parsing in get_minutes (#610)
    • Fixup to run unit tests on MacOS and Windows in GitHub Actions (#629)
    • mypy: ignore type union-attr errors in scraper modules, to deal with false positives from BeautifulSoup's find return type (e33181aef48f0aac6740edbf96055f2fec6c8eb2)

    Thanks @​vabene1111 for the reishunger improvements!

    Commits
    • a95d8ac Bump version to 14.17.0
    • 753c054 Refactor: remove use of 'while' loop (#634)
    • 5c033fb reishunger.de: bugfixes and add support for multi-method recipes (#616)
    • f5c5ec1 Maintenance: update bs4 string searches to use 'string' parameter instead of ...
    • 401070d Workaround: install lxml from binary wheel when unit tests run on MacOS (#629)
    • e33181a Ignore union-attr mypy errors in scraper modules
    • 39fa50b Use isodate library to attempt ISO 8601 duration parsing in get_minutes (#610)
    • 754a316 Fixup for OS selection in GitHub Actions unittests workflow (#628)
    • 7d1cfad Bump version to 14.16.0
    • c477678 Fix ingredients for simplyrecipes.com scraper (#623)
    • Additional commits viewable in compare view

    Dependabot will resolve any conflicts with this PR as long as you don't alter it yourself. You can also trigger a rebase manually by commenting @dependabot rebase.


    Dependabot commands and options

    You can trigger Dependabot actions by commenting on this PR:

    • @dependabot rebase will rebase this PR
    • @dependabot recreate will recreate this PR, overwriting any edits that have been made to it
    • @dependabot merge will merge this PR after your CI passes on it
    • @dependabot squash and merge will squash and merge this PR after your CI passes on it
    • @dependabot cancel merge will cancel a previously requested merge and block automerging
    • @dependabot reopen will reopen this PR if it is closed
    • @dependabot close will close this PR and stop Dependabot recreating it. You can achieve the same result by closing it manually
    • @dependabot ignore this major version will close this PR and stop Dependabot creating any more for this major version (unless you reopen the PR or upgrade to it yourself)
    • @dependabot ignore this minor version will close this PR and stop Dependabot creating any more for this minor version (unless you reopen the PR or upgrade to it yourself)
    • @dependabot ignore this dependency will close this PR and stop Dependabot creating any more for this dependency (unless you reopen the PR or upgrade to it yourself)
    dependencies python 
    opened by dependabot[bot] 1
  • build(deps): update recipe-scrapers requirement from ~=14.6 to ~=14.16

    build(deps): update recipe-scrapers requirement from ~=14.6 to ~=14.16

    Updates the requirements on recipe-scrapers to permit the latest version.

    Release notes

    Sourced from recipe-scrapers's releases.

    14.16.0

    • Fix ingredients for simplyrecipes.com scraper (#623)
    • Simple Veganista scraper added (#626)

    Thanks, @​thomaspinder @​puradox!

    Commits

    Dependabot will resolve any conflicts with this PR as long as you don't alter it yourself. You can also trigger a rebase manually by commenting @dependabot rebase.


    Dependabot commands and options

    You can trigger Dependabot actions by commenting on this PR:

    • @dependabot rebase will rebase this PR
    • @dependabot recreate will recreate this PR, overwriting any edits that have been made to it
    • @dependabot merge will merge this PR after your CI passes on it
    • @dependabot squash and merge will squash and merge this PR after your CI passes on it
    • @dependabot cancel merge will cancel a previously requested merge and block automerging
    • @dependabot reopen will reopen this PR if it is closed
    • @dependabot close will close this PR and stop Dependabot recreating it. You can achieve the same result by closing it manually
    • @dependabot ignore this major version will close this PR and stop Dependabot creating any more for this major version (unless you reopen the PR or upgrade to it yourself)
    • @dependabot ignore this minor version will close this PR and stop Dependabot creating any more for this minor version (unless you reopen the PR or upgrade to it yourself)
    • @dependabot ignore this dependency will close this PR and stop Dependabot creating any more for this dependency (unless you reopen the PR or upgrade to it yourself)
    dependencies python 
    opened by dependabot[bot] 1
  • build(deps): update recipe-scrapers requirement from ~=14.6 to ~=14.14

    build(deps): update recipe-scrapers requirement from ~=14.6 to ~=14.14

    Updates the requirements on recipe-scrapers to permit the latest version.

    Release notes

    Sourced from recipe-scrapers's releases.

    14.14.0

    Adds support for:

    • owen-han.com (#599)

    Includes fixes for:

    • greatbritishchefs - ingredients in subheadings (#598)
    • mobkitchen - domain name matching (#600)

    Thanks @​ptoczko @​ephemer4l!

    Commits
    • 3a3d2fd Bump version to 14.14.0
    • 3a57112 Added owen-han.com (#599)
    • a52e91e Add updated domain name for MobKitchen scraper (#600)
    • 9ecaec3 greatbritishchefs: handle case where ingredients are in subheaders (#598)
    • 348abb2 Bump version to 14.13.0. Food.com updates
    • a97807b removed unused imports in food.com scraper (#591)
    • 998a3ad Run tests against python 3.11 too and bump setup-python version (#586)
    • 4b5a51f Bump version to 14.12.0
    • 908c8f2 Add support for ica.se (#584)
    • 796a35a Add support for coop.se (#583)
    • Additional commits viewable in compare view

    Dependabot will resolve any conflicts with this PR as long as you don't alter it yourself. You can also trigger a rebase manually by commenting @dependabot rebase.


    Dependabot commands and options

    You can trigger Dependabot actions by commenting on this PR:

    • @dependabot rebase will rebase this PR
    • @dependabot recreate will recreate this PR, overwriting any edits that have been made to it
    • @dependabot merge will merge this PR after your CI passes on it
    • @dependabot squash and merge will squash and merge this PR after your CI passes on it
    • @dependabot cancel merge will cancel a previously requested merge and block automerging
    • @dependabot reopen will reopen this PR if it is closed
    • @dependabot close will close this PR and stop Dependabot recreating it. You can achieve the same result by closing it manually
    • @dependabot ignore this major version will close this PR and stop Dependabot creating any more for this major version (unless you reopen the PR or upgrade to it yourself)
    • @dependabot ignore this minor version will close this PR and stop Dependabot creating any more for this minor version (unless you reopen the PR or upgrade to it yourself)
    • @dependabot ignore this dependency will close this PR and stop Dependabot creating any more for this dependency (unless you reopen the PR or upgrade to it yourself)
    dependencies python 
    opened by dependabot[bot] 1
  • build(deps): update recipe-scrapers requirement from ~=14.6 to ~=14.26

    build(deps): update recipe-scrapers requirement from ~=14.6 to ~=14.26

    Updates the requirements on recipe-scrapers to permit the latest version.

    Release notes

    Sourced from recipe-scrapers's releases.

    14.26.0

    Adds support for:

    • briceletbaklava.ch (#697)

    With credit to @​lacliq

    Commits
    • d673cae Bump version to 14.26.0
    • 472114b added briceletbaklava.ch (#697)
    • d882d1f GitHub Actions workflows: version-constrain 'tox' to less-than v4 (#702)
    • baf3403 Bump version to 14.25.0
    • 607ab04 Add Project Gezond scraper (Dutch Website) (#691)
    • 05a04a8 add sunset.com (#690)
    • 0967f5e Bump version to 14.24.0
    • f45155f Remove some outdated quirk/workaround handling code for schema.org data in mo...
    • e2bda68 Update amazingribs scraper (#688)
    • f278c94 tox: permit positional arguments when running 'unittest'-based unit tests (#686)
    • Additional commits viewable in compare view

    Dependabot will resolve any conflicts with this PR as long as you don't alter it yourself. You can also trigger a rebase manually by commenting @dependabot rebase.


    Dependabot commands and options

    You can trigger Dependabot actions by commenting on this PR:

    • @dependabot rebase will rebase this PR
    • @dependabot recreate will recreate this PR, overwriting any edits that have been made to it
    • @dependabot merge will merge this PR after your CI passes on it
    • @dependabot squash and merge will squash and merge this PR after your CI passes on it
    • @dependabot cancel merge will cancel a previously requested merge and block automerging
    • @dependabot reopen will reopen this PR if it is closed
    • @dependabot close will close this PR and stop Dependabot recreating it. You can achieve the same result by closing it manually
    • @dependabot ignore this major version will close this PR and stop Dependabot creating any more for this major version (unless you reopen the PR or upgrade to it yourself)
    • @dependabot ignore this minor version will close this PR and stop Dependabot creating any more for this minor version (unless you reopen the PR or upgrade to it yourself)
    • @dependabot ignore this dependency will close this PR and stop Dependabot creating any more for this dependency (unless you reopen the PR or upgrade to it yourself)
    dependencies python 
    opened by dependabot[bot] 0
  • build(deps): bump alpine from 3.15 to 3.17

    build(deps): bump alpine from 3.15 to 3.17

    Bumps alpine from 3.15 to 3.17.

    Dependabot compatibility score

    Dependabot will resolve any conflicts with this PR as long as you don't alter it yourself. You can also trigger a rebase manually by commenting @dependabot rebase.


    Dependabot commands and options

    You can trigger Dependabot actions by commenting on this PR:

    • @dependabot rebase will rebase this PR
    • @dependabot recreate will recreate this PR, overwriting any edits that have been made to it
    • @dependabot merge will merge this PR after your CI passes on it
    • @dependabot squash and merge will squash and merge this PR after your CI passes on it
    • @dependabot cancel merge will cancel a previously requested merge and block automerging
    • @dependabot reopen will reopen this PR if it is closed
    • @dependabot close will close this PR and stop Dependabot recreating it. You can achieve the same result by closing it manually
    • @dependabot ignore this major version will close this PR and stop Dependabot creating any more for this major version (unless you reopen the PR or upgrade to it yourself)
    • @dependabot ignore this minor version will close this PR and stop Dependabot creating any more for this minor version (unless you reopen the PR or upgrade to it yourself)
    • @dependabot ignore this dependency will close this PR and stop Dependabot creating any more for this dependency (unless you reopen the PR or upgrade to it yourself)
    dependencies docker 
    opened by dependabot[bot] 0
  • build(deps): update flask requirement from ~=2.1 to ~=2.2

    build(deps): update flask requirement from ~=2.1 to ~=2.2

    Updates the requirements on flask to permit the latest version.

    Release notes

    Sourced from flask's releases.

    2.2.0

    This is a feature release, which includes new features and removes previously deprecated code. The 2.2.x branch is now the supported bug fix branch, the 2.1.x branch will become a tag marking the end of support for that branch. We encourage everyone to upgrade, and to use a tool such as pip-tools to pin all dependencies and control upgrades.

    Changelog

    Sourced from flask's changelog.

    Version 2.2.0

    Released 2022-08-01

    • Remove previously deprecated code. :pr:4337

      • Old names for some send_file parameters have been removed. download_name replaces attachment_filename, max_age replaces cache_timeout, and etag replaces add_etags. Additionally, path replaces filename in send_from_directory.
      • The RequestContext.g property returning AppContext.g is removed.
    • Update Werkzeug dependency to >= 2.2.

    • The app and request contexts are managed using Python context vars directly rather than Werkzeug's LocalStack. This should result in better performance and memory use. :pr:4682

      • Extension maintainers, be aware that _app_ctx_stack.top and _request_ctx_stack.top are deprecated. Store data on g instead using a unique prefix, like g._extension_name_attr.
    • The FLASK_ENV environment variable and app.env attribute are deprecated, removing the distinction between development and debug mode. Debug mode should be controlled directly using the --debug option or app.run(debug=True). :issue:4714

    • Some attributes that proxied config keys on app are deprecated: session_cookie_name, send_file_max_age_default, use_x_sendfile, propagate_exceptions, and templates_auto_reload. Use the relevant config keys instead. :issue:4716

    • Add new customization points to the Flask app object for many previously global behaviors.

      • flask.url_for will call app.url_for. :issue:4568
      • flask.abort will call app.aborter. Flask.aborter_class and Flask.make_aborter can be used to customize this aborter. :issue:4567
      • flask.redirect will call app.redirect. :issue:4569
      • flask.json is an instance of JSONProvider. A different provider can be set to use a different JSON library. flask.jsonify will call app.json.response, other functions in flask.json will call corresponding functions in app.json. :pr:4688
    • JSON configuration is moved to attributes on the default app.json provider. JSON_AS_ASCII, JSON_SORT_KEYS,

    ... (truncated)

    Commits
    • b17bb9e Merge pull request #4710 from pallets/release-2.2.0
    • 292c7e5 release version 2.2.0
    • f3bb9b2 Merge branch '2.1.x'
    • ac1bb97 Merge pull request #4721 from pallets/pre-commit-ci-update-config
    • cfd5783 Merge pull request #4722 from pallets/deprecate-config-attrs
    • bfdd371 deprecate config attributes
    • 6f9ef11 [pre-commit.ci] pre-commit autoupdate
    • 98ca00d Merge pull request #4720 from pallets/deprecate-env
    • 30427a2 remove FLASK_ENV from docs
    • ef95998 deprecate FLASK_ENV
    • Additional commits viewable in compare view

    Dependabot will resolve any conflicts with this PR as long as you don't alter it yourself. You can also trigger a rebase manually by commenting @dependabot rebase.


    Dependabot commands and options

    You can trigger Dependabot actions by commenting on this PR:

    • @dependabot rebase will rebase this PR
    • @dependabot recreate will recreate this PR, overwriting any edits that have been made to it
    • @dependabot merge will merge this PR after your CI passes on it
    • @dependabot squash and merge will squash and merge this PR after your CI passes on it
    • @dependabot cancel merge will cancel a previously requested merge and block automerging
    • @dependabot reopen will reopen this PR if it is closed
    • @dependabot close will close this PR and stop Dependabot recreating it. You can achieve the same result by closing it manually
    • @dependabot ignore this major version will close this PR and stop Dependabot creating any more for this major version (unless you reopen the PR or upgrade to it yourself)
    • @dependabot ignore this minor version will close this PR and stop Dependabot creating any more for this minor version (unless you reopen the PR or upgrade to it yourself)
    • @dependabot ignore this dependency will close this PR and stop Dependabot creating any more for this dependency (unless you reopen the PR or upgrade to it yourself)
    dependencies python 
    opened by dependabot[bot] 0
Releases(v1.6.0)
Facebook Group Scraping Using Beautiful Soup & Selenium

Extract Facebook group posts that are related to a specific topic and write them to a .json file.

Fatima Ghadieh 14 Aug 12, 2022
Scraping Top Repositories for Topics on GitHub,

0.-Webscrapping-using-python Scraping Top Repositories for Topics on GitHub, Web scraping is the process of extracting and parsing data from websites

Dev Aravind D Satprem 2 Mar 18, 2022
淘宝、天猫半价抢购,抢电视、抢茅台,干死黄牛党

taobao_seckill 淘宝、天猫半价抢购,抢电视、抢茅台,干死黄牛党 依赖 安装chrome浏览器,根据浏览器的版本找到对应的chromedriver下载安装 web版使用说明 1、抢购前需要校准本地时间,然后把需要抢购的商品加入购物车 2、如果要打包成可执行文件,可使用pyinstalle

2k Jan 05, 2023
A python script to extract answers to any question on Quora (Quora+ included)

quora-plus-bypass A python script to extract answers to any question on Quora (Quora+ included) Requirements Python 3.x

Nitin Narayanan 10 Aug 18, 2022
Scraping news from Ucsal portal with Scrapy.

NewsScraping Esse é um projeto de raspagem das últimas noticias, de 2021, do portal da universidade Ucsal http://noosfero.ucsal.br/institucional Tecno

Crissiano Pires 0 Sep 30, 2021
Bigdata - This Scrapy project uses Redis and Kafka to create a distributed on demand scraping cluster

Scrapy Cluster This Scrapy project uses Redis and Kafka to create a distributed

Hanh Pham Van 0 Jan 06, 2022
a Scrapy spider that utilizes Postgres as a DB, Squid as a proxy server, Redis for de-duplication and Splash to render JavaScript. All in a microservices architecture utilizing Docker and Docker Compose

This is George's Scraping Project To get started cd into the theZoo file and run: chmod +x script.sh then: ./script.sh This will spin up a Postgres co

George Reyes 7 Nov 27, 2022
一个m3u8视频流下载脚本

一个Python的m3u8流视频下载脚本 介绍 m3u8流视频日益常见,目前好用的下载器也有很多,我把之前自己写的一个小脚本分享出来,供广大网友使用。写此程序的目的在于给视频下载爱好者提供一个下载样例,可直接调用,勿再重复造轮子。 使用方法 在python中直接运行程序或进行外部调用 import

Nchu 0 Oct 10, 2021
API to parse tibia.com content into python objects.

Tibia.py An API to parse Tibia.com content into object oriented data. No fetching is done by this module, you must provide the html content. Features:

Allan Galarza 25 Oct 31, 2022
An experiment to deploy a serverless infrastructure for a scrapy project.

Serverless Scrapy project This project aims to evaluate the feasibility of an architecture based on serverless technology for a web crawler using scra

José Ferraz Neto 5 Jul 08, 2022
Simple tool to scrape and download cross country ski timings and results from live.skidor.com

LiveSkidorDownload Simple tool to scrape and download cross country ski timings and results from live.skidor.com Usage: Put the python file in a dedic

0 Jan 07, 2022
Quick Project made to help scrape Lexile and Atos(AR) levels from ISBN

Lexile-Atos-Scraper Quick Project made to help scrape Lexile and Atos(AR) levels from ISBN You will need to install the chrome webdriver if you have n

1 Feb 11, 2022
Command line program to download documents from web portals.

command line document download made easy Highlights list available documents in json format or download them filter documents using string matching re

16 Dec 26, 2022
A Python Oriented tool to Scrap WhatsApp Group Link using Google Dork it Scraps Whatsapp Group Links From Google Results And Gives Working Links.

WaGpScraper A Python Oriented tool to Scrap WhatsApp Group Link using Google Dork it Scraps Whatsapp Group Links From Google Results And Gives Working

Muhammed Rizad 27 Dec 18, 2022
Download images from forum threads

Forum Image Scraper Downloads images from forum threads Only works with forums which doesn't require a login to view and have an incremental paginatio

9 Nov 16, 2022
The core packages of security analyzer web crawler

Security Analyzer 🐍 A large scale web crawler (considered also as vulnerability scanner tool) to take an overview about security of Moroccan sites Cu

Security Analyzer 10 Jul 03, 2022
This project was created using Python technology and flask tools to scrape a music site

python-scrapping This project was created using Python technology and flask tools to scrape a music site You need to install the following packages to

hosein moradi 1 Dec 07, 2021
Script for scrape user data like "id,username,fullname,followers,tweets .. etc" by Twitter's search engine .

TwitterScraper Script for scrape user data like "id,username,fullname,followers,tweets .. etc" by Twitter's search engine . Screenshot Data Users Only

Remax Alghamdi 19 Nov 17, 2022
Web crawling framework based on asyncio.

Web crawling framework for everyone. Written with asyncio, uvloop and aiohttp. Requirements Python3.5+ Installation pip install gain pip install uvloo

Jiuli Gao 2k Jan 05, 2023
Get paper names from dblp.org

scraper-dblp Get paper names from dblp.org and store them in a .txt file Useful for a related literature :) Install libraries pip3 install -r requirem

Daisy Lab 1 Dec 07, 2021