KKBA
Intruoduction
A low-code tool that generates python crawler code based on curl or url
Requirement
Python >= 3.6
Install
pip install kkba
Usage
Copy the curl command or url from the browser, without pasting, execute the command directly: kkba [options]
kkba [options]
# After the command execution, the crawler directory will be generated in the current directory (including the crawler articles and readme files).
Example
# 1. Copy curl or url
# 2. excute commands
kkba -F
Help Document
kkba -h
爬虫生成器
usage: kkba [options]
optional arguments:
-F, 推荐: 将粘贴板curl或者url，生成feapder异步爬虫代码，相当于scrapy的用法
-s 将粘贴板curl或者url，生成scrapy单文件项目
-f, 将粘贴板curl或者url，生成feapder同步爬虫代码，相当于requests的用法
-r, 将粘贴板curl或者url，生成requests爬虫代码
-h, --help 帮助文档
-v, --version 查看版本
Genrates feapder spider code
# install fepader
pip install feapder
# generates feapder spiders code
kkba -F
Generates scrapy single file code
# install scrapy
pip install scrapy
# generates scrapy single spiders code
kkba -F
Thanks
curl2pyreqs 令狐 向娜
2 Apr 29, 2022
3 Oct 4, 2022
1 Nov 14, 2021
46 Dec 16, 2022
1 Dec 30, 2021
1 Jan 10, 2022
47 Nov 23, 2022
1 Dec 20, 2021
1 Nov 28, 2021
150 Oct 15, 2022
2 Mar 12, 2022
2 Mar 28, 2022
3 Jul 01, 2022
5 Dec 01, 2022
2 Feb 22, 2022
2 Nov 01, 2021
2 Jul 20, 2022
3 Feb 27, 2022
1 Feb 10, 2022
3 Jul 08, 2022
1 Feb 10, 2022
1 Nov 10, 2021
17 Jan 24, 2022
3.2k Dec 29, 2022
4 Nov 09, 2021
4 Dec 03, 2022
1 Jan 31, 2022
5 Jul 27, 2022