Subdomain enumeration,Web scraping and finding usernames automation script written in python

Last update: Nov 22, 2022

Overview

𝓟𝓨𝓞𝓢𝓘𝓝𝓣

Subdomain enumeration,Web scraping and finding usernames automation script written in python

Installation

git clone https://github.com/d8rkmind/Pyosint.git
cd PyOsint
pip3 install -r requirements.txt

Usage :

python3 Pyosint.py [OPTIONS]

Brief info:

The main functionality of this program has been divided to 3 parts

Find - Module to search For usenames form a list of 326 websites
Scrap - To Scrap a website to extract all links form a given website and store it in a file
Enum - To automate the search of subdomains of a given domain from different services

In Scrap module results are automatically stored in output/web folder wit he ip-address of the website as the filename

The services used are Virus Total,PassiveDns,CrtSearch,ThreatCrowd
Enum module an Api key of Virus total that you can get from going Here

Paste the key inside api.json file:

* if this step is not done Virus total may block your request

Command Line Utilization Information.

The following are the sub-commands that work this program

Arguments	Shot form	Long form	Functionality
Name	-n	--name	To specify the domain name or username to use
Module	-m	--module	To specify which module to use
Output	-o	--output	To specify outputfile name
Thread	-t	--threads	To specify the number of threads to use [ Not applicable to web crawling ]
Limit	-l	--limit	to specify the maxium value of web urls to crawl [ Applicable only to web crawling ]
Verbose	-v	--verbose	To enable verbose mode [ Applicable only to Enumeration ]
Ports	-p	--ports	To specify the ports to scan [ Applicable only to Enumeration ]
Help	-h	--help	To Show the help options

Example :

Linux commands:

python3 pyosint.py -m find -n exampleuser               <-- Username-huntdown

python3 pyosint.py -m scrap -n http://scanme.nmap.org   <-- Scrapping using bot

python3 pyosint.py -m enum -n google.com                <-- Subdomain enum

The project is still in development and will be added with additional functionality.
Happy to hear suggestions for improvement.

Special Thanks to 𝓣𝓮𝓬𝓱𝓷𝓸𝓻𝓮𝓬𝓴 and 𝓢𝓱𝓾𝓷𝓾𝔁 - 𝓢𝓽𝓾𝔁𝓷𝓮𝓽 for working in this project

Note :

This is only for educational and research purposes.The developers will not be held responsible for any harm caused by anyone who misuses the material.

License :

Pyosint is licensed under the GNU GPL license. take a look at the LICENSE for more information

Update informations

Update on 18-8-21:

Rewritten the code completely ,Improved interface

Update on 20-8-21:

Subdomain enumeration module (enum) has been added

Update on 23-8-21:

Find module code that has been optimised. The number of sites to automate has grown from 14 to 147, and connection error has been resolved.

Update on 16-09-21:

Program has been re-written to work with arguments
Find module has been added threading Functionality
Output functionality has been added to every module
More Error handiling has been added
Number of sites has been increased from 147 to 326
Cross platform portable
Reduced unused and unwanted codes
Removed console mode

You might also like...

NExfil is an OSINT tool written in python for finding profiles by username.

NExfil is an OSINT tool written in python for finding profiles by username. The provided usernames are checked on over 350 websites within few seconds.

1.4k Jan 1, 2023

Web Scraping com Python - Raspando Vagas para Programadores

Web Scraping com Python - Raspando Vagas para Programadores Sobre o Projeto Web

3 Dec 30, 2021

A fully automated, accurate, and extensive scanner for finding vulnerable log4j hosts

log4j-scan A fully automated, accurate, and extensive scanner for finding vulnerable log4j hosts Features Support for lists of URLs. Fuzzing for more

4 Aug 8, 2022

Vulnerability Scanner & Auto Exploiter You can use this tool to check the security by finding the vulnerability in your website or you can use this tool to Get Shells

About create a target list or select one target, scans then exploits, done! Vulnnr is a Vulnerability Scanner & Auto Exploiter You can use this tool t

108 Dec 4, 2021

SCodeScanner stands for Source Code scanner where the user can scans the source code for finding the Critical Vulnerabilities.

The SCodeScanner stands for Source Code Scanner, where you can scan your source code files like PHP and get identify the vulnerabilities inside it. The tool can use by Pentester, Developer to quickly identify the weakness.

136 Dec 13, 2022

IDAPatternSearch adds a capability of finding functions according to bit-patterns into the well-known IDA Pro disassembler based on Ghidra’s function patterns format.

IDA Pattern Search by Argus Cyber Security Ltd. The IDA Pattern Search plugin adds a capability of finding functions according to bit-patterns into th

48 Dec 29, 2022

A Burp Suite extension made to automate the process of finding reverse proxy path based SSRF.

Subdomain enumeration,Web scraping and finding usernames automation script written in python

Related tags

Overview

𝓟𝓨𝓞𝓢𝓘𝓝𝓣

Subdomain enumeration,Web scraping and finding usernames automation script written in python

Installation

Brief info:

Command Line Utilization Information.

Example :

Linux commands:

Note :

License :

Update informations

Update on 18-8-21:

Update on 20-8-21:

Update on 23-8-21:

Update on 16-09-21:

You might also like...

NExfil is an OSINT tool written in python for finding profiles by username.

Web Scraping com Python - Raspando Vagas para Programadores

A fully automated, accurate, and extensive scanner for finding vulnerable log4j hosts

Vulnerability Scanner & Auto Exploiter You can use this tool to check the security by finding the vulnerability in your website or you can use this tool to Get Shells

SCodeScanner stands for Source Code scanner where the user can scans the source code for finding the Critical Vulnerabilities.

IDAPatternSearch adds a capability of finding functions according to bit-patterns into the well-known IDA Pro disassembler based on Ghidra’s function patterns format.

A Burp Suite extension made to automate the process of finding reverse proxy path based SSRF.

A simple automatic tool for finding vulnerable log4j hosts

Tool for finding PHP source code vulnerabilities.

Releases(v1)

v1(Sep 16, 2021)

Owner

Syam

Generate obfuscated meterpreter shells

Lightweight and beneficial Dependency Injection plugin for apscheduler

ssh-audit is a tool for ssh server & client configuration auditing.

Grafana-POC(CVE-2021-43798)

An intranet tool for easily intranet pentesting

Bug Alert: a service for alerting security and IT professionals of high-impact and 0day vulnerabilities

I hacked my own webcam from a Kali Linux VM in my local network, using Ettercap to do the MiTM ARP poisoning attack, sniffing with Wireshark, and using metasploit

Python library to remotely extract credentials on a set of hosts.

Webpack自动化信息收集

Show apps recorded storage files by jailbreak

OpenTOTP is yet another time-based, one-time passwords (OTPs) generator/verifier inspired by RFC 6238.

NIVOS is a hacking tool that allows you to scan deeply , crack wifi, see people on your network

CVE 2020-14871 Solaris exploit

Chrome Post-Exploitation is a client-server Chrome exploit to remotely allow an attacker access to Chrome passwords, downloads, history, and more.

NoSecerets is a python script that is designed to crack hashes extremely fast. Faster even than Hashcat

script that pulls cve collections from NVD.NIST.GOV.

Huskee: Malware made in Python for Educational purposes

A BurpSuite extension to parse 5GC NF OpenAPI 3.0 files to assess 5G core networks

Cryptick is a stock ticker for cryptocurrency tokens, and a physical NFT.

A Burp Pro extension that adds log4shell checks to Burp Scanner