Metasploit Web Crawler
05/30/2018
Description
This auxiliary module is a modular web crawler, to be used in conjunction with wmap (someday) or standalone.
Author(s)
- et <et@metasploit.com>
Development
Module Options
To display the available options, load the module within the Metasploit console and run the commands 'show options' or 'show advanced':
msf > use auxiliary/crawler/msfcrawler
msf auxiliary(msfcrawler) > show actions
...actions...
msf auxiliary(msfcrawler) > set ACTION < action-name >
msf auxiliary(msfcrawler) > show options
...show and set options...
msf auxiliary(msfcrawler) > run 
Penetration testing software for offensive security teams.
Key Features
- Collect and share all the information you need to conduct a successful and efficient penetration test
- Simulate complex attacks against your systems and users
- Test your defenses to make sure they’re ready
- Automate Every Step of Your Penetration Test
Time is precious, so I don’t want to do something manually that I can automate. Leveraging the Metasploit Framework when automating any task keeps us from having to re-create the wheel as we can use the existing libraries and focus our efforts where it matters.
– Jim O’Gorman | President, Offensive Security