Secure download
AE Find WebLinks
Initial Release
First public release of Find-WebLinks.ps1, a PowerShell link extraction tool for scanning a single web page or a text file containing multiple URLs.
Highlights
- Extract links from a single URL or from a list of URLs in a text file
- Filter extracted links using wildcard patterns such as
*news*,*download*, or*bbc*sport* - Write matching links to a text output file
- Append to existing output or start from a new file
- Retry failed requests with configurable wait and timeout values
- Optional second fetch per URL to keep the larger response
- Remove duplicates by default
- Support exact URL blacklist files
- Log per-URL results to CSV
- Save failed URLs and error messages to a separate file
- Write results after each processed page, preserving partial progress during long runs
Note
This script uses PowerShell’s Invoke-WebRequest. It does not execute JavaScript or render pages like a browser, so links created only by client-side JavaScript may not be detected.
5
seconds until the download starts
If the download does not start automatically after the countdown, click the button above.