How do I download all links from a website and check which ones are NOT in the Google index?

Share This Post

ForumCategory: SEO - On-Page & Off-PageHow do I download all links from a website and check which ones are NOT in the Google index?
Mohammad Athar Staff asked 11 months ago
I have a wordpress/Woocommerce site. Does anyone know of a tool that can extract all URLs from the site and check which ones are NOT in the Google index?   Links I am interested in are not active on site. (disabled products that are re-directed to parent category). I want to know when those fall off the Google index and can be deleted permanently. I need some sort of plugin for WordPress/Woocommerce to do so. Or, I can write a small plugin to generate a list of URLs in question and need a tool I can feed this list to.
1 Answers
Fajal Shah answered 11 months ago
Most crawlers like Screaming Frog can do this. Not free, unless your site is very small. If the site is very small you might be able to get this data from Google Search Console.

Subscribe To Our Newsletter

Get updates and learn from the best

More To Explore

8 Best Free Soovle Alternatives
Keyword Research

Soovle – 8 Best Free Alternative Tools

Created in 2008, Soovle is a search engine that aims to make search more efficient and user-friendly. It does this by providing keywords from a

7 Best Free Keyworddit Alternatives
Keyword Research

Keyworddit Tool – 8 Free Alternatives

In SEO, keywords are everything. And finding the right ones can be a real challenge, especially if you’re targeting a specific niche. But what if

Do You Want To Boost Your Business?

drop us a line and keep in touch