I'm having a tough time finding specific words on a website that has a pretty terrible search function. I want to discover all the pages on the site where those words appear, not just on a single page. Using Ctrl+F isn't cutting it. I've attempted searching through Google with the 'site:' approach, but that only yielded a small number of pages with the words I'm looking for. I heard that Screaming Frog with Custom Search could help with this, but it requires a paid plan, which I can't afford. Is there any free tool or method to search an entire website for specific words?
1 Answer
A quick solution could be using a web scraping tool, though it might require some basic tech skills. You can try a free option like Octoparse or ParseHub to scrape the website and then search through the collected data. Just keep in mind the site's terms of service to make sure you’re not violating any rules.
Octoparse has a pretty user-friendly interface, so if you're new to web scraping, it could be a great starting point!