I'm looking for a way to search for specific words on a website that has a really terrible search function. My goal is to find all the pages on the site where these words are mentioned, not just on one specific page, since using ctrl+f doesn't help with this. I've tried using Google with the site: search operator, but that only brought up a few pages that contain those words. I heard that Screaming Frog can do this with its Custom Search feature, but that requires a paid plan which I can't afford. Does anyone know of a free method to find all the pages on a website with certain words? (By the way, sorry if my English isn't perfect!)
2 Answers
You could try using a web scraping tool like Scrapy or Beautiful Soup if you're familiar with Python. These can help you scan the entire site and extract pages with specific words. If programming isn’t your thing, some browser extensions can also help with site searches, just look for 'site search extension' in the Chrome Web Store or similar.
Another option is to use an online tool like 'Site search tool,' which lets you input the URL and the word you're looking for. They'll crawl the site for you and provide results. Just be mindful that some tools may limit the number of pages they search for free users.
Related Questions
Glassmorphism CSS Generator with Live Preview
Remove Duplicate Items From List
EAN Validator
EAN Generator
Cloudflare Cache Detector
HTTP Status Code Check