Hey everyone! I'm brainstorming a product idea and could really use your thoughts on its architecture and feasibility. Right now, real estate agents, especially in smaller countries, have a tedious manual process. They have to log into multiple classified websites and repeat the same tasks, which is extremely slow and inconvenient, particularly when they're out and about.
I'm thinking of developing a mobile-first app (using React Native or as a web app) where agents can create a single property listing and post it across various websites with just a click. The features I envision include:
1. Creating a listing with all the details (title, price, images, description).
2. Selecting multiple classified websites to post on.
3. Clicking a "Post" button and getting real-time feedback on the posting status (like if it was successful or if there were any issues, such as a failed login).
However, I'm stuck on a few issues: none of these websites have APIs, and they're blocking my automation efforts with Cloudflare's anti-bot measures. While I've been able to run automation in a real browser session, it still requires user intervention with a desktop browser, so it's not entirely mobile-friendly.
Here are my main questions:
1. Is there a reliable method to bypass the Cloudflare and anti-bot barriers for this purpose?
2. Is the browser extension route the only dependable option?
3. Has anyone here created a similar tool for posting to multiple sites?
4. Am I making this too complicated and should I rethink the user experience?
I'm eager to hear from anyone with experience in scraping, browser automation, or SaaS workflows. Thanks!
3 Answers
Instead of trying to outsmart Cloudflare's protections, going with the browser extension option sounds like a safer bet. You could create a web app where users fill out the listing, and then the extension takes care of posting it across sites in separate tabs. You mentioned needing a desktop for posting, but honestly, for handling images and forms, that's still usually the best route.
You're not overengineering, just tackling a common issue that many developers underestimate. If the platforms are blocking automation and there's no API access, the browser extension approach is probably your best bet. This way, it operates within a real user's session and IP, making it less likely to be flagged. Rather than forcing a mobile-only solution, consider a hybrid where the mobile app handles the listings and the desktop manages posting. You might also focus on a few key platforms first to iterate on your tool and see how it performs. Keep it simple, and you might find a way to make it work.
It would be helpful to know which countries you're focused on. For example, in the US, MLS is really regulated and controlled, so that could influence how your app functions.
I'm thinking of targeting Albania as it has a different landscape.