Why does Google keep asking me to prove I’m not a bot?
Recently, Google frequently shows an "Our systems have detected unusual traffic" message and asks me to complete a CAPTCHA before searching. I don't use a VPN myself, but…
bot detection
Why am I seeing “unusual traffic” and a CAPTCHA on Google?
I got an "unusual traffic from your computer network" warning and a CAPTCHA while browsing in an incognito tab on my iPhone. I was searching for something sensitive…
How can a phishing detector handle websites that block automated requests?
I'm building an AI-based phishing detector that accepts URLs, retrieves their HTML and JavaScript with Playwright and Chromium in a Docker container, and extracts features from the downloaded…
What’s the ethical way to handle Cloudflare 403 challenges in a phishing detector?
I'm building an AI-based phishing detector that accepts URLs, uses Playwright and Chromium in Docker to retrieve the page's HTML and JavaScript, and then extracts features from the…
How Are You Separating Human Visitors From AI and Bot Traffic?
With AI crawlers, automated agents, monitoring tools, and traditional bots visiting websites more often, how reliable is "direct traffic" in modern analytics? If automated visits are included, conversion…
How are you separating real users from AI and bot traffic in your analytics?
With AI crawlers, automated agents, and traditional bots hitting websites more often, how much of the traffic labeled as "direct" is still human? If automated visits are included,…
How can I handle Google CAPTCHAs in a Chrome automation workflow?
I'm building an automated sign-in flow in Google Chrome and keep running into Google's CAPTCHA challenges. Is there a legitimate way to design the workflow so it works…
What’s the right way to automate a site that uses Google CAPTCHA?
I'm building a Chrome automation project and keep running into Google CAPTCHA challenges. I'd like to understand the legitimate way to handle this during automation without manually signing…
How can I automate a website without triggering CAPTCHA protections?
I'm working on a Chrome automation project and keep running into Google CAPTCHA challenges. I'm looking for legitimate ways to design the automation so it doesn't violate the…
How can I handle Google CAPTCHAs in a legitimate browser automation workflow?
I'm building an automated Chrome sign-in workflow and keep running into Google CAPTCHAs. Is there a supported way to handle them during development or testing, such as a…
How can I test the effectiveness of an invisible CAPTCHA on my own form?
I'm experimenting with different CAPTCHA systems and want to measure how well they resist automated submissions. The form has a single field and uses an invisible CAPTCHA, and…
How Are You Dealing with AI Agents on Your Website?
I'm a new web developer and I'm interested in hearing how others are managing AI agents on their websites. Are the current tools effective for detecting or servicing…
What Do I Need to Know to Build a Bot Detection App?
I'm an engineering student who's recently started diving into computer science through the OSSU curriculum, and I'm really curious about building a bot identification application. A colleague of…
What Do I Need to Know to Build a Bot Detection Tool?
I'm an engineering student who's recently developed an interest in computer science and started self-learning using the OSSU Curriculum. A colleague was conducting a survey on a specific…
Is ASN 203020 (HOSTROYALE) Responsible for Bot or Legit Traffic?
I'm seeking insights from anyone who has dealt with traffic coming from ASN 203020, also known as HOSTROYALE. Recently, one of our services has been hit with an…
How Can I Effectively Scrape the ChatGPT Website for Large-Scale Data Collection?
I'm developing a B2B analytics tool that tracks brand visibility across AI platforms, like ChatGPT. To ensure accuracy, I need to fetch responses directly from the ChatGPT website…
How to Programmatically Access ChatGPT Website Responses at Scale?
I'm currently developing a B2B analytics tool aimed at tracking how brands are portrayed on various AI platforms, including ChatGPT and Gemini. It's crucial for my project to…
Why Do Apps Keep Thinking I'm a Robot?
I've been running into a frustrating problem where multiple apps and sites think I'm a bot, and it's happening on my phone. It's not just one app; I've…
Trouble with Web Scraping on GitHub Actions
I created a web scraper for airbnb.com and kiwi.com using Python and Playwright. It successfully runs on my local machine, but when I try to deploy it on…
Why Do Websites Keep Thinking I'm a Bot?
I'm having a frustrating issue where multiple websites, especially ones for time-sensitive purchases like Ticketmaster or the Pokémon Centre, are rejecting my access and marking me as a…