I'm trying to create a web app that opens another site within an iframe and allows AI to perform actions like clicking buttons and typing text. Ideally, the main app would have a chat interface where I can instruct the AI on what to do. I've looked into tools like Puppeteer and similar libraries, but they seem to require a new browser instance instead of working within an iframe. Does anyone know of any existing tech or libraries that can help with this setup?
1 Answer
It sounds like what you're describing fits the use case for testing tools like Cypress or Playwright. I’m curious, why do you specifically want to integrate AI with an iframe?
I want the AI to run actions on the site directly from my app without having to start a local terminal and open a separate browser. Plus, it would be great to run tests from my phone, but I'm wondering if that's even possible.