Hey everyone! I'm looking to create an application that automates some redundant tasks on my computer in the background. Specifically, I want to know what the best method is for sending commands to the computer. Should I use specific coordinates for buttons, rely on the names of the buttons or toolbars, or should I use images of the icons to interact with? I'm looking for your insights and experiences. Thanks! 🤣
3 Answers
I think you should really consider what you want to automate. If it’s just repetitive tasks, then using image icons makes sense as it can adapt if the button’s position changes or if the screen resolution differs. Just make sure your automation tool can recognize the images well.
Yeah, and if you're stuck on how to implement the image recognition, there are lots of resources online to help you out!
That's an interesting project! If the actions are repetitive but necessary, automation makes total sense. I suggest you focus on using image recognition for automation, like `pyautogui.locateOnScreen()`. It’s more reliable than using coordinates since window positions can change, leading to misclicks. By using images, your app can check if buttons are on the screen before clicking, making it a lot more dependable.
I actually built something similar! It wasn't in Python, but you could check out my app at getkbm.io. It might give you some ideas on how to set things up in the way you want. Good luck with your project!
Thanks for the advice! I appreciate the recommendation on using images.