Hey there! I haven't done much programming since high school – life gets busy, right? I've dabbled a bit in C++, but I might need to pick up a new language for my current project. I primarily use Windows but have some basic experience with Linux, mostly Ubuntu.
I'm looking for some guidance on how to create a standalone program that can automatically or manually pull and parse data from various websites. Ideally, I want this program to work up to 100 times a day and compile the data into a couple of files: one for a raw dump or backup, and another for sorting data, maybe into spreadsheets. I'm keen to keep the details private for now, but I'd love to hear any advice you have!
4 Answers
Honestly, developing on a phone isn’t the best idea. If you can access a computer, I’d recommend using Python for this project. It’s really well-suited for tasks like data pulling and parsing, though you could technically use any language.
You should definitely check out web scraping and serialization techniques! They’d pretty much cover what you need based on your project description. There’s a ton of info online about doing this using C++, so that could be a good start!
Why do you think Python is a better choice?