Hey everyone! I recently started working on a solar metrics dashboard for my company that utilizes Arduinos to manage solar systems. While I'm using Grafana for the actual dashboard, I'm currently facing a challenge in transferring data from the Arduino to Grafana without having to manually copy and paste CSV files generated by the Arduino. I'm looking to automate this process, and AWS seems like a potential solution. My coworker heading the Arduino side agrees with this approach.
I've looked into setting up a data flow from Arduino to Grafana using AWS, and I'm thinking the pipeline would be Arduino -> IoT Core -> S3 -> Athena -> Grafana. Does this pipeline make sense for our needs? We have around 100 clients, so I'm aiming for something cost-efficient. Also, Grafana is hosted on a VPS via Hostinger. I'm open to any suggestions or alternatives you might recommend!
3 Answers
I agree that AWS IoT Core and S3 would work fine. However, consider the complexity of this setup. If your Arduinos can publish data using MQTT (which is generally a better practice), you might want to explore using an MQTT broker with Grafana instead. This could simplify your architecture.
Using S3 and Athena is workable, but there are more efficient solutions for time-series data. Look into using Amazon Timestream or InfluxDB, which are designed for scenarios like yours. They might save you some headaches down the line!
Great question! From what you described, it sounds like AWS IoT Core is a solid choice for initial data ingestion. You could then store the data in S3, and use Athena to query it for visualization in Grafana. Just make sure to keep an eye on costs as Athena can get pricey depending on usage.
Related Questions
Google Nest Doorbell Not Alerting Google Hub Or Google Mini
Can't Rename Google Nest Doorbell