I'm looking for help on how to connect AWS Glue with Bitbucket. I want to be able to track who is making changes to our data scripts and what those changes are. With the discovery team expanding, this would really help us keep an eye on modifications to the scripts. Is there a reliable way to set this up?
2 Answers
Here are some useful links you might want to check out for AWS database services that could integrate well with your setup:
- [AWS Databases Overview](https://aws.amazon.com/products/databases/)
- [AWS RDS](https://aws.amazon.com/rds/)
- [AWS DynamoDB](https://aws.amazon.com/dynamodb/)
- [AWS Aurora](https://aws.amazon.com/aurora/)
- [AWS Redshift](https://aws.amazon.com/redshift/)
- [AWS DocumentDB](https://aws.amazon.com/documentdb/)
- [AWS Neptune](https://aws.amazon.com/neptune/)
Additionally, you might want to check out some discussions on [this search page](https://www.reddit.com/r/aws/search?q=flair%3A'database'&sort=new&restrict_sr=on) for further insights.
Yeah, I think these resources will help us a lot!
You can definitely deploy Infrastructure as Code (IaC) with AWS Glue like you would with any other AWS service. A solid approach is to push your code to an S3 bucket and configure your Glue job to reference that location. If you’re using GitHub Actions, you can even leverage OpenId Connect to securely push changes to AWS. Check out the documentation on that for detailed steps!
That sounds interesting! But isn’t there a manual step involved? I’m not sure everything can be done automatically.
Good point! It does seem like some aspects require manual configuration, right?
Thanks for the links! They seem to offer a lot of options.