I need to pull data from a public FTP server located in another country into my AWS account in the eu-west-2 region. What are some effective methods to accomplish this task seamlessly? Also, how can I address potential latency issues during the transfer?
2 Answers
The term "seamless" usually means a smooth process without interruptions. About the latency, you have to consider the physical distance between your FTP server and the AWS region, especially if it's a public server. There's not much you can do about the speed of light, which affects overall latency, but choosing efficient transfer protocols is vital. You could explore AWS's transfer solutions for added features too.
You might want to check out SFTP and SSH options. Those could give you a more secure connection while transferring data from the FTP server to AWS. Also, when it comes to latency, keep in mind that transfers can have inherent delays, but generally, it shouldn't exceed 500ms in most cases.
Yeah, AWS transfer family is typically for uploads, so if you're pulling data, you might want to look at other services or even set up a Lambda function for a more flexible pull approach.