5

I am currently looking into solutions for geographically distributing an FTP solution. Here is the use case:

The company I work for has a software product that can produce very large log files which could range from 1 to 10 GB. A customer could zip up multiple files into a single file creating a much larger zip file (could be 20+ GB). We currently have a single FTP server located in our data center. Customers could be anywhere in the world (Asia/Pacific, Europe, Africa, etc.). Due to geographic distances, some of these log file uploads could take a substantial amount of time with the network latency.

What we would like to do is spin up an FTP server on a cloud based Infrastructure as a Service platform (Azure, AWS, etc.) and create instances in multiple geographic regions. A customer would then connect to a single host name and the cloud provider would then route the customer behind the scenes to the nearest cloud data center based on their geographic location.

My question then, is if any such off the shelf software exists that can support a geographically distributed FTP deployment that would allow a user to access via a single host name or entry point, while also keeping things such as users and groups synchronized across each of the different regions.

1

You can do this with AWS if you use EC2 to host your FTP servers and Route 53 for DNS by taking advantage of the Route 53 DNS feature called "Latency Resource Record Sets"

Links:

It would be cool if you could do with this S3 and therefore save money by not having to run EC2 servers but I havent come across that as an option yet. You could bake in some logic into your log sender script to see which S3 region is closest/fastest and upload to a bucket in that region.

  • I'm aware of the technology within AWS as well as Azure to handle global load balancing. We don't have a log sender script in our product, that's not what I was asking. Customers manually select log files to send to our Support department depending on the support case. My question is if there are any off the shelf FTP software packages that can handle being located in different data centers on different networks around the world. Setting up a load balanced FTP farm in the same data center on the same network is straight forward and several vendors support that scenario already. – Rob Jul 17 '14 at 2:24
0

You can deploy Syncplify.me Server! in AWS via Marketplace; the service is called SFTP.cloud and you can:

  • automatically deploy it on EC2 virtual machines via AMI
  • deploy instances in every AWS supported zone (geographically distributed)
  • you can even deploy multiple instances in HA (High Availability) if you want to achieve an even greater service availability

The product can be administered via web browser or directly via REST API (over a secure HTTPS connection) and features highly sercure SFTP as well as FTP(E/S) file transfer services.

There is also a pretty rich online knowledge base that includes hundreds of useful articles and best practices.

Your Answer

By clicking “Post Your Answer”, you agree to our terms of service, privacy policy and cookie policy

Not the answer you're looking for? Browse other questions tagged or ask your own question.