I am working on retraining the already trained
Siamese Network with
Triplet Loss and those who don't know, it is very high memory + resource intensive task. So I want to know which service I should use for training the network.
The reason I want to use
AWS is that someone told me that there is a library
Boto which you can use to save your data. My data would be around 25+ GBs.
I want min 32GB RAM, 128GB SSD, GPU or TPU (please suggest which one to use). Also, how can I get all my data in the permanent storage from
AWS s3 links? I have a script to download but it takes too much time to download all those and if the memory is temporary, I'll lose it. Like in
Google Colab. Cost is not an issue but the service and permanent memory management is.