Swift Backup portable data shuttle functionality

Asked by Patrick Gaßner

Dear community,

I'm working on an Enterprise-Backup Solution with a provider-sided Swift Storage Infrastructure and a client-sided Cloud-Gateway-Appliance with encryption and deduplication functionalities. The initial full backup can easily be several TB of size. Depending on the internet connection, this can result in an initial upload or full download duration of several days, which is not acceptable.
A way round the problem would be an portable physical data shuttle, which collects the encrypted and deduplicated initial backup data from the customers cloud gateway over the customers high-speed network, transfers it by car to the cloud infrastructure, and saves all the data in the customers cloud account over the high-speed network of the cloud infrastructure. The very smaller incremental backups can than be performed on the handed transferred backup data.
Thereby the problem is the gateway-specific data structure (encrypted, deduped).

Is there any experience with such an implementation, maybe some successful solution, or any kind of ideas or doubts whether such a scenario is even possible.

Thanks for any kind of answers.

With regards,
Patrick

Question information

Language:
English Edit question
Status:
Solved
For:
OpenStack Object Storage (swift) Edit question
Assignee:
No assignee Edit question
Solved by:
Patrick Gaßner
Solved:
Last query:
Last reply:
Revision history for this message
John Dickinson (notmyname) said :
#1

Physically transporting drives is quite a common (and efficient) way to move large amounts of data. Several major cloud storage providers offer this sort of service for data ingress and egress. It's certainly possible, and not too technically challenging. The biggest challenges are the logistics of dealing with the physical devices and managing that process.

I wouldn't consider this sort of service to be part of Swift's scope, but it would complement what Swift offers.

Revision history for this message
Patrick Gaßner (patrick-gassner) said :
#2

Hey John,
thanks for your fast response.
You're right, this is the topic of the storage gateway. This means, i need to check my gateway for this funtionality.
Currently, I use a Riverbed Whitewater Appliance.
I'll try it and share my experiences.