Background : A content production team shoots and records content in digital media formats. These can be a mix of raw footages, converted videos and images.
These content are stored in a share folder (Linux Samba) It is 21 TB storage which is almost fully used. I would prefer having these content team re-organize and clear the data. Overlooking the need for discipline, I am asked to simply archive. It makes sense--as years pile on, the disk space will be thin, no matter how much discipline is maintained.
We had carried out archival using Tape drives under the older leadership. New leadership has discontinued that process. They have recommended archiving older content to Amazon Glacier.
Now, the content size could be around 2Tb as an archive. There may be need to pull out an old content. How frequent?--That we do not know as of now.
No matter how much bandwidth Amazon can offer, the wire I have can do a max of 40 mbit/s. Moreover, I am asked to limit the speed by some means so that others on the same Internet connection are not affected by the transfer.
What are the considerations that I should take in to account to arrive at an understanding on whether Glacier fits the bill for such a task.
Also, is there any BASH command-line tool that can push 2 Tb+ archives to the Glacier Vault ?