As always we are adding features to make it easier for our
customers to use the functionality to offer the most compelling Amazon S3 , CloudFront , IAM and Glacier client on Windows platform.
Amazon Glacier,
a secure, reliable and extremely low cost storage service designed for data
archiving and backup. In order to keep costs low, Amazon Glacier is optimized
for data that is infrequently accessed and for which retrieval times of several
hours are suitable. With Amazon Glacier, you can reliably store large or small
amounts of data for as little as $0.01 per gigabyte per month.
CloudBerry
S3 Explorer has supported Glacier for quite some time now. We introduced the Glacier
support in September, followed by supporting encryption and compression and
finally Amazon
S3 to Glacier archiving.
Amazon Glacier
is designed for very infrequent restores and restore costs may be substantial.
And in fact it is very confusing. Check out the following article from Amazon
FAQ.
The data restore is charged based on the pick usage during
the given month. In other words if you have to restore 100GB and you restore
them in 1 hours you will pay one amount. But if you restore 1GB for the next
100 hours you will pay 100 times less.
Check out the following third party calculator to estimate
the retrieval costs
In the latest release of CloudBerry Explorer PRO v 3.8 we
are introducing the Smart Retrieval functionality,
that allows you to manage data restore
budget in an intelligent way.
When you run a copy for Glacier it will pop up a
dialog asking you to specify your peak retrieval rate in MB. It will also allow you to allocate data retrieval
to run for a number of hours to stay within a selected budget. This way you can
significantly reduced your retrieval costs.
After you set it up, the restore will run in the background retrieving
the portions of data every hour. Note, you can also access this dialog from Tools
| Options menu
You can monitor the restore progress on the bottom panel.
+++
Note: this post applies to CloudBerry
Explorer PRO 3.8 and later.
As always we would be happy to hear your feedback and you
are welcome to post a comment.
CloudBerry
S3 Explorer is a Windows freeware product that helps managing Amazon S3 storage and CloudFront . You can
download it at http://www.cloudberrylab.com/free
CloudBerry
S3 Explorer PRO is a Windows program that helps managing Amazon S3 storage and CloudFront . You can
download it at http://www.cloudberrylab.com/pro It is priced at $39.99
Want to get CloudBerry Explorer PRO for FREE? Make a blog
post about us!
Posts
9 comments:
Does this work for downloading S3 objects that have been archived using the lifecycle policy?
Also, when using the lifecycle policy, can I move objects back to S3? Does that have a smart restore also?
Hi, Thank you for your question. yes, it works for the S3 objects moved to Glacier using the Livecycle policies.
As far as I know you can only temporary move the objects back to S3, not permanently. This is what we do when you want to copy objects back
Thanks
Apparently, there's kludgy workaround: https://forums.aws.amazon.com/thread.jspa?messageID=400201
You can either set the expiration of the temporary object to 5 million years or copy the temporary object using the same source and destination.
I'm only assuming the Glacier object will remain even if you delete the 5 million year expiration object or the copied one.
Hi Andy. So I'm testing out the smart restore and I'm getting this error:
retrieval rate would exceed allowed threshold
I was under the impression that a file could be split into chunks in order to meet the rate threshold. Is this incorrect? Does it just wait to retrieve the next file and not break up a single file into chunks? Thanks.
Hi Brian
if the file is larger than the threshold, we will skip it. We are going to support the range retrievals in the future to address the issue. for now I suggest to increase the threshold.
Thanks
Andy
Thanks Andy. Just to clarify, so if I set a restore rate of 1MB per hour, that means any file over 1 MB would just get skipped? Or does it base it off of the minimum 4 hour rule that Amazon has so any file over 4MB would get skipped? I'm planning to use Glacier to backup our client's pictures and I'm trying to decide whether to upload an entire DVD as a single zip or split it up into smaller files. The benefit of the large file is if the client ever needs to retrieve it, I can send them a link to a single file after all the chunks have been moved over for them to download directly along with having to pay for less REQUEST. Do you have any ETA on when you will support the range retrievals? I guess this brings up another point since I don't see how you to do a smart restore if you're just "unthawing" the file back to regular S3 storage. Is it possible to do a smart restore when you're just putting it back to regular s3 storage? BTW I assume to unthaw the file you just right click the file and say change store class to either standard or reduced correct?
Brian,
1. if the retrieval rate is 1MB the files > 1MB will get skipped
2. There is no ETA for the range retrievals support, but the requests like yours help us to prioritize features
3. changing storage class will not move the files back to S3. the only way to put them back is to initiate the retrieval.
Gotcha so if I tell it to copy to my system. That also causes it be moved to s3? How long will it stay on S3 for?
You can only temporarily move the data to S3 if it was once moved to Glacier. There is a thread about that on the official Amazon forum. With CloudBerry Explorer the data will stay on S3 for 24 hours.
in the future we will make it an option for how long to keep the data
Post a Comment