Many of you have asked whether s3cmd supports Reduced Redundancy Storage recently introduced by Amazon. Yes it does!
RRS is supported in s3cmd 1.0.0-rc1 and newer
Oh, by the way, the magic switch is --reduced-redundancy or --rr for put, sync, cp and mv commands.
Jonathan wrote:
Excellent! Looking forward to making use of this features! And may I say: keep up the good work!
(15 August 2010, 07:09 · #)
Marc Abel wrote:
You don’t need the development version for this; at least on 0.9.9.91 (recent Ubuntu distro), just add the header as documented by Amazon:
—add-header=x-amz-storage-class:REDUCED_REDUNDANCY
to the command line.
( 8 September 2010, 03:42 · #)
Matthew Houldsworth wrote:
I use the s3cmd sync option and have backups already running, What happens if I add Reduced Redundancy option, will it re-upload all the files to the reduced redundancy?
(22 October 2010, 22:22 · #)
Michal Ludvig wrote:
Matthew – no it won’t re-upload everything. RR is a per-object setting, you’re free to mix RR and non-RR object in one bucket.
(29 October 2010, 16:16 · #)
Maxim wrote:
Michal, how to change storage type for already existed objects in S3? It is written that s3cmd supports it only for put, sync, cp and mv command.
Thank you.
( 3 November 2010, 06:25 · #)
Michal Ludvig wrote:
Hi Maxim,
as far as I know it’s not directly possible to change the storage type of existing objects. You can, however, copy the objects elsewhere and then move them back to the original place with —rr, effectively overwriting the non-rr objects with —rr ones under the same name.
I don’t know of any other way to achieve that – it’s not a limitation of s3cmd, it’s a limitation of Amazon S3 itself.
( 3 November 2010, 13:30 · #)
jerry wrote:
http://www.bryceboe.com/2010/07/02/amazon-s3-convert-objects-to-reduced-redundancy-storage/
This looks reasonable, haven’t tried it.
(20 November 2010, 11:49 · #)
scott@dsbcpas.com wrote:
Two Questions:
1. Is there an .s3cfg setting for Reduced Redundancy (could not locate a document or man describing those options)?
2. Could the “Patches for updating headers without re-uploading” be used for marking an entire bucket for rr and if so how so?
Would I be better off using Bryce Boe’s fix?
Thank you.
(11 January 2011, 06:11 · #)
JUlie wrote:
I did /Users/wouser/s3tools/s3cmd-1.0.0/s3cmd sync -v —reduced-redundancy folder1 s3://mybucket
however when I logged into my console management, the folder permissions still show use reduced redundancy not checked. how do I verify I’ useing the rr storage?
(17 March 2011, 15:40 · #)
Anton wrote:
Seems the RR with —add-header=x-amz-storage-class:REDUCED_REDUNDANCY does only work with put and sync commands, but NOT with mv and cp commands, which is a pitty. :-(
Julie: If it’s not shown as RR it is not RR, imho.
(24 March 2011, 07:57 · #)
Scott wrote:
Add RR header feature is now available through AWS’ console for both objects and folders via properties without having to re-put the object. Simple to use, but selection is by object or folder which depending upon your structure could be time consuming.
I also discovered that CloudBerryLab.com free has a nice facility for updating headers of any type. Coding is http header “x-amz-storage-class” with value “REDUCED_REDUNDANCY”. It too is easy to use and included the added benefit of selecting large numbers of files and folders all at once.
Both tools complement s3tools nicely.
( 4 September 2011, 01:29 · #)
Jim wrote:
http header “x-amz-storage-class” with value “REDUCED_REDUNDANCY” reflects on the metadata but does not seem to change the storage class that remains standard.Any ideas?
Thanks in advance
(15 December 2011, 20:19 · #)