Hi all,
as I wanted to make the last day of 2008 a bit special I have just uploaded s3cmd 0.9.9-pre4 to SourceForge. It’s got quite a lot of changes, bugfixes and new features under the bonnet. The most important ones are:
Support for multiple sources in get and recursive get, improved wildcard get
II admit the previous handling of prefixes in ‘get’ was braindead. Now it’s fixed and get behaves much like ‘cp’ on the local file system. Wildcards are possible with ‘get s3://bucket/blah/abc*.jpg’
Support for non-recursive ls
S3cmd ‘ls’ command on large buckets with lots and lots of files was useless as it always listed all the remote files. From now on it will only list one level of files or directories unless —recursive (-r) is given. For example:
~$ s3cmd ls s3://public.logix.cz/blah/
D s3://public.logix.cz/blah/S3/
2008-11-26 10:05 42019 s3://public.logix.cz/blah/s3cmd.. where ‘S3/’ is a directory and s3cmd is a file.
New option —skip-existing for get and sync
Self explanatory. If the local or remote file of the same name exists sync won’t go into comparing sizes or MD5 checksums but simply skips over it.
Should work fine on non-UTF8 systems, provided all the files are in current system encoding. System encoding can be overriden using —encoding.
Users on non-UTF8 / non-ASCII systems occasionally experienced Unicode conversion problems. These should now be a history and proper system encoding should be detected and used for converting local filenames to Unicode required by S3.
Don’t print nasty backtrace on KeyboardInterrupt.
There is no need to print a scary backtrace on Ctrl+C, indeed.
Improved Progress class (fixes Mac OS X)
Apparently the Mac OS X console doesn’t support all the same ANSI escape sequences as Linux does.
Fixed installation on Windows and Mac OS X and custom built Python installations
Self explanatory. There should be no more PkgInfo import errors.
Mailing lists changes
Bug reporting address is now s3tools-bugs@lists.sourceforge.net because I don’t think people subscribed to s3tools-general are interested in reading about all the same problems over and over again ;-)
Also note that there is a s3tools-announce@lists.sourceforge.net list that will only be used for new release announcements.
There’s still some more to be done before 0.9.9 is be out, especially regarding slight syntax changes for put and sync. I want to release all the backwards incompatible things at once.
This s3cmd 0.9.9-pre4 is a good step forward. I already have it on my server and it works nicely. Should be safe for a general use, although some command line syntax details may slightly change before final 0.9.9. Nothing major is expected though.
That’s it. Give s3cmd 0.9.9-pre4 some bashing if you can. Download the source either from ‘testing’ package on SourceForge:
http://sourceforge.net/project/showfiles.php?group_id=178907
or stay up to date with a SVN checkout of s3cmd “trunk”:
http://s3tools.logix.cz/download
I’m ready to hear what problems you experience. Emails of “it works great, no problems at all” nature are welcome even more ;-)
Enjoy and happy new year!
