rsync
Stephen Partington
cryptworks at gmail.com
Wed Sep 23 11:17:51 MST 2015
That would be a tar operation and not an rsync. rsync is intended to create
2 identical locations not an archive.
On Wed, Sep 23, 2015 at 11:11 AM, Michael Havens <bmike1 at gmail.com> wrote:
> by compress I thought they meant zip. so there is no way to zip it?
>
> On Wed, Sep 23, 2015 at 1:36 PM, Brian Cluff <brian at snaptek.com> wrote:
>
>> The --compress-level=5 option is for compressing the data over a
>> network. I would hope that rsync is smart enough to not actually compress
>> the data internally when the data is staying local to the machine, but if
>> it's not, telling it to compress will just eat up a bunch of your CPU to
>> accomplish nothing.
>>
>> rsync does indeed have an exclude option that looks like:
>>
>> --exclude 'string*'
>>
>> If you want the data compressed but still want to use rsync on it, you
>> will probably need to look into using a filesystem that will automatically
>> compress your data. Then you can just use the same command to backup your
>> data and the compression will be done transparently.
>>
>> Try looking into formatting your drive with something like the BTRFS
>> filesystem that supports transparent compression.
>>
>> Brian Cluff
>>
>> On 09/23/2015 06:49 AM, Michael Havens wrote:
>>
>>> It seems that the compress doesn't work.
>>>
>>> size of Documents folder:
>>> bmike1 at c521 ~ $ du -hs Documents/
>>> which lists the size of 19G
>>>
>>> bmike1 at c521 /media/bmike1/USB DISK $ du -hs ./
>>> 20G./
>>>
>>> --compress-level=5 made it bigger!
>>>
>>> Or else do I also need to include '-z' as well?
>>>
>>> On Wed, Sep 23, 2015 at 9:29 AM, Michael Havens <bmike1 at gmail.com
>>> <mailto:bmike1 at gmail.com>> wrote:
>>>
>>> got it to backup. But still, please answer my question about the
>>> 'exclude' option and how much I can compress it. I got it to backup
>>> by erasing the .Trash folder. Why don't pendrives make the space
>>> available after you delete a file?
>>>
>>> rsync -auWq --progress --delete --compress-level=5
>>> /home/bmike1/Documents /media/bmike1/"USB DISK"/
>>> rsync: rename "/media/bmike1/USB DISK/Documents/.forwardspamto
>>> .elhlC4" -> "Documents/forwardspamto ": Invalid argument (22)
>>> rsync: mkstemp "/media/bmike1/USB
>>>
>>> DISK/Documents/Business/Receipts/lazycash/.index.html?a_aid=509c458b25b79.sGaqe4"
>>> failed: Invalid argument (22)
>>>
>>> rsync: mkstemp "/media/bmike1/USB
>>> DISK/Documents/ComputerInstructions/.ForgotPassword?.xVeqCC" failed:
>>> Invalid argument (22)
>>> rsync: mkstemp "/media/bmike1/USB
>>> DISK/Documents/Education/.Screenshot-LFS101x.2 Progress | edX -
>>> Google Chrome.png.eyN1PK" failed: Invalid argument (22)
>>> rsync error: some files/attrs were not transferred (see previous
>>> errors) (code 23) at main.c(1183) [sender=3.1.0]
>>>
>>>
>>> On Wed, Sep 23, 2015 at 8:07 AM, Michael Havens <bmike1 at gmail.com
>>> <mailto:bmike1 at gmail.com>> wrote:
>>>
>>> I keep running out of space on the flash drive. How tightly can
>>> I compress it?
>>> Could I get it to not copy files like so: --exclude=string* so
>>> that it would exclude all files string<and whatever else comes
>>> after string>
>>> ????????????????????????
>>>
>>> On Mon, Sep 21, 2015 at 12:48 PM, Michael Havens
>>> <bmike1 at gmail.com <mailto:bmike1 at gmail.com>> wrote:
>>>
>>> thanks!
>>>
>>> On Mon, Sep 21, 2015 at 12:40 PM, Brian Cluff
>>> <brian at snaptek.com <mailto:brian at snaptek.com>> wrote:
>>>
>>> Use --delete if you want the destination to have any
>>> files that have been deleted from the source to also
>>> deleted in the destination.
>>>
>>> The -q option just suppresses any output that isn't an
>>> error, I tend to leave it off do that I can see what
>>> file it's currently working on. You can add or remove
>>> it as needed.
>>>
>>> Brian Cluff
>>>
>>> On 09/21/2015 03:42 AM, Michael Havens wrote:
>>>
>>> what about the -q option and the --delete option? i
>>> noticed that you
>>> didn't use them in your command 'rsync -auW
>>> /sort/directory
>>> /dest/directory/'.
>>>
>>> On Sun, Sep 20, 2015 at 10:34 PM, Brian Cluff
>>> <brian at snaptek.com <mailto:brian at snaptek.com>
>>> <mailto:brian at snaptek.com
>>>
>>> <mailto:brian at snaptek.com>>> wrote:
>>>
>>> If you are backing up locally you will want to
>>> do things a little
>>> different size as:
>>>
>>> rsync -auW /sort/directory /dest/directory/
>>>
>>> You will want to skip the -z option and the
>>> corresponding
>>> --compress-level option. Since you are doing
>>> copying everything
>>> locally that will only cause the machine to
>>> compress and immediately
>>> decompress every file that is copied wasting a
>>> ton of CPU/power.
>>>
>>> The other thing you will want to do is use the
>>> -W flag, that tells
>>> the machine to copy whole files instead of
>>> looking for what has
>>> changed between the documents. That way it can
>>> look at the time
>>> and/or size and if it's changed it will just
>>> copy the whole file.
>>> Without that flag it would read through both
>>> the source and
>>> destination file and then just copy the
>>> differences by writing a
>>> whole new file, so with the -W (whole file)
>>> flag the machine just
>>> reads/writes the file once and is a lot more
>>> efficient/faster.
>>>
>>> This can also be a good flag to set on fast
>>> networks since it can be
>>> a lot faster just to re-copy the whole file
>>> than it is to have the
>>> hard drive reading the file multiple times.
>>>
>>> The progress flag is very nice, but unless you
>>> are planning on
>>> closely monitoring your copy, I would skip it
>>> as I've found that it
>>> tends to slow down the transfer... or at least
>>> make it feel that
>>> way, like a watched pot never boils :)
>>>
>>> On your slash at end end question. A slash at
>>> the end tends to mean
>>> that you want to put the source files/dirs into
>>> that directory and a
>>> destination without a slash usually means that
>>> you want to rename
>>> your source file/directory to that destination
>>> file/dir name.
>>>
>>> Lastly the -h option gives you the sizes in
>>> easily readable terms or
>>> in other words, instead of just giving you the
>>> size in bytes it will
>>> give you size that look like 100K 2.4M 1.8G
>>>
>>> Brian Cluff
>>>
>>>
>>> On 09/20/2015 05:34 AM, Michael Havens wrote:
>>>
>>> I know how to use rsync (sorta) to backup a
>>> disk and go between
>>> remote
>>> machines. With my current incarnation of
>>> the os I'm not so
>>> worried about
>>> backing up the whole system as I am a
>>> directory (and all of the
>>> directories under it) nor copying between
>>> remote machines. The
>>> directory
>>> is the 'Documents' directory. Would I:
>>>
>>> rsync -aquz --compress-level=5
>>> /home/bmike1/Documents
>>> /media/bmike1/USB
>>> DISK/
>>> --
>>> :-)~MIKE~(-:
>>>
>>>
>>>
>>> ---------------------------------------------------
>>> PLUG-discuss mailing list -
>>> PLUG-discuss at lists.phxlinux.org
>>> <mailto:PLUG-discuss at lists.phxlinux.org>
>>> <mailto:PLUG-discuss at lists.phxlinux.org
>>> <mailto:PLUG-discuss at lists.phxlinux.org>>
>>> To subscribe, unsubscribe, or to change
>>> your mail settings:
>>>
>>> http://lists.phxlinux.org/mailman/listinfo/plug-discuss
>>>
>>>
>>> ---------------------------------------------------
>>> PLUG-discuss mailing list -
>>> PLUG-discuss at lists.phxlinux.org
>>> <mailto:PLUG-discuss at lists.phxlinux.org>
>>> <mailto:PLUG-discuss at lists.phxlinux.org
>>> <mailto:PLUG-discuss at lists.phxlinux.org>>
>>> To subscribe, unsubscribe, or to change your
>>> mail settings:
>>>
>>> http://lists.phxlinux.org/mailman/listinfo/plug-discuss
>>>
>>>
>>>
>>>
>>> --
>>> :-)~MIKE~(-:
>>>
>>>
>>> ---------------------------------------------------
>>> PLUG-discuss mailing list -
>>> PLUG-discuss at lists.phxlinux.org
>>> <mailto:PLUG-discuss at lists.phxlinux.org>
>>> To subscribe, unsubscribe, or to change your mail
>>> settings:
>>>
>>> http://lists.phxlinux.org/mailman/listinfo/plug-discuss
>>>
>>>
>>> ---------------------------------------------------
>>> PLUG-discuss mailing list -
>>> PLUG-discuss at lists.phxlinux.org
>>> <mailto:PLUG-discuss at lists.phxlinux.org>
>>> To subscribe, unsubscribe, or to change your mail
>>> settings:
>>> http://lists.phxlinux.org/mailman/listinfo/plug-discuss
>>>
>>>
>>>
>>>
>>> --
>>> :-)~MIKE~(-:
>>>
>>>
>>>
>>>
>>> --
>>> :-)~MIKE~(-:
>>>
>>>
>>>
>>>
>>> --
>>> :-)~MIKE~(-:
>>>
>>>
>>>
>>>
>>> --
>>> :-)~MIKE~(-:
>>>
>>>
>>> ---------------------------------------------------
>>> PLUG-discuss mailing list - PLUG-discuss at lists.phxlinux.org
>>> To subscribe, unsubscribe, or to change your mail settings:
>>> http://lists.phxlinux.org/mailman/listinfo/plug-discuss
>>>
>>> ---------------------------------------------------
>> PLUG-discuss mailing list - PLUG-discuss at lists.phxlinux.org
>> To subscribe, unsubscribe, or to change your mail settings:
>> http://lists.phxlinux.org/mailman/listinfo/plug-discuss
>>
>
>
>
> --
> :-)~MIKE~(-:
>
> ---------------------------------------------------
> PLUG-discuss mailing list - PLUG-discuss at lists.phxlinux.org
> To subscribe, unsubscribe, or to change your mail settings:
> http://lists.phxlinux.org/mailman/listinfo/plug-discuss
>
--
A mouse trap, placed on top of your alarm clock, will prevent you from
rolling over and going back to sleep after you hit the snooze button.
Stephen
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.phxlinux.org/pipermail/plug-discuss/attachments/20150923/98c86644/attachment.html>
More information about the PLUG-discuss
mailing list