On 2020-02-06 12:27, Nathan (PLUGAZ) wrote: > I have a 2TB mirrored array that has hundreds of thousands of less > than 12KB files and hundreds of files that are more than 1MB and of > course lots of movies and such which can be 1 to 4GB. Over the years > it has gotten really slow. 2 930G disks here, in softRAID, with LVM. 630G ext4 filesystem on /home in an LV. 1,090,498 files and dirs on that filesystem, file sizes all over the map but more files in the M and K range than in the G range. No problems with filesystem speed ever. Is this RAID in hardware or software? Are you running baloo or some kind of file indexing/searching service? > I ran time { rsync -av /home/myuser/.cache/ > remote:/backup/dir/.cache/; } and after 75 minutes I cancelled it. > There are 46k files in that folder and it is roughly 2GB... 75 minutes > it wasn't finished. Now this is running over an NFS link just FYI. This seems off. What was the exact command you ran? I don't think rsync supports that syntax for accessing NFS things. What options is your NFS share mounted with? What was the rsync displaying after 75 minutes? Are the times on both machines the same, or unsynced? 46,000 files seems like it should take a minute or so unless it had to transfer all the files in full. For comparison, doing "rsync -av /home/me/ /mnt/backup1/me/" on that 630G filesystem with 1,090,498 files from an ext4 filesystem to a USB2 backup disk took 6 minutes 3 seconds wall-clock time. I don't have anything using NFS at the moment so I can't check that. However, rsyncing a 15G dir with 150,000 files to my ext4 filesystem on RAID over ssh took ~2 minutes. > So I created a 4GB tmpfs and mounted it where I needed and ran my > time backup again and it took 2 minutes and 6 seconds. Obviously my > network is not the issue. Doesn't tmpfs cache things in RAM? Also, how full is the ext4 destination? My filesystem has only 42% used, which probably avoids any fragmentation problems. How is the ext4 filesystem mounted? The thing that helps the most is "noatime", but that's really only a small win. > Is there a program that watches and optimizes placement of files on a > hard drive? I know these exist for windows, but linux? Can you umount and e2fsck -p the filesystem? That should at least tell you how fragmented the thing is. The "filefrag" utility will tell you how fragmented an individual file is. I don't see anything about defragging tools for ext234 in portage/sys-fs/ but that may be just me. There is http://vleu.net/shake/ but it's a bit old and I'm not sure whether it would help you. Finally, make sure you don't see anything about disk errors in the output from dmesg on the machine with the RAID, and check that "cat /proc/mdstat" returns UU for that md device. -- Crow202 Blog: http://crow202.org/wordpress There is no Darkness in Eternity But only Light too dim for us to see. --------------------------------------------------- PLUG-discuss mailing list - PLUG-discuss@lists.phxlinux.org To subscribe, unsubscribe, or to change your mail settings: https://lists.phxlinux.org/mailman/listinfo/plug-discuss