Skip to content
< Configure Garmin Express to download files to a different partition | Split a multi-object STL file into separate files containing each one object >

Find large files in a BackupPC transfer log (sort files in XferLOG by size)

Posted by crox on
When your backups suddenly takes much longer to complete, it could be because large files that were previously excluded from the backup were renamed or relocated elsewhere. In order to identify those files, or just to sort the list of files by size, I use the following code (bash):
cd /tmp/
BackupPC_zcat /var/lib/backuppc/pc/mypc/XferLOG.99.z > xlog
for S in `cat xlog | sed -e 's/^[^/]*\/[0-9]*[ ]*//' | cut -f1 -d\  | egrep '^[0-9]+$' | egrep '[0-9]{9,}' | sort -n | uniq ` ; do fgrep " $S " xlog ; done
This will show the list of files bigger than 99999999 bytes (100 MB). Remove "| egrep '[0-9]{9,}'" to just list all instead.

Note: on Debian, BackupPC_zcat is in /usr/share/backuppc/bin/. I've added a symlink in /usr/local/bin/ so that I don't need to look for it every time.


  • Twitter
  • Bookmark Find large files in a BackupPC transfer log (sort files in XferLOG by size) at del.icio.us
  • Facebook
  • Google Bookmarks
  • FriendFeed
  • Digg Find large files in a BackupPC transfer log (sort files in XferLOG by size)
  • Mixx Find large files in a BackupPC transfer log (sort files in XferLOG by size)
  • Bloglines Find large files in a BackupPC transfer log (sort files in XferLOG by size)
  • Technorati Find large files in a BackupPC transfer log (sort files in XferLOG by size)
  • Fark this: Find large files in a BackupPC transfer log (sort files in XferLOG by size)
  • Bookmark Find large files in a BackupPC transfer log (sort files in XferLOG by size) at YahooMyWeb
  • Bookmark Find large files in a BackupPC transfer log (sort files in XferLOG by size) at Furl.net
  • Bookmark Find large files in a BackupPC transfer log (sort files in XferLOG by size) at reddit.com
  • Bookmark Find large files in a BackupPC transfer log (sort files in XferLOG by size) at blinklist.com
  • Bookmark Find large files in a BackupPC transfer log (sort files in XferLOG by size) at Spurl.net
  • Bookmark Find large files in a BackupPC transfer log (sort files in XferLOG by size) at NewsVine
  • Bookmark Find large files in a BackupPC transfer log (sort files in XferLOG by size) at Simpy.com
  • Bookmark Find large files in a BackupPC transfer log (sort files in XferLOG by size) at blogmarks
  • Bookmark Find large files in a BackupPC transfer log (sort files in XferLOG by size) with wists
  • wong it!
  • Bookmark using any bookmark manager!
  • Stumble It!
  • Print this article!
  • E-mail this story to a friend!
  • Identi.ca

Trackbacks

No Trackbacks

Comments

Display comments as Linear | Threaded

No comments

Add Comment

Enclosing asterisks marks text as bold (*word*), underscore are made via _word_.
Standard emoticons like :-) and ;-) are converted to images.
E-Mail addresses will not be displayed and will only be used for E-Mail notifications.

To prevent automated Bots from commentspamming, please enter the string you see in the image below in the appropriate input box. Your comment will only be submitted if the strings match. Please ensure that your browser supports and accepts cookies, or your comment cannot be verified correctly.
CAPTCHA

Form options