Skip to content

BackupPC - binary garbage in XferLog.z / XferLog.z getting huge

I run a BackupPC instance that is still on Debian 10 / buster. The latest rsync package for Debian 10 has version number 3.1.3-6.

I recently noticed infrequent issues when backing up hosts that are either on Debian 11 / bullseye, or on Ubuntu 22.04 (which both ship rsync 3.2.3). The symptoms are as follows:

- backups take much longer than usual
- XferLog.z starts "normally", but after a certain point contains a lot of binary garbage, and gets much bigger than usual (hundreds of MB, or even in one case up to 12 GB)

After investigating and looking for information online, I came across these bug reports, which contain the explanation as well as a workaround: Debian Bug report #969463 and BackupPC issue #369.

=> The issue is caused by a combination of a change of default behaviour introduced with rsync 3.2.3, and a bug in File::RsyncP.

The solution that works for me (pending an update to Debian 11 and BackupPC 4) is to add the following line in the individual server config for each of the affected hosts:
$Conf{RsyncArgsExtra} = ['--no-msgs2stderr'];


  • Twitter
  • Bookmark BackupPC - binary garbage in XferLog.z / XferLog.z getting huge at del.icio.us
  • Facebook
  • Google Bookmarks
  • FriendFeed
  • Digg BackupPC - binary garbage in XferLog.z / XferLog.z getting huge
  • Mixx BackupPC - binary garbage in XferLog.z / XferLog.z getting huge
  • Bloglines BackupPC - binary garbage in XferLog.z / XferLog.z getting huge
  • Technorati BackupPC - binary garbage in XferLog.z / XferLog.z getting huge
  • Fark this: BackupPC - binary garbage in XferLog.z / XferLog.z getting huge
  • Bookmark BackupPC - binary garbage in XferLog.z / XferLog.z getting huge at YahooMyWeb
  • Bookmark BackupPC - binary garbage in XferLog.z / XferLog.z getting huge at Furl.net
  • Bookmark BackupPC - binary garbage in XferLog.z / XferLog.z getting huge at reddit.com
  • Bookmark BackupPC - binary garbage in XferLog.z / XferLog.z getting huge at blinklist.com
  • Bookmark BackupPC - binary garbage in XferLog.z / XferLog.z getting huge at Spurl.net
  • Bookmark BackupPC - binary garbage in XferLog.z / XferLog.z getting huge at NewsVine
  • Bookmark BackupPC - binary garbage in XferLog.z / XferLog.z getting huge at Simpy.com
  • Bookmark BackupPC - binary garbage in XferLog.z / XferLog.z getting huge at blogmarks
  • Bookmark BackupPC - binary garbage in XferLog.z / XferLog.z getting huge with wists
  • wong it!
  • Bookmark using any bookmark manager!
  • Stumble It!
  • Print this article!
  • E-mail this story to a friend!
  • Identi.ca

Find large files in a BackupPC transfer log (sort files in XferLOG by size)

When your backups suddenly takes much longer to complete, it could be because large files that were previously excluded from the backup were renamed or relocated elsewhere. In order to identify those files, or just to sort the list of files by size, I use the following code (bash):
cd /tmp/
BackupPC_zcat /var/lib/backuppc/pc/mypc/XferLOG.99.z > xlog
for S in `cat xlog | sed -e 's/^[^/]*\/[0-9]*[ ]*//' | cut -f1 -d\ | egrep '^[0-9]+$' | egrep '[0-9]{9,}' | sort -n | uniq ` ; do fgrep " $S " xlog ; done
This will show the list of files bigger than 99999999 bytes (100 MB). Remove "| egrep '[0-9]{9,}'" to just list all instead.

Note: on Debian, BackupPC_zcat is in /usr/share/backuppc/bin/. I've added a symlink in /usr/local/bin/ so that I don't need to look for it every time.


  • Twitter
  • Bookmark Find large files in a BackupPC transfer log (sort files in XferLOG by size) at del.icio.us
  • Facebook
  • Google Bookmarks
  • FriendFeed
  • Digg Find large files in a BackupPC transfer log (sort files in XferLOG by size)
  • Mixx Find large files in a BackupPC transfer log (sort files in XferLOG by size)
  • Bloglines Find large files in a BackupPC transfer log (sort files in XferLOG by size)
  • Technorati Find large files in a BackupPC transfer log (sort files in XferLOG by size)
  • Fark this: Find large files in a BackupPC transfer log (sort files in XferLOG by size)
  • Bookmark Find large files in a BackupPC transfer log (sort files in XferLOG by size) at YahooMyWeb
  • Bookmark Find large files in a BackupPC transfer log (sort files in XferLOG by size) at Furl.net
  • Bookmark Find large files in a BackupPC transfer log (sort files in XferLOG by size) at reddit.com
  • Bookmark Find large files in a BackupPC transfer log (sort files in XferLOG by size) at blinklist.com
  • Bookmark Find large files in a BackupPC transfer log (sort files in XferLOG by size) at Spurl.net
  • Bookmark Find large files in a BackupPC transfer log (sort files in XferLOG by size) at NewsVine
  • Bookmark Find large files in a BackupPC transfer log (sort files in XferLOG by size) at Simpy.com
  • Bookmark Find large files in a BackupPC transfer log (sort files in XferLOG by size) at blogmarks
  • Bookmark Find large files in a BackupPC transfer log (sort files in XferLOG by size) with wists
  • wong it!
  • Bookmark using any bookmark manager!
  • Stumble It!
  • Print this article!
  • E-mail this story to a friend!
  • Identi.ca

Add HEIF support to Ubuntu Linux 18.04 (thumbnails / gimp) - preview and open HEIC files from iPhone directly in Ubuntu

Since Apple moved from JPEG to HEIF as default format about two years ago, there has been a lot of progress.

There is a very straightforward way to add minimal HEIC/HEIF support to Ubuntu:
sudo add-apt-repository ppa:strukturag/libheif
sudo apt-get install heif-gdk-pixbuf heif-gimp-plugin heif-thumbnailer

That's it! You don't even need to logout or restart, the new functionality is available immediately.

More details here and here.

  • Twitter
  • Bookmark Add HEIF support to Ubuntu Linux 18.04 (thumbnails / gimp) - preview and open HEIC files from iPhone directly in Ubuntu at del.icio.us
  • Facebook
  • Google Bookmarks
  • FriendFeed
  • Digg Add HEIF support to Ubuntu Linux 18.04 (thumbnails / gimp) - preview and open HEIC files from iPhone directly in Ubuntu
  • Mixx Add HEIF support to Ubuntu Linux 18.04 (thumbnails / gimp) - preview and open HEIC files from iPhone directly in Ubuntu
  • Bloglines Add HEIF support to Ubuntu Linux 18.04 (thumbnails / gimp) - preview and open HEIC files from iPhone directly in Ubuntu
  • Technorati Add HEIF support to Ubuntu Linux 18.04 (thumbnails / gimp) - preview and open HEIC files from iPhone directly in Ubuntu
  • Fark this: Add HEIF support to Ubuntu Linux 18.04 (thumbnails / gimp) - preview and open HEIC files from iPhone directly in Ubuntu
  • Bookmark Add HEIF support to Ubuntu Linux 18.04 (thumbnails / gimp) - preview and open HEIC files from iPhone directly in Ubuntu at YahooMyWeb
  • Bookmark Add HEIF support to Ubuntu Linux 18.04 (thumbnails / gimp) - preview and open HEIC files from iPhone directly in Ubuntu at Furl.net
  • Bookmark Add HEIF support to Ubuntu Linux 18.04 (thumbnails / gimp) - preview and open HEIC files from iPhone directly in Ubuntu at reddit.com
  • Bookmark Add HEIF support to Ubuntu Linux 18.04 (thumbnails / gimp) - preview and open HEIC files from iPhone directly in Ubuntu at blinklist.com
  • Bookmark Add HEIF support to Ubuntu Linux 18.04 (thumbnails / gimp) - preview and open HEIC files from iPhone directly in Ubuntu at Spurl.net
  • Bookmark Add HEIF support to Ubuntu Linux 18.04 (thumbnails / gimp) - preview and open HEIC files from iPhone directly in Ubuntu at NewsVine
  • Bookmark Add HEIF support to Ubuntu Linux 18.04 (thumbnails / gimp) - preview and open HEIC files from iPhone directly in Ubuntu at Simpy.com
  • Bookmark Add HEIF support to Ubuntu Linux 18.04 (thumbnails / gimp) - preview and open HEIC files from iPhone directly in Ubuntu at blogmarks
  • Bookmark Add HEIF support to Ubuntu Linux 18.04 (thumbnails / gimp) - preview and open HEIC files from iPhone directly in Ubuntu with wists
  • wong it!
  • Bookmark using any bookmark manager!
  • Stumble It!
  • Print this article!
  • E-mail this story to a friend!
  • Identi.ca

IPv6 Neighbor discovery

Discover/list other hosts:
ping6 -I eth0 ff02::1
ip -6 neigh show

To connect to a host using the link-local address you need to specify which interface to use (see "zone index"):
ssh -6 fe80::a00:aaaa:bbbb:cccc%eth0
  • Twitter
  • Bookmark IPv6 Neighbor discovery at del.icio.us
  • Facebook
  • Google Bookmarks
  • FriendFeed
  • Digg IPv6 Neighbor discovery
  • Mixx IPv6 Neighbor discovery
  • Bloglines IPv6 Neighbor discovery
  • Technorati IPv6 Neighbor discovery
  • Fark this: IPv6 Neighbor discovery
  • Bookmark IPv6 Neighbor discovery at YahooMyWeb
  • Bookmark IPv6 Neighbor discovery at Furl.net
  • Bookmark IPv6 Neighbor discovery at reddit.com
  • Bookmark IPv6 Neighbor discovery at blinklist.com
  • Bookmark IPv6 Neighbor discovery at Spurl.net
  • Bookmark IPv6 Neighbor discovery at NewsVine
  • Bookmark IPv6 Neighbor discovery at Simpy.com
  • Bookmark IPv6 Neighbor discovery at blogmarks
  • Bookmark IPv6 Neighbor discovery with wists
  • wong it!
  • Bookmark using any bookmark manager!
  • Stumble It!
  • Print this article!
  • E-mail this story to a friend!
  • Identi.ca

backuppc "no ping response" when ping works fine

It took me some time to figure this out, maybe it can be useful to someone else...

I kept getting "no ping" error for unknown reasons. It turned out that I had enabled DumpPreUserCmd and UserCmdCheckStatus for that specific host to check for an encrypted partition being mounted.

Due to some changes on the host after an upgrade, the script triggered by DumpPreUserCmd was returning an error... And for some reason this showed as a ping error in the web interface.

I eventually figured it out by checking the last lines of the LOG.** file in the pc/[host] directory, which looked like this:
2018-05-08 19:15:45 Output from DumpPreUserCmd: /[partition] is not mounted
2018-05-08 19:15:45 DumpPreUserCmd returned error status 256... exiting

  • Twitter
  • Bookmark backuppc "no ping response" when ping works fine at del.icio.us
  • Facebook
  • Google Bookmarks
  • FriendFeed
  • Digg backuppc "no ping response" when ping works fine
  • Mixx backuppc "no ping response" when ping works fine
  • Bloglines backuppc "no ping response" when ping works fine
  • Technorati backuppc "no ping response" when ping works fine
  • Fark this: backuppc "no ping response" when ping works fine
  • Bookmark backuppc "no ping response" when ping works fine at YahooMyWeb
  • Bookmark backuppc "no ping response" when ping works fine at Furl.net
  • Bookmark backuppc "no ping response" when ping works fine at reddit.com
  • Bookmark backuppc "no ping response" when ping works fine at blinklist.com
  • Bookmark backuppc "no ping response" when ping works fine at Spurl.net
  • Bookmark backuppc "no ping response" when ping works fine at NewsVine
  • Bookmark backuppc "no ping response" when ping works fine at Simpy.com
  • Bookmark backuppc "no ping response" when ping works fine at blogmarks
  • Bookmark backuppc "no ping response" when ping works fine with wists
  • wong it!
  • Bookmark using any bookmark manager!
  • Stumble It!
  • Print this article!
  • E-mail this story to a friend!
  • Identi.ca