Skip to content

BackupPC - binary garbage in XferLog.z / XferLog.z getting huge

I run a BackupPC instance that is still on Debian 10 / buster. The latest rsync package for Debian 10 has version number 3.1.3-6.

I recently noticed infrequent issues when backing up hosts that are either on Debian 11 / bullseye, or on Ubuntu 22.04 (which both ship rsync 3.2.3). The symptoms are as follows:

- backups take much longer than usual
- XferLog.z starts "normally", but after a certain point contains a lot of binary garbage, and gets much bigger than usual (hundreds of MB, or even in one case up to 12 GB)

After investigating and looking for information online, I came across these bug reports, which contain the explanation as well as a workaround: Debian Bug report #969463 and BackupPC issue #369.

=> The issue is caused by a combination of a change of default behaviour introduced with rsync 3.2.3, and a bug in File::RsyncP.

The solution that works for me (pending an update to Debian 11 and BackupPC 4) is to add the following line in the individual server config for each of the affected hosts:
$Conf{RsyncArgsExtra} = ['--no-msgs2stderr'];


  • Twitter
  • Bookmark BackupPC - binary garbage in XferLog.z / XferLog.z getting huge at del.icio.us
  • Facebook
  • Google Bookmarks
  • FriendFeed
  • Digg BackupPC - binary garbage in XferLog.z / XferLog.z getting huge
  • Mixx BackupPC - binary garbage in XferLog.z / XferLog.z getting huge
  • Bloglines BackupPC - binary garbage in XferLog.z / XferLog.z getting huge
  • Technorati BackupPC - binary garbage in XferLog.z / XferLog.z getting huge
  • Fark this: BackupPC - binary garbage in XferLog.z / XferLog.z getting huge
  • Bookmark BackupPC - binary garbage in XferLog.z / XferLog.z getting huge at YahooMyWeb
  • Bookmark BackupPC - binary garbage in XferLog.z / XferLog.z getting huge at Furl.net
  • Bookmark BackupPC - binary garbage in XferLog.z / XferLog.z getting huge at reddit.com
  • Bookmark BackupPC - binary garbage in XferLog.z / XferLog.z getting huge at blinklist.com
  • Bookmark BackupPC - binary garbage in XferLog.z / XferLog.z getting huge at Spurl.net
  • Bookmark BackupPC - binary garbage in XferLog.z / XferLog.z getting huge at NewsVine
  • Bookmark BackupPC - binary garbage in XferLog.z / XferLog.z getting huge at Simpy.com
  • Bookmark BackupPC - binary garbage in XferLog.z / XferLog.z getting huge at blogmarks
  • Bookmark BackupPC - binary garbage in XferLog.z / XferLog.z getting huge with wists
  • wong it!
  • Bookmark using any bookmark manager!
  • Stumble It!
  • Print this article!
  • E-mail this story to a friend!
  • Identi.ca

Find large files in a BackupPC transfer log (sort files in XferLOG by size)

When your backups suddenly takes much longer to complete, it could be because large files that were previously excluded from the backup were renamed or relocated elsewhere. In order to identify those files, or just to sort the list of files by size, I use the following code (bash):
cd /tmp/
BackupPC_zcat /var/lib/backuppc/pc/mypc/XferLOG.99.z > xlog
for S in `cat xlog | sed -e 's/^[^/]*\/[0-9]*[ ]*//' | cut -f1 -d\ | egrep '^[0-9]+$' | egrep '[0-9]{9,}' | sort -n | uniq ` ; do fgrep " $S " xlog ; done
This will show the list of files bigger than 99999999 bytes (100 MB). Remove "| egrep '[0-9]{9,}'" to just list all instead.

Note: on Debian, BackupPC_zcat is in /usr/share/backuppc/bin/. I've added a symlink in /usr/local/bin/ so that I don't need to look for it every time.


  • Twitter
  • Bookmark Find large files in a BackupPC transfer log (sort files in XferLOG by size) at del.icio.us
  • Facebook
  • Google Bookmarks
  • FriendFeed
  • Digg Find large files in a BackupPC transfer log (sort files in XferLOG by size)
  • Mixx Find large files in a BackupPC transfer log (sort files in XferLOG by size)
  • Bloglines Find large files in a BackupPC transfer log (sort files in XferLOG by size)
  • Technorati Find large files in a BackupPC transfer log (sort files in XferLOG by size)
  • Fark this: Find large files in a BackupPC transfer log (sort files in XferLOG by size)
  • Bookmark Find large files in a BackupPC transfer log (sort files in XferLOG by size) at YahooMyWeb
  • Bookmark Find large files in a BackupPC transfer log (sort files in XferLOG by size) at Furl.net
  • Bookmark Find large files in a BackupPC transfer log (sort files in XferLOG by size) at reddit.com
  • Bookmark Find large files in a BackupPC transfer log (sort files in XferLOG by size) at blinklist.com
  • Bookmark Find large files in a BackupPC transfer log (sort files in XferLOG by size) at Spurl.net
  • Bookmark Find large files in a BackupPC transfer log (sort files in XferLOG by size) at NewsVine
  • Bookmark Find large files in a BackupPC transfer log (sort files in XferLOG by size) at Simpy.com
  • Bookmark Find large files in a BackupPC transfer log (sort files in XferLOG by size) at blogmarks
  • Bookmark Find large files in a BackupPC transfer log (sort files in XferLOG by size) with wists
  • wong it!
  • Bookmark using any bookmark manager!
  • Stumble It!
  • Print this article!
  • E-mail this story to a friend!
  • Identi.ca

Grafana PNG export on headless Debian server (phantomjs / render fails with "404 page not found")

If it still fails after you've set "root_url" to the correct value in grafana.ini, you might want to check whether you can run phantomjs from the command line.

If you get "QXcbConnection: Could not connect to display / PhantomJS has crashed", then the explanation is here: Debian Bug #817277.

To fix it, I installed xvfb (apt-get install xvfb), and edited /usr/bin/phantomjs so that the last line now looks like this:
exec "/usr/bin/xvfb-run" --server-args="-screen 0 640x480x16" "/usr/lib/phantomjs/phantomjs" "$@"

  • Twitter
  • Bookmark Grafana PNG export on headless Debian server (phantomjs / render fails with "404 page not found") at del.icio.us
  • Facebook
  • Google Bookmarks
  • FriendFeed
  • Digg Grafana PNG export on headless Debian server (phantomjs / render fails with "404 page not found")
  • Mixx Grafana PNG export on headless Debian server (phantomjs / render fails with "404 page not found")
  • Bloglines Grafana PNG export on headless Debian server (phantomjs / render fails with "404 page not found")
  • Technorati Grafana PNG export on headless Debian server (phantomjs / render fails with "404 page not found")
  • Fark this: Grafana PNG export on headless Debian server (phantomjs / render fails with "404 page not found")
  • Bookmark Grafana PNG export on headless Debian server (phantomjs / render fails with "404 page not found") at YahooMyWeb
  • Bookmark Grafana PNG export on headless Debian server (phantomjs / render fails with "404 page not found") at Furl.net
  • Bookmark Grafana PNG export on headless Debian server (phantomjs / render fails with "404 page not found") at reddit.com
  • Bookmark Grafana PNG export on headless Debian server (phantomjs / render fails with "404 page not found") at blinklist.com
  • Bookmark Grafana PNG export on headless Debian server (phantomjs / render fails with "404 page not found") at Spurl.net
  • Bookmark Grafana PNG export on headless Debian server (phantomjs / render fails with "404 page not found") at NewsVine
  • Bookmark Grafana PNG export on headless Debian server (phantomjs / render fails with "404 page not found") at Simpy.com
  • Bookmark Grafana PNG export on headless Debian server (phantomjs / render fails with "404 page not found") at blogmarks
  • Bookmark Grafana PNG export on headless Debian server (phantomjs / render fails with "404 page not found") with wists
  • wong it!
  • Bookmark using any bookmark manager!
  • Stumble It!
  • Print this article!
  • E-mail this story to a friend!
  • Identi.ca

How to solve Edimax EW-7612UAn v2 (7392:7822) power management issues on Raspberry Pi (Raspbian WiFi disconnect)

  • On Raspbian, you don't need to install the 8192cu driver manually, as it comes with the distribution

  • To avoid disconnection issues, you need however to disable power management. This needs to be done in two places. First, this is what I have in /etc/modprobe.d/8192cu.conf:
    options 8192cu rtw_power_mgnt=0 rtw_enusbss=0

  • This alone did not prevent the issue. I also had to add this entry to /etc/network/interfaces:
    auto wlan0
    allow-hotplug wlan0
    iface wlan0 inet dhcp
    wpa-conf /etc/wpa_supplicant/wpa_supplicant.conf
    wireless-power off
    iface default inet dhcp


Sources: https://github.com/xbianonpi/xbian/issues/217, https://www.kuerbis.org/2016/03/raspberry-pi-3-kurztipps-wlan-sleep-mode-verhindern/
  • Twitter
  • Bookmark How to solve Edimax EW-7612UAn v2 (7392:7822) power management issues on Raspberry Pi (Raspbian WiFi disconnect) at del.icio.us
  • Facebook
  • Google Bookmarks
  • FriendFeed
  • Digg How to solve Edimax EW-7612UAn v2 (7392:7822) power management issues on Raspberry Pi (Raspbian WiFi disconnect)
  • Mixx How to solve Edimax EW-7612UAn v2 (7392:7822) power management issues on Raspberry Pi (Raspbian WiFi disconnect)
  • Bloglines How to solve Edimax EW-7612UAn v2 (7392:7822) power management issues on Raspberry Pi (Raspbian WiFi disconnect)
  • Technorati How to solve Edimax EW-7612UAn v2 (7392:7822) power management issues on Raspberry Pi (Raspbian WiFi disconnect)
  • Fark this: How to solve Edimax EW-7612UAn v2 (7392:7822) power management issues on Raspberry Pi (Raspbian WiFi disconnect)
  • Bookmark How to solve Edimax EW-7612UAn v2 (7392:7822) power management issues on Raspberry Pi (Raspbian WiFi disconnect) at YahooMyWeb
  • Bookmark How to solve Edimax EW-7612UAn v2 (7392:7822) power management issues on Raspberry Pi (Raspbian WiFi disconnect) at Furl.net
  • Bookmark How to solve Edimax EW-7612UAn v2 (7392:7822) power management issues on Raspberry Pi (Raspbian WiFi disconnect) at reddit.com
  • Bookmark How to solve Edimax EW-7612UAn v2 (7392:7822) power management issues on Raspberry Pi (Raspbian WiFi disconnect) at blinklist.com
  • Bookmark How to solve Edimax EW-7612UAn v2 (7392:7822) power management issues on Raspberry Pi (Raspbian WiFi disconnect) at Spurl.net
  • Bookmark How to solve Edimax EW-7612UAn v2 (7392:7822) power management issues on Raspberry Pi (Raspbian WiFi disconnect) at NewsVine
  • Bookmark How to solve Edimax EW-7612UAn v2 (7392:7822) power management issues on Raspberry Pi (Raspbian WiFi disconnect) at Simpy.com
  • Bookmark How to solve Edimax EW-7612UAn v2 (7392:7822) power management issues on Raspberry Pi (Raspbian WiFi disconnect) at blogmarks
  • Bookmark How to solve Edimax EW-7612UAn v2 (7392:7822) power management issues on Raspberry Pi (Raspbian WiFi disconnect) with wists
  • wong it!
  • Bookmark using any bookmark manager!
  • Stumble It!
  • Print this article!
  • E-mail this story to a friend!
  • Identi.ca

Using a Raspberry Pi running raspbmc to sync Fitbit One with galileo (fitbit linux sync)

(it should work with any other Debian-based Raspberry Pi distribution and all newer Fitbit devices that use BLE)
sudo -i
apt-get update
apt-get install python-pip
pip install galileo
galileo

You can then use cron or a simple shell script to periodically run galileo.

  • Twitter
  • Bookmark Using a Raspberry Pi running raspbmc to sync Fitbit One with galileo (fitbit linux sync) at del.icio.us
  • Facebook
  • Google Bookmarks
  • FriendFeed
  • Digg Using a Raspberry Pi running raspbmc to sync Fitbit One with galileo (fitbit linux sync)
  • Mixx Using a Raspberry Pi running raspbmc to sync Fitbit One with galileo (fitbit linux sync)
  • Bloglines Using a Raspberry Pi running raspbmc to sync Fitbit One with galileo (fitbit linux sync)
  • Technorati Using a Raspberry Pi running raspbmc to sync Fitbit One with galileo (fitbit linux sync)
  • Fark this: Using a Raspberry Pi running raspbmc to sync Fitbit One with galileo (fitbit linux sync)
  • Bookmark Using a Raspberry Pi running raspbmc to sync Fitbit One with galileo (fitbit linux sync) at YahooMyWeb
  • Bookmark Using a Raspberry Pi running raspbmc to sync Fitbit One with galileo (fitbit linux sync) at Furl.net
  • Bookmark Using a Raspberry Pi running raspbmc to sync Fitbit One with galileo (fitbit linux sync) at reddit.com
  • Bookmark Using a Raspberry Pi running raspbmc to sync Fitbit One with galileo (fitbit linux sync) at blinklist.com
  • Bookmark Using a Raspberry Pi running raspbmc to sync Fitbit One with galileo (fitbit linux sync) at Spurl.net
  • Bookmark Using a Raspberry Pi running raspbmc to sync Fitbit One with galileo (fitbit linux sync) at NewsVine
  • Bookmark Using a Raspberry Pi running raspbmc to sync Fitbit One with galileo (fitbit linux sync) at Simpy.com
  • Bookmark Using a Raspberry Pi running raspbmc to sync Fitbit One with galileo (fitbit linux sync) at blogmarks
  • Bookmark Using a Raspberry Pi running raspbmc to sync Fitbit One with galileo (fitbit linux sync) with wists
  • wong it!
  • Bookmark using any bookmark manager!
  • Stumble It!
  • Print this article!
  • E-mail this story to a friend!
  • Identi.ca