We were in fact only deleting stale marker when we got an incremental
update, rather than when we did a full resync.