Commit Graph

2927 Commits

Author SHA1 Message Date
Marian Beermann adaeb32cd4 Repository: fix repo not closed cleanly on InvalidRepository exception 2016-08-18 00:54:10 +02:00
Marian Beermann c39e395ecf Exclude incompatible tests for ArchiverTestCaseBinary 2016-08-17 23:01:20 +02:00
Marian Beermann 8268e26c6b extract: refactor filter building 2016-08-17 22:36:25 +02:00
Martin Hostettler 724586e965 Add test for preloading releated leaks on extract with --strip-components 2016-08-17 01:35:43 +02:00
Martin Hostettler c84ad6b7b1 Archiver.do_extract: Fix leak of downloaded chunk contents caused by preloading
Include condition that path is non empty after applying strip_components into
filter passed to iter_items.

All filtering of files to extract must be done in the filter callable used in
archive.iter_items because iter_items will preload all chunks used in items
it returns. If they are not actually extracted the accumulate in the
responsed dict.
2016-08-17 01:35:35 +02:00
Marian Beermann 26e8ff2cbc Repository: don't use defaultdict for shadow index
avoids errors by accidentally inserting an empty list and makes it more clear.
2016-08-17 01:17:49 +02:00
Marian Beermann 833f8d1373 Track entire session
Note how this enables the much stricter check in test_moved_deletes_are_tracked
2016-08-17 01:17:49 +02:00
Marian Beermann ac41ebcf78 Track shadowing of log entries
Fixes (benign) index vs. log inconsistencies when segments are skipped
during compaction.
2016-08-17 01:17:49 +02:00
Marian Beermann 21c3fb3b93 compact_segments: add segment-level logging 2016-08-17 01:16:25 +02:00
TW f7c1c71ff1 Merge pull request #1489 from enkore/issue/1486
Fix borg-list --list-format
2016-08-16 21:35:25 +02:00
enkore 8718c24856 Merge pull request #1488 from ThomasWaldmann/fix-timestamp-key-name
fix timestamp key name, fixes #1487
2016-08-16 21:28:30 +02:00
Marian Beermann f3defb02de Fix borg-list empty format
Should produce empty output, not default output.
2016-08-16 20:46:58 +02:00
Marian Beermann 146d531d9e Fix borg-list --list-format 2016-08-16 20:46:54 +02:00
Thomas Waldmann 30cd7f3f21 fix timestamp key name 2016-08-16 20:36:29 +02:00
enkore 35a0ab2183 Merge pull request #1481 from ThomasWaldmann/debug-info
implement borg debug-info, fixes #1122
2016-08-16 01:21:19 +02:00
enkore 1bcf3d2317 Merge pull request #1482 from ThomasWaldmann/skip-noatime-test-hurd
skip the O_NOATIME test on GNU Hurd, fixes #1315
2016-08-16 01:20:14 +02:00
Thomas Waldmann 2a434c3928 skip the O_NOATIME test on GNU Hurd, fixes #1315
GNU Hurd needs to fix their O_NOATIME, after that we can
re-enable the test on that platform.
2016-08-15 22:49:38 +02:00
Thomas Waldmann e50646a07b implement borg debug-info, fixes #1122
In tracebacks we have it already, but with the command,
you can have it without a traceback also.
2016-08-15 19:20:51 +02:00
enkore d5edaa502c Merge pull request #1161 from ThomasWaldmann/pretty-archive
make source more pretty
2016-08-15 18:42:58 +02:00
enkore a0df0a9494 Merge pull request #1480 from ThomasWaldmann/clean-repo-release
use a clean repo to test / build the release
2016-08-15 17:35:39 +02:00
Thomas Waldmann 2f70e3f69a src cleanup: do not use XXX in strings if just any other string works also
XXX is usually used in comments to mark questionable places in the source.
2016-08-15 16:01:23 +02:00
Thomas Waldmann 3c8d86354b src cleanup: get rid of text-as-bytes in borg.remote 2016-08-15 15:52:19 +02:00
Thomas Waldmann e3c155e75a use a clean repo to test / build the release 2016-08-15 15:41:24 +02:00
Thomas Waldmann 1f056d9e8a more safe interface for manifest.archives 2016-08-15 15:03:05 +02:00
Thomas Waldmann b6d0eb99a5 add and use ManifestItem 2016-08-15 02:01:13 +02:00
Thomas Waldmann c8922c8b3d use ArchiveItem 2016-08-15 01:11:33 +02:00
Thomas Waldmann 585407f4f4 introduce ArchiveItem, see #1157 2016-08-14 22:04:01 +02:00
TW 6e9debb027 Merge pull request #1420 from enkore/f/recreate1.1rc1
recreate goals for 1.1rc1
2016-08-14 18:04:41 +02:00
Marian Beermann f0e9a55ebf recreate: document that absolute patterns won't match 2016-08-14 17:46:59 +02:00
Marian Beermann 93b1cf3453 recreate: --target 2016-08-14 17:46:59 +02:00
Marian Beermann 88798ae949 recreate: --always-recompress, --compression-from
what a mess
2016-08-14 17:46:59 +02:00
Marian Beermann 5433b1a1e4 Add Compressor.detect(data) -> CompressBase impl 2016-08-14 17:41:34 +02:00
Marian Beermann c2c90645ad Add Key.assert_id function 2016-08-14 17:41:33 +02:00
Marian Beermann a80b371d09 Add decompress arg to Key.decrypt 2016-08-14 17:41:33 +02:00
TW 774609cd9f Merge pull request #1478 from ThomasWaldmann/merge-1.0-maint
Merge 1.0 maint
2016-08-14 17:27:51 +02:00
Marian Beermann ac80332ce7 Merge branch '1.0-maint' into master
# Conflicts:
#	src/borg/repository.py
#	src/borg/testsuite/repository.py
2016-08-14 15:51:49 +02:00
Thomas Waldmann 42b6a838da fix cyclic import issue, fix tests
needed to increase ChunkBuffer size due to increased items stream chunk size
to get the test working.
2016-08-14 15:26:56 +02:00
Thomas Waldmann 8be6761c26 Merge commit 'feb7e2517ef7ec07cc638953a86c726aada7d37e' 2016-08-14 15:05:11 +02:00
TW c19fb8b921 Merge pull request #1477 from borgbackup/1.0.7rc2rst
Fix changes.rst formatting, clarify changelog
2016-08-13 15:18:51 +02:00
enkore 17aacb9719 Fix changes.rst formatting, clarify changelog 2016-08-13 10:18:41 +02:00
TW 4712b9d133 Merge pull request #1474 from ThomasWaldmann/update-1.0-changes
update CHANGES
2016-08-13 02:24:32 +02:00
Thomas Waldmann 07b47ef4a5 update CHANGES 2016-08-13 02:23:40 +02:00
TW a12672530c Merge pull request #1448 from enkore/issue/1442
Fix untracked segments made by moved DELETEs
2016-08-13 02:13:27 +02:00
TW feb7e2517e Merge pull request #1472 from ThomasWaldmann/lz4-buffer
lz4 reusing helpers.Buffer
2016-08-13 02:13:11 +02:00
TW df967722e3 Merge pull request #1471 from ThomasWaldmann/buffer
refactor buffer code into helpers.Buffer class
2016-08-13 02:02:34 +02:00
Marian Beermann 3b716f98ff Add regression test for 95cf337 2016-08-13 01:47:51 +02:00
Marian Beermann 95cf337fa5 Fix untracked segments made by moved DELETEs
Fixes #1442

(note that the segments _still_ get generated, see the comment, they
 should be collected now on the next compaction run)
2016-08-13 01:46:37 +02:00
Thomas Waldmann e1bc7b62f6 lz4: reuse helpers.Buffer 2016-08-13 01:46:15 +02:00
Thomas Waldmann ef9e8a584b refactor buffer code into helpers.Buffer class, add tests 2016-08-13 01:45:23 +02:00
TW 00449ad7b0 Merge pull request #1470 from ThomasWaldmann/document-archive-limit
document archive limitation, #1452
2016-08-13 00:12:17 +02:00