Commit Graph

2852 Commits

Author SHA1 Message Date
TW 316c0cd6f0 Merge pull request #1455 from ThomasWaldmann/fix-compr-buffer-size
LZ4: dynamically enlarge the (de)compression buffer, fixes #1453
2016-08-09 18:36:55 +02:00
TW 4c51bed665 Merge pull request #1454 from ThomasWaldmann/enfore-max-object-size-put
repo: do not put objects that we won't get, fixes #1451
2016-08-09 18:17:03 +02:00
Thomas Waldmann 20392f8dd9 repo: split size check into too small and too big
also add a hint if somebody needs to restore an archive that has too big objects.
2016-08-09 18:05:22 +02:00
Thomas Waldmann a360307938 repo: do not put objects that we won't get, fixes #1451
we will not get() objects that have a segment entry larger than MAX_OBJECT_SIZE.
thus we should never produce such entries.

also: introduce repository.MAX_DATA_SIZE that gives the max payload size.
2016-08-09 18:05:22 +02:00
Thomas Waldmann fc92822b6c explain the confusing TypeError, fixes #1456 2016-08-09 17:35:27 +02:00
Thomas Waldmann b0e7bb5ddc fixup: use thread-local buffer
start with 0 bytes length (saves memory in case lz4 is not used).
always grow when a bigger buffer is needed.
avoid per-call reallocation / freeing / garbage.
2016-08-09 17:05:24 +02:00
Thomas Waldmann d3000a7e5d LZ4: dynamically enlarge the (de)compression buffer, fixes #1453
the statically allocated COMPR_BUFFER was right size for chunks,
but not for the archive item which could get larger if you have
many millions of files/dirs.
2016-08-09 02:52:21 +02:00
enkore 51054da692 Merge pull request #1444 from ThomasWaldmann/merge-1.0-maint
Merge 1.0 maint
2016-08-08 20:28:35 +02:00
Marian Beermann 0a65e83df3 check --verify-data: remove incorrect help paragraph
(since d0ec7e76bb - doesn't mean this probably useful feature may not
 be reimplemented, on the contrary)
2016-08-08 16:38:31 +02:00
Marian Beermann bec5051ea5 helpers.format_timedelta: use timedelta.total_seconds() 2016-08-08 16:38:31 +02:00
Marian Beermann 389ca94407 Silence repeated "Processing files..." log entries when --no-files-cache 2016-08-08 16:38:31 +02:00
Marian Beermann 4d7a52d8e0 --debug-topic for granular debug logging
Especially: disables file-compression logging by default
2016-08-08 16:38:31 +02:00
Marian Beermann 7b70b74ad1 ArchiveRecreater.incref_partial_chunks try to use __contains__ 2016-08-08 15:54:47 +02:00
Marian Beermann 5fe6c09c34 Refactor ArchiveRecreater.try_resume 2016-08-08 15:54:41 +02:00
Thomas Waldmann 6c1c87f7ae add forgotten usage help file from build_usage 2016-08-06 01:28:02 +02:00
Thomas Waldmann dbe862f3d8 Merge branch '1.0-maint' into merge-1.0-maint 2016-08-06 01:24:22 +02:00
Thomas Waldmann a56b010960 ran build_usage 2016-08-05 20:26:09 +02:00
Thomas Waldmann 5b575f69dc CHANGES: add date to 1.0.7rc1 2016-08-05 20:23:47 +02:00
TW 58a9ccb49d Merge pull request #1441 from ThomasWaldmann/update-1.0-changes
update CHANGES
2016-08-05 20:01:49 +02:00
Thomas Waldmann b79e913244 update CHANGES 2016-08-05 19:56:10 +02:00
TW 18654eaf91 Merge pull request #1371 from ThomasWaldmann/fix-deadlock
fix deadlock
2016-08-05 19:48:51 +02:00
Thomas Waldmann 33e3348208 locking: better differentiate new vs. old clients, lock upgrade for replay
old clients use self.exclusive = None and do a read->write lock upgrade when needed.
new clients use self.exclusive = True/False and never upgrade.

replay fakes an old client by setting self.exclusive = None to get a lock upgrade if needed.
2016-08-05 19:11:16 +02:00
Thomas Waldmann 64dcbbfdd0 change RPC API, fix remote repo tests 2016-08-05 19:11:16 +02:00
Thomas Waldmann 1e739fd52d fix local repo / upgrader tests 2016-08-05 19:06:38 +02:00
Thomas Waldmann d3d51e12ea rename UpgradableLock to Lock
lock upgrading is troublesome / may deadlock, do not advertise it.
2016-08-05 19:06:09 +02:00
Thomas Waldmann 2a355e547e make sure we have a excl. lock when starting a transaction
if we don't, we try to upgrade the lock.
this is to support old clients talking to a new server and also
to avoid bad consequences from coding mistakes for new clients.
2016-08-05 18:55:32 +02:00
Thomas Waldmann 26007c0162 add Lock.got_exclusive_lock 2016-08-05 18:52:20 +02:00
TW 976925c625 Merge pull request #1436 from ThomasWaldmann/fix-fuse-tests
fix fuse tests on OS X, fixes #1433
2016-08-05 15:08:16 +02:00
TW 109c095c42 Merge pull request #1435 from ThomasWaldmann/fix-1430
fix unintended file cache eviction, fixes #1430
2016-08-05 14:19:56 +02:00
TW 3fac548b34 Merge pull request #1431 from ThomasWaldmann/osxfuse-3.4
Vagrantfile: use FUSE for macOS 3.4.1
2016-08-05 14:08:04 +02:00
TW d050efbe34 Merge pull request #1438 from ThomasWaldmann/debug-dump-repo-objs
borg debug-dump-repo-objs
2016-08-05 14:06:20 +02:00
Thomas Waldmann b96bc155ac fix unintended file cache eviction, fixes #1430
thanks much to e477 for diagnosing this and finding the right fix.
2016-08-05 13:59:21 +02:00
Thomas Waldmann 4fa420ef29 borg debug-dump-repo-objs
dump all objects stored in the repository (decrypted and decompressed)
2016-08-05 13:48:48 +02:00
TW 33ee2b0897 Merge pull request #1437 from robmv/patch-2
Add backup using stable filesystem names recommendation
2016-08-04 09:56:38 +02:00
Robert Marcano bc6050bc3c Add backup using stable filesystem names recommendation 2016-08-03 22:54:51 -04:00
Thomas Waldmann 40163c2e9f fix fuse tests on OS X, fixes #1433
NOATIME support needed checking and the flagfile was UF_NODUMP and thus not there in the backup archive.

Note: i have just duplicated the has_noatime function instead of refactoring it to be global,
to avoid merge conflicts in case we cherry-pick the test improvements from master.
2016-08-04 01:32:01 +02:00
Thomas Waldmann b5d605e5aa Vagrantfile: use FUSE for macOS 3.4.1
Note: "FUSE for OS X" was renamed to "FUSE for macOS".
2016-08-03 18:23:43 +02:00
TW c7b7e76ddd Merge pull request #1427 from anarcat/patch-4
mention where code, issues and support is
2016-08-03 17:47:53 +02:00
TW 9b0d8df0f8 Merge pull request #1373 from PlasmaPower/filesystem-test-skipping
Filesystem feature detection and test skipping
2016-08-03 17:46:34 +02:00
anarcat 661e8ebceb point to code, issues and support in devel section
real story: users that are also developpers expect to find out where
to submit issues and pull requests in the development section, but
couldn't. add some meat there and point to the support section for
everything else.
2016-08-03 11:37:46 -04:00
TW 29e5e558bc Merge pull request #1412 from ThomasWaldmann/info-repo
borg info REPO
2016-08-02 23:29:39 +02:00
Thomas Waldmann 770a892b2d implement borg info REPO
currently it is just the same global stats also shown in "borg info ARCHIVE",
just without the archive-specific stats.

also: add separate test for "borg info".
2016-08-02 20:06:24 +02:00
TW 3456bb08a5 Merge pull request #1423 from leo-b/1.0-maint-version_placeholder
borgversion placeholder 1.0-maint
2016-08-02 18:43:45 +02:00
Alexander 'Leo' Bergolth 54048a339c add new placeholder {borgversion}
substitute placeholders in --remote-path
add BORG_VERSION environment variable before executing ssh command
2016-08-02 17:03:13 +02:00
enkore b7a563885d Merge pull request #1413 from ThomasWaldmann/store-mountpoint-dirs
save mountpoint dirs, fixes #1033
2016-08-01 15:51:53 +02:00
Thomas Waldmann 2b454fc54b save mountpoint dirs, fixes #1033 2016-08-01 15:25:54 +02:00
enkore e5a3229fd2 Merge pull request #1417 from ThomasWaldmann/glibc-check
glibc check improved / faq added
2016-07-31 23:27:36 +02:00
enkore 3079b6451e Merge pull request #1410 from ThomasWaldmann/doc-tweaks
docs: remove borg list example, be more specific about compression heuristics
2016-07-31 23:21:15 +02:00
Thomas Waldmann 8e222d8fd9 glibc compatibility: add FAQ entry, fixes #491 2016-07-31 14:42:34 +02:00
Thomas Waldmann e1a97c76b0 glibc_check.py: improve / fix docstring 2016-07-31 14:20:06 +02:00