Commit Graph

2356 Commits

Author SHA1 Message Date
TW 316c0cd6f0 Merge pull request #1455 from ThomasWaldmann/fix-compr-buffer-size
LZ4: dynamically enlarge the (de)compression buffer, fixes #1453
2016-08-09 18:36:55 +02:00
TW 4c51bed665 Merge pull request #1454 from ThomasWaldmann/enfore-max-object-size-put
repo: do not put objects that we won't get, fixes #1451
2016-08-09 18:17:03 +02:00
Thomas Waldmann 20392f8dd9 repo: split size check into too small and too big
also add a hint if somebody needs to restore an archive that has too big objects.
2016-08-09 18:05:22 +02:00
Thomas Waldmann a360307938 repo: do not put objects that we won't get, fixes #1451
we will not get() objects that have a segment entry larger than MAX_OBJECT_SIZE.
thus we should never produce such entries.

also: introduce repository.MAX_DATA_SIZE that gives the max payload size.
2016-08-09 18:05:22 +02:00
Thomas Waldmann b0e7bb5ddc fixup: use thread-local buffer
start with 0 bytes length (saves memory in case lz4 is not used).
always grow when a bigger buffer is needed.
avoid per-call reallocation / freeing / garbage.
2016-08-09 17:05:24 +02:00
Thomas Waldmann d3000a7e5d LZ4: dynamically enlarge the (de)compression buffer, fixes #1453
the statically allocated COMPR_BUFFER was right size for chunks,
but not for the archive item which could get larger if you have
many millions of files/dirs.
2016-08-09 02:52:21 +02:00
Thomas Waldmann 6c1c87f7ae add forgotten usage help file from build_usage 2016-08-06 01:28:02 +02:00
Thomas Waldmann a56b010960 ran build_usage 2016-08-05 20:26:09 +02:00
Thomas Waldmann 5b575f69dc CHANGES: add date to 1.0.7rc1 2016-08-05 20:23:47 +02:00
TW 58a9ccb49d Merge pull request #1441 from ThomasWaldmann/update-1.0-changes
update CHANGES
2016-08-05 20:01:49 +02:00
Thomas Waldmann b79e913244 update CHANGES 2016-08-05 19:56:10 +02:00
TW 18654eaf91 Merge pull request #1371 from ThomasWaldmann/fix-deadlock
fix deadlock
2016-08-05 19:48:51 +02:00
Thomas Waldmann 33e3348208 locking: better differentiate new vs. old clients, lock upgrade for replay
old clients use self.exclusive = None and do a read->write lock upgrade when needed.
new clients use self.exclusive = True/False and never upgrade.

replay fakes an old client by setting self.exclusive = None to get a lock upgrade if needed.
2016-08-05 19:11:16 +02:00
Thomas Waldmann 64dcbbfdd0 change RPC API, fix remote repo tests 2016-08-05 19:11:16 +02:00
Thomas Waldmann 1e739fd52d fix local repo / upgrader tests 2016-08-05 19:06:38 +02:00
Thomas Waldmann d3d51e12ea rename UpgradableLock to Lock
lock upgrading is troublesome / may deadlock, do not advertise it.
2016-08-05 19:06:09 +02:00
Thomas Waldmann 2a355e547e make sure we have a excl. lock when starting a transaction
if we don't, we try to upgrade the lock.
this is to support old clients talking to a new server and also
to avoid bad consequences from coding mistakes for new clients.
2016-08-05 18:55:32 +02:00
Thomas Waldmann 26007c0162 add Lock.got_exclusive_lock 2016-08-05 18:52:20 +02:00
TW 976925c625 Merge pull request #1436 from ThomasWaldmann/fix-fuse-tests
fix fuse tests on OS X, fixes #1433
2016-08-05 15:08:16 +02:00
TW 109c095c42 Merge pull request #1435 from ThomasWaldmann/fix-1430
fix unintended file cache eviction, fixes #1430
2016-08-05 14:19:56 +02:00
TW 3fac548b34 Merge pull request #1431 from ThomasWaldmann/osxfuse-3.4
Vagrantfile: use FUSE for macOS 3.4.1
2016-08-05 14:08:04 +02:00
TW d050efbe34 Merge pull request #1438 from ThomasWaldmann/debug-dump-repo-objs
borg debug-dump-repo-objs
2016-08-05 14:06:20 +02:00
Thomas Waldmann b96bc155ac fix unintended file cache eviction, fixes #1430
thanks much to e477 for diagnosing this and finding the right fix.
2016-08-05 13:59:21 +02:00
Thomas Waldmann 4fa420ef29 borg debug-dump-repo-objs
dump all objects stored in the repository (decrypted and decompressed)
2016-08-05 13:48:48 +02:00
TW 33ee2b0897 Merge pull request #1437 from robmv/patch-2
Add backup using stable filesystem names recommendation
2016-08-04 09:56:38 +02:00
Robert Marcano bc6050bc3c Add backup using stable filesystem names recommendation 2016-08-03 22:54:51 -04:00
Thomas Waldmann 40163c2e9f fix fuse tests on OS X, fixes #1433
NOATIME support needed checking and the flagfile was UF_NODUMP and thus not there in the backup archive.

Note: i have just duplicated the has_noatime function instead of refactoring it to be global,
to avoid merge conflicts in case we cherry-pick the test improvements from master.
2016-08-04 01:32:01 +02:00
Thomas Waldmann b5d605e5aa Vagrantfile: use FUSE for macOS 3.4.1
Note: "FUSE for OS X" was renamed to "FUSE for macOS".
2016-08-03 18:23:43 +02:00
TW 3456bb08a5 Merge pull request #1423 from leo-b/1.0-maint-version_placeholder
borgversion placeholder 1.0-maint
2016-08-02 18:43:45 +02:00
Alexander 'Leo' Bergolth 54048a339c add new placeholder {borgversion}
substitute placeholders in --remote-path
add BORG_VERSION environment variable before executing ssh command
2016-08-02 17:03:13 +02:00
enkore e5a3229fd2 Merge pull request #1417 from ThomasWaldmann/glibc-check
glibc check improved / faq added
2016-07-31 23:27:36 +02:00
Thomas Waldmann 8e222d8fd9 glibc compatibility: add FAQ entry, fixes #491 2016-07-31 14:42:34 +02:00
Thomas Waldmann e1a97c76b0 glibc_check.py: improve / fix docstring 2016-07-31 14:20:06 +02:00
TW d020c6f776 Merge pull request #1414 from ThomasWaldmann/configurable-files-cache-ttl
implement BORG_FILES_CACHE_TTL, update FAQ
2016-07-31 13:37:38 +02:00
Thomas Waldmann 5f7b466969 implement BORG_FILES_CACHE_TTL, update FAQ
raise default ttl to 20 (previously: 10).
2016-07-31 01:33:46 +02:00
enkore 2e969a7418 Merge pull request #1408 from ThomasWaldmann/fix-remote-repo-teardown
RemoteRepository init: always call close on exceptions, fixes #1370
2016-07-31 00:25:13 +02:00
TW 473b1d03ee Merge pull request #1409 from ThomasWaldmann/fix-pkg-config-name
OS X: install pkg-config to build with FUSE support, fixes #1400
2016-07-30 21:09:31 +02:00
Thomas Waldmann 4e737cb64b OS X: install pkg-config to build with FUSE support 2016-07-30 21:08:20 +02:00
Thomas Waldmann 5a83f74418 RemoteRepository init: always call close on exceptions, fixes #1370
This fixes the cosmetic issue that the cleanup happened in __del__ and caused an AssertionError there.
2016-07-30 19:42:25 +02:00
TW 1ccadd4ab8 Merge pull request #1403 from ThomasWaldmann/fix-1125
FUSE: always create a root dir, fixes #1125
2016-07-30 15:43:05 +02:00
TW 2cb9533ccc Merge pull request #1402 from ThomasWaldmann/fix-1351
Fix 1351
2016-07-30 15:28:29 +02:00
Thomas Waldmann 32320c2f9f FUSE: always create a root dir, fixes #1125
also: refactor / deduplicate directory creation
2016-07-29 00:24:18 +02:00
TW e06b89abb3 Merge pull request #1401 from PlasmaPower/fuse-cache-partially-read
borg mount: cache partially read data chunks
2016-07-28 22:34:03 +02:00
Thomas Waldmann 97383e9e60 transform unpacker exception only at 1 place 2016-07-28 22:23:38 +02:00
Thomas Waldmann 852c583076 handle unpacker exception with tighter scope 2016-07-28 22:12:34 +02:00
Thomas Waldmann edea587f35 catch unpacker exceptions, resync, fixes #1351 2016-07-28 22:10:29 +02:00
Lee Bousfield d126265fe4
borg mount: cache partially read data chunks
Cherry-pick of bfb00df from master to 1.0-maint
2016-07-28 15:59:36 -04:00
TW 9f996da640 Merge pull request #1380 from jzacsh/document-envvars-pitfalls
doc: quickstart on shell pitfalls for env. vars
2016-07-28 20:18:32 +02:00
Jonathan Zacsh 1eaf1b7365
follow automation quickstart w/env. var pitfalls
Mostly commentary on proper `export` usage, pitfall w/sudo, and debugging tips.
2016-07-28 14:10:28 -04:00
TW 10ecb1792d Merge pull request #1386 from PlasmaPower/init-append-only
Add --append-only to borg init (1.0-maint)
2016-07-28 01:15:32 +02:00