Thomas Waldmann
3d21dd6d55
fix rst markup in FAQ
2021-02-06 01:24:14 +01:00
Thomas Waldmann
b1fff5dd39
FAQ: project_name -> Borg
...
see changeset 8d830d069f
where this was
started.
2021-02-06 01:24:14 +01:00
Thomas Waldmann
10368f9c2c
minor fix: fix order issue in test
2021-02-06 01:24:14 +01:00
TW
0ed75ca01d
Merge pull request #5670 from ThomasWaldmann/fix-shadow-index-put-again
...
revert incorrect fix for put updating shadow_index, fixes #5661
2021-02-05 17:07:41 +01:00
Thomas Waldmann
3d0c61a184
revert incorrect fix for put updating shadow_index, fixes #5661
...
A) the compaction code needs the shadow index only for this case:
segment A: PUT x, segment B: DEL x, with A < B (DEL shadows the PUT).
B) for the following case, we have no shadowing DEL (or rather: it does not matter,
because there is a PUT right after the DEL) and x is in the repo index,
thus the shadow_index is not needed for the special case in the compaction code:
segment A: PUT x, segment B: DEL x PUT x
see also PR #5636 .
reverts f079a83fed
and clarifies the code by more comments.
we keep the code deduplication of 5f32b5666a
and just add a update_shadow_index param to make it not look like there was
something accidentally forgotten, which was the whole reason for the reverted
"fix".
2021-02-04 02:29:43 +01:00
TW
f195a71e24
Merge pull request #5669 from ThomasWaldmann/misc-fixes-master
...
misc. crash fixes (master)
2021-02-03 16:35:10 +01:00
Thomas Waldmann
a77db94b01
fix bad default: manifest.archives.list(consider_checkpoints=False), fixes #5668
...
also, add a comment about it, to avoid future similar mistakes.
2021-02-03 14:13:27 +01:00
Thomas Waldmann
649603f247
only print stats if not Ctrl-C'ed
...
if the user interrupts by ctrl-c, we do not save the archive,
thus we can not show stats because archive.id will not be in
the chunks index.
2021-02-03 01:56:52 +01:00
TW
6844d33e7f
Merge pull request #5656 from SanskritFritz/master
...
Tab completion support for additional archives for 'borg delete'
2021-01-31 22:06:42 +01:00
TW
e4a2e16b77
Merge pull request #5666 from ThomasWaldmann/upgrade-msgpack
...
also accept msgpack up to 1.0.2
2021-01-30 22:01:15 +01:00
Thomas Waldmann
12d9110882
also accept msgpack up to 1.0.2
...
exclude 1.0.1 though, which had some issues (not sure whether they affect borg).
2021-01-30 21:31:33 +01:00
SanskritFritz
426fb9e8ec
Efficiency fixes thanks to @oxiedi
2021-01-30 13:16:27 +01:00
TW
dde13d7122
Merge pull request #5636 from ThomasWaldmann/fix-put-updates-shadow-index
...
Fix "put updates shadow index"
2021-01-29 17:31:35 +01:00
Thomas Waldmann
f079a83fed
fix updating shadow_index also in put
...
The shadow_index should be in same state after both of these sequences
(let's assume that A is not in repo yet for simplicity, but it does not matter):
a) explicit delete: put(A), delete(A), put(A), resulting in: PUT A, DEL A, PUT A repo contents
b) implicit delete: put(A), put(A), resulting in: PUT A, DEL A, PUT A repo contents
2021-01-29 17:05:01 +01:00
Thomas Waldmann
5f32b5666a
deduplicate code of put and delete, no functional change
2021-01-29 17:05:01 +01:00
TW
e3d8b7c9ea
Merge pull request #5614 from ThomasWaldmann/remove-empty-shadowed-segments-list-master
...
remove empty shadowed_segments lists, fixes #5275
2021-01-29 16:33:40 +01:00
Thomas Waldmann
6f00b025d8
remove empty shadowed_segments lists, fixes #5275
...
also:
- add test for removed empty shadowed_segments list
- add some comments
- add repo_dump test debug tool
2021-01-29 15:44:49 +01:00
TW
9c988ee632
Merge pull request #5662 from ThomasWaldmann/dump-hints
...
implement borg debug dump-hints
2021-01-29 15:42:22 +01:00
Thomas Waldmann
a83fdd7de9
implement borg debug dump-hints
2021-01-29 14:11:32 +01:00
TW
0b76194a58
Merge pull request #5647 from ThomasWaldmann/blake2-from-py36
...
use blake2 from py36
2021-01-28 18:23:53 +01:00
Thomas Waldmann
c3df6fcca4
fix docs about blake2 requirements / origin
2021-01-28 18:00:00 +01:00
Thomas Waldmann
c8e9131158
remove bundled blake2 code, usage of libb2
...
we just use it via python3 now.
2021-01-28 18:00:00 +01:00
Thomas Waldmann
1dbe86a14e
use blake2b from hashlib
2021-01-28 18:00:00 +01:00
Thomas Waldmann
6fa5bb4630
add tests for blake2b_128
2021-01-28 17:59:46 +01:00
Ryan Polley
83116e58f2
add examples for --paths-from-stdin, --paths-from-command, --paths-separator ( #5644 )
...
docs: add examples for --paths-from-stdin, --paths-from-command, --paths-separator
2021-01-27 00:15:14 +01:00
SanskritFritz
4346c4e85b
Tab completion support for additional archives for 'borg delete'
...
Bash and Fish tab completions now too support more than just one
archive provided for 'borg delete'.
2021-01-26 22:43:05 +01:00
TW
b20c7229e6
Merge pull request #5642 from rpolley/fix-grammar-in-docs-5632
...
fix grammar in faq
2021-01-23 01:44:28 +01:00
TW
2d8c9f1acf
Merge pull request #5643 from rpolley/update-docs-on-dev-env-setup-#5504
...
Update docs for dev environment installation instructions
2021-01-23 01:40:26 +01:00
Ryan Polley
1c5b57f1b3
recomend running tests only on installed versions for setup
2021-01-22 16:21:13 -06:00
Ryan Polley
974fd9eecb
add link back to git-installation
2021-01-22 16:12:52 -06:00
Ryan Polley
921cac0177
fix grammar in faq
2021-01-22 14:35:45 -06:00
TW
699256edbd
Merge pull request #5620 from ThomasWaldmann/sparse-file-integr2
...
Sparse file support (integration)
2021-01-17 17:45:53 +01:00
Thomas Waldmann
6dc334422e
fixup: improve comment about assumptions in the item metadata stream chunker
2021-01-15 21:51:15 +01:00
Thomas Waldmann
2391d160a8
add all-zero detection to buzhash chunk data processing
2021-01-15 21:27:29 +01:00
Thomas Waldmann
2d76365214
cosmetic: directly set allocation instead going via is_zero
2021-01-15 21:10:07 +01:00
Thomas Waldmann
8162e2e67b
cached_hash is only used in archive, move it there
2021-01-14 20:50:12 +01:00
Thomas Waldmann
e41dc6e96f
use zeros for benchmarks
2021-01-14 20:19:10 +01:00
Thomas Waldmann
be257728ca
move zeros to constants module
2021-01-14 20:02:18 +01:00
Thomas Waldmann
3b9798cffc
remove max_chunk_size (unused)
2021-01-14 19:56:39 +01:00
TW
4041bdf169
Merge pull request #5606 from ThomasWaldmann/fix-5603-master
...
do not recurse into duplicate roots, fixes #5603 (master)
2021-01-11 16:51:49 +01:00
TW
abb87ce68b
Merge pull request #5623 from infectormp/patch-4
...
Add badge with current status of package
2021-01-10 13:54:36 +01:00
infectormp
ab97bc20ed
Add badge with current status of package
2021-01-09 17:58:47 +03:00
Thomas Waldmann
4e3be1db5e
reuse zeros also in fixed-size chunker for all-zero chunk detection
...
also: zeros.startswith() is faster
2021-01-08 23:39:53 +01:00
Thomas Waldmann
ef19d937ed
use cached_hash also to generate all-zero replacement chunks
...
at least for major amounts of fixed-size replacement hashes,
this will be much faster. also less memory management overhead.
2021-01-08 23:39:53 +01:00
Thomas Waldmann
f3088a9893
rename chunk_to_id_data to cached_hash
2021-01-08 23:39:53 +01:00
Thomas Waldmann
92f221075a
refactor recreate to use chunk_to_id_data
2021-01-08 23:39:53 +01:00
Thomas Waldmann
b3659e0b8c
reuse chunker.zeros for sparse extraction
2021-01-08 23:39:53 +01:00
Thomas Waldmann
9fd284ce1a
refactor new zero chunk handling to be reusable
2021-01-08 23:39:53 +01:00
Thomas Waldmann
6d0f9a52eb
detect all-zero chunks, avoid hashing them
...
comparing zeros is quicker than hashing them.
the comparison should fail quickly inside non-zero data.
2021-01-08 17:40:06 +01:00
Thomas Waldmann
52bd55b29a
integrate Chunk type, avoid hashing holes
2021-01-08 17:39:51 +01:00