Commit Graph

6443 Commits

Author SHA1 Message Date
TW dde13d7122
Merge pull request #5636 from ThomasWaldmann/fix-put-updates-shadow-index
Fix "put updates shadow index"
2021-01-29 17:31:35 +01:00
Thomas Waldmann f079a83fed fix updating shadow_index also in put
The shadow_index should be in same state after both of these sequences
(let's assume that A is not in repo yet for simplicity, but it does not matter):

a) explicit delete: put(A), delete(A), put(A), resulting in: PUT A, DEL A, PUT A repo contents

b) implicit delete: put(A), put(A), resulting in: PUT A, DEL A, PUT A repo contents
2021-01-29 17:05:01 +01:00
Thomas Waldmann 5f32b5666a deduplicate code of put and delete, no functional change 2021-01-29 17:05:01 +01:00
TW e3d8b7c9ea
Merge pull request #5614 from ThomasWaldmann/remove-empty-shadowed-segments-list-master
remove empty shadowed_segments lists, fixes #5275
2021-01-29 16:33:40 +01:00
Thomas Waldmann 6f00b025d8 remove empty shadowed_segments lists, fixes #5275
also:
- add test for removed empty shadowed_segments list
- add some comments
- add repo_dump test debug tool
2021-01-29 15:44:49 +01:00
TW 9c988ee632
Merge pull request #5662 from ThomasWaldmann/dump-hints
implement borg debug dump-hints
2021-01-29 15:42:22 +01:00
Thomas Waldmann a83fdd7de9 implement borg debug dump-hints 2021-01-29 14:11:32 +01:00
TW 0b76194a58
Merge pull request #5647 from ThomasWaldmann/blake2-from-py36
use blake2 from py36
2021-01-28 18:23:53 +01:00
Thomas Waldmann c3df6fcca4 fix docs about blake2 requirements / origin 2021-01-28 18:00:00 +01:00
Thomas Waldmann c8e9131158 remove bundled blake2 code, usage of libb2
we just use it via python3 now.
2021-01-28 18:00:00 +01:00
Thomas Waldmann 1dbe86a14e use blake2b from hashlib 2021-01-28 18:00:00 +01:00
Thomas Waldmann 6fa5bb4630 add tests for blake2b_128 2021-01-28 17:59:46 +01:00
Ryan Polley 83116e58f2
add examples for --paths-from-stdin, --paths-from-command, --paths-separator (#5644)
docs: add examples for --paths-from-stdin, --paths-from-command, --paths-separator
2021-01-27 00:15:14 +01:00
SanskritFritz 4346c4e85b Tab completion support for additional archives for 'borg delete'
Bash and Fish tab completions now too support more than just one
archive provided for 'borg delete'.
2021-01-26 22:43:05 +01:00
TW b20c7229e6
Merge pull request #5642 from rpolley/fix-grammar-in-docs-5632
fix grammar in faq
2021-01-23 01:44:28 +01:00
TW 2d8c9f1acf
Merge pull request #5643 from rpolley/update-docs-on-dev-env-setup-#5504
Update docs for dev environment installation instructions
2021-01-23 01:40:26 +01:00
Ryan Polley 1c5b57f1b3 recomend running tests only on installed versions for setup 2021-01-22 16:21:13 -06:00
Ryan Polley 974fd9eecb add link back to git-installation 2021-01-22 16:12:52 -06:00
Ryan Polley 921cac0177 fix grammar in faq 2021-01-22 14:35:45 -06:00
TW 699256edbd
Merge pull request #5620 from ThomasWaldmann/sparse-file-integr2
Sparse file support (integration)
2021-01-17 17:45:53 +01:00
Thomas Waldmann 6dc334422e fixup: improve comment about assumptions in the item metadata stream chunker 2021-01-15 21:51:15 +01:00
Thomas Waldmann 2391d160a8 add all-zero detection to buzhash chunk data processing 2021-01-15 21:27:29 +01:00
Thomas Waldmann 2d76365214 cosmetic: directly set allocation instead going via is_zero 2021-01-15 21:10:07 +01:00
Thomas Waldmann 8162e2e67b cached_hash is only used in archive, move it there 2021-01-14 20:50:12 +01:00
Thomas Waldmann e41dc6e96f use zeros for benchmarks 2021-01-14 20:19:10 +01:00
Thomas Waldmann be257728ca move zeros to constants module 2021-01-14 20:02:18 +01:00
Thomas Waldmann 3b9798cffc remove max_chunk_size (unused) 2021-01-14 19:56:39 +01:00
TW 4041bdf169
Merge pull request #5606 from ThomasWaldmann/fix-5603-master
do not recurse into duplicate roots, fixes #5603 (master)
2021-01-11 16:51:49 +01:00
TW abb87ce68b
Merge pull request #5623 from infectormp/patch-4
Add badge with current status of package
2021-01-10 13:54:36 +01:00
infectormp ab97bc20ed
Add badge with current status of package 2021-01-09 17:58:47 +03:00
Thomas Waldmann 4e3be1db5e reuse zeros also in fixed-size chunker for all-zero chunk detection
also: zeros.startswith() is faster
2021-01-08 23:39:53 +01:00
Thomas Waldmann ef19d937ed use cached_hash also to generate all-zero replacement chunks
at least for major amounts of fixed-size replacement hashes,
this will be much faster. also less memory management overhead.
2021-01-08 23:39:53 +01:00
Thomas Waldmann f3088a9893 rename chunk_to_id_data to cached_hash 2021-01-08 23:39:53 +01:00
Thomas Waldmann 92f221075a refactor recreate to use chunk_to_id_data 2021-01-08 23:39:53 +01:00
Thomas Waldmann b3659e0b8c reuse chunker.zeros for sparse extraction 2021-01-08 23:39:53 +01:00
Thomas Waldmann 9fd284ce1a refactor new zero chunk handling to be reusable 2021-01-08 23:39:53 +01:00
Thomas Waldmann 6d0f9a52eb detect all-zero chunks, avoid hashing them
comparing zeros is quicker than hashing them.
the comparison should fail quickly inside non-zero data.
2021-01-08 17:40:06 +01:00
Thomas Waldmann 52bd55b29a integrate Chunk type, avoid hashing holes 2021-01-08 17:39:51 +01:00
Thomas Waldmann 7319f85b54 adapt the existing chunker tests 2021-01-08 17:33:25 +01:00
Thomas Waldmann 8c299696aa Chunker: yield Chunk namedtuple instead of bytes/memoryview 2021-01-08 01:10:44 +01:00
TW 37d4aee122
Merge pull request #5597 from Gelma/typos_dec
Fix typos
2021-01-07 19:21:03 +01:00
Thomas Waldmann 7a3a49e99b reverted changes to 3rd party code
all algorithms/* stuff needs to be fixed upstream.

we just copy the files from there now and then.

https://github.com/lz4/lz4
https://github.com/facebook/zstd
https://github.com/Cyan4973/xxHash
2021-01-07 18:18:15 +01:00
Thomas Waldmann 0984e00d31 revert changes to autogenerated files
this stuff will be auto-generated, regularly done at release time.
2021-01-07 18:08:49 +01:00
Andrea Gelmini 72e7c46fa7 Fix typos 2021-01-07 17:54:33 +01:00
TW 41d282bc14
Merge pull request #5615 from jedie/patch-1
Change docs/install instruction: "python-virtualenv" -> "python3-virtualenv"
2021-01-07 17:13:31 +01:00
Jens Diemer 5a585c5c2e
"python-virtualenv" -> "python3-virtualenv" 2021-01-07 10:31:26 +01:00
TW 268eb2e598
Merge pull request #5610 from ThomasWaldmann/update-changes-master
update CHANGES
2021-01-04 19:50:56 +01:00
Thomas Waldmann 4394fa45ba update CHANGES 2021-01-03 21:40:31 +01:00
TW 9088b1e85a
Merge pull request #5608 from ThomasWaldmann/improve-borg-check-logging-master
check: debug log segment filename
2021-01-03 19:04:40 +01:00
Thomas Waldmann f2cb17d66c check: debug log segment filename 2021-01-03 18:23:52 +01:00