1
0
Fork 0
mirror of https://github.com/borgbackup/borg.git synced 2024-12-26 17:57:59 +00:00
Commit graph

6136 commits

Author SHA1 Message Date
Thomas Waldmann
a83fdd7de9 implement borg debug dump-hints 2021-01-29 14:11:32 +01:00
TW
0b76194a58
Merge pull request #5647 from ThomasWaldmann/blake2-from-py36
use blake2 from py36
2021-01-28 18:23:53 +01:00
Thomas Waldmann
c3df6fcca4 fix docs about blake2 requirements / origin 2021-01-28 18:00:00 +01:00
Thomas Waldmann
c8e9131158 remove bundled blake2 code, usage of libb2
we just use it via python3 now.
2021-01-28 18:00:00 +01:00
Thomas Waldmann
1dbe86a14e use blake2b from hashlib 2021-01-28 18:00:00 +01:00
Thomas Waldmann
6fa5bb4630 add tests for blake2b_128 2021-01-28 17:59:46 +01:00
Ryan Polley
83116e58f2
add examples for --paths-from-stdin, --paths-from-command, --paths-separator (#5644)
docs: add examples for --paths-from-stdin, --paths-from-command, --paths-separator
2021-01-27 00:15:14 +01:00
TW
b20c7229e6
Merge pull request #5642 from rpolley/fix-grammar-in-docs-5632
fix grammar in faq
2021-01-23 01:44:28 +01:00
TW
2d8c9f1acf
Merge pull request #5643 from rpolley/update-docs-on-dev-env-setup-#5504
Update docs for dev environment installation instructions
2021-01-23 01:40:26 +01:00
Ryan Polley
1c5b57f1b3 recomend running tests only on installed versions for setup 2021-01-22 16:21:13 -06:00
Ryan Polley
974fd9eecb add link back to git-installation 2021-01-22 16:12:52 -06:00
Ryan Polley
921cac0177 fix grammar in faq 2021-01-22 14:35:45 -06:00
TW
699256edbd
Merge pull request #5620 from ThomasWaldmann/sparse-file-integr2
Sparse file support (integration)
2021-01-17 17:45:53 +01:00
Thomas Waldmann
6dc334422e fixup: improve comment about assumptions in the item metadata stream chunker 2021-01-15 21:51:15 +01:00
Thomas Waldmann
2391d160a8 add all-zero detection to buzhash chunk data processing 2021-01-15 21:27:29 +01:00
Thomas Waldmann
2d76365214 cosmetic: directly set allocation instead going via is_zero 2021-01-15 21:10:07 +01:00
Thomas Waldmann
8162e2e67b cached_hash is only used in archive, move it there 2021-01-14 20:50:12 +01:00
Thomas Waldmann
e41dc6e96f use zeros for benchmarks 2021-01-14 20:19:10 +01:00
Thomas Waldmann
be257728ca move zeros to constants module 2021-01-14 20:02:18 +01:00
Thomas Waldmann
3b9798cffc remove max_chunk_size (unused) 2021-01-14 19:56:39 +01:00
TW
4041bdf169
Merge pull request #5606 from ThomasWaldmann/fix-5603-master
do not recurse into duplicate roots, fixes #5603 (master)
2021-01-11 16:51:49 +01:00
TW
abb87ce68b
Merge pull request #5623 from infectormp/patch-4
Add badge with current status of package
2021-01-10 13:54:36 +01:00
infectormp
ab97bc20ed
Add badge with current status of package 2021-01-09 17:58:47 +03:00
Thomas Waldmann
4e3be1db5e reuse zeros also in fixed-size chunker for all-zero chunk detection
also: zeros.startswith() is faster
2021-01-08 23:39:53 +01:00
Thomas Waldmann
ef19d937ed use cached_hash also to generate all-zero replacement chunks
at least for major amounts of fixed-size replacement hashes,
this will be much faster. also less memory management overhead.
2021-01-08 23:39:53 +01:00
Thomas Waldmann
f3088a9893 rename chunk_to_id_data to cached_hash 2021-01-08 23:39:53 +01:00
Thomas Waldmann
92f221075a refactor recreate to use chunk_to_id_data 2021-01-08 23:39:53 +01:00
Thomas Waldmann
b3659e0b8c reuse chunker.zeros for sparse extraction 2021-01-08 23:39:53 +01:00
Thomas Waldmann
9fd284ce1a refactor new zero chunk handling to be reusable 2021-01-08 23:39:53 +01:00
Thomas Waldmann
6d0f9a52eb detect all-zero chunks, avoid hashing them
comparing zeros is quicker than hashing them.
the comparison should fail quickly inside non-zero data.
2021-01-08 17:40:06 +01:00
Thomas Waldmann
52bd55b29a integrate Chunk type, avoid hashing holes 2021-01-08 17:39:51 +01:00
Thomas Waldmann
7319f85b54 adapt the existing chunker tests 2021-01-08 17:33:25 +01:00
Thomas Waldmann
8c299696aa Chunker: yield Chunk namedtuple instead of bytes/memoryview 2021-01-08 01:10:44 +01:00
TW
37d4aee122
Merge pull request #5597 from Gelma/typos_dec
Fix typos
2021-01-07 19:21:03 +01:00
Thomas Waldmann
7a3a49e99b reverted changes to 3rd party code
all algorithms/* stuff needs to be fixed upstream.

we just copy the files from there now and then.

https://github.com/lz4/lz4
https://github.com/facebook/zstd
https://github.com/Cyan4973/xxHash
2021-01-07 18:18:15 +01:00
Thomas Waldmann
0984e00d31 revert changes to autogenerated files
this stuff will be auto-generated, regularly done at release time.
2021-01-07 18:08:49 +01:00
Andrea Gelmini
72e7c46fa7 Fix typos 2021-01-07 17:54:33 +01:00
TW
41d282bc14
Merge pull request #5615 from jedie/patch-1
Change docs/install instruction: "python-virtualenv" -> "python3-virtualenv"
2021-01-07 17:13:31 +01:00
Jens Diemer
5a585c5c2e
"python-virtualenv" -> "python3-virtualenv" 2021-01-07 10:31:26 +01:00
TW
268eb2e598
Merge pull request #5610 from ThomasWaldmann/update-changes-master
update CHANGES
2021-01-04 19:50:56 +01:00
Thomas Waldmann
4394fa45ba update CHANGES 2021-01-03 21:40:31 +01:00
TW
9088b1e85a
Merge pull request #5608 from ThomasWaldmann/improve-borg-check-logging-master
check: debug log segment filename
2021-01-03 19:04:40 +01:00
Thomas Waldmann
f2cb17d66c check: debug log segment filename 2021-01-03 18:23:52 +01:00
Thomas Waldmann
73c04398f3 move requires_hardlinks upwards 2021-01-03 17:55:45 +01:00
axapaxa
b291b91962
Add remote upload buffer (--remote-buffer) (#5574)
add remote upload buffer (--remote-buffer)

- added new option --remote-buffer
- allow to_send to grow to selected size
- don't grow if wait is specified
- fill pipe on any command (including 'async_response')
- add new option to docs
- create EfficientBytesQueue to prevent recreation of buffer each time we send something
- add tests for EfficientBytesQueue
2021-01-03 17:37:16 +01:00
Thomas Waldmann
806dc5084d do not recurse into duplicate roots, fixes #5603 2021-01-02 23:01:31 +01:00
Thomas Waldmann
257791274f add a test whether a duplicate root is skipped, see #5603 2021-01-02 23:00:52 +01:00
Thomas Waldmann
58c0a0186f add a test for hardlink extraction issue, see #5603 2021-01-02 23:00:38 +01:00
TW
2851a84003
Merge pull request #5561 from ThomasWaldmann/sparse-file-support
sparse map / file map support for fixed size chunker
2020-12-28 20:21:50 +01:00
TW
27651f6f28
Merge pull request #5600 from ThomasWaldmann/fix-mp
fix cythonize crash on macOS/py39, fixes #5599
2020-12-28 20:20:33 +01:00