52b9f8e7e9
build_usage
2023-02-26 21:32:42 +01:00
1233b47878
sphinx: fix extlinks configuration
...
otherwise sphinx crashes.
2023-02-26 21:32:40 +01:00
03cb4d4124
update CHANGES, set release date
...
also minor other changes.
2023-02-26 21:32:32 +01:00
437ee97e66
Merge pull request #7388 from diivi/feat/log-cache-dir
...
feat: add cache dir to --debug
2023-02-26 21:02:12 +01:00
9710c8f0a6
Merge pull request #7389 from ThomasWaldmann/vagrant-updates
...
updates and fixes done while working with the VMs
2023-02-26 20:55:16 +01:00
a8792f466b
development.lock.txt: upgrade to more recent versions
2023-02-26 20:29:30 +01:00
7dd186ccf3
feat: add cache dir to --debug
2023-02-26 23:48:35 +05:30
a3ab390e59
test_create_read_special_symlink: fix exception in test cleanup code on FreeBSD, fixes #7386
2023-02-26 19:10:39 +01:00
98338f4cc0
hfs+ filesystem (darwin64 VM) has 1s ts granularity, fixes #7387
2023-02-26 19:07:10 +01:00
6160c0918f
vagrant: add debian bookworm (debian testing) VM
2023-02-26 18:05:59 +01:00
dc773ffb81
vagrant: use Python 3.11.2
2023-02-26 18:03:24 +01:00
b04b4438bf
Merge pull request #7385 from ThomasWaldmann/update-changes
...
update CHANGES
2023-02-26 02:31:58 +01:00
c8f5cab8b6
update CHANGES
2023-02-26 01:14:18 +01:00
8f73f00fb5
Merge pull request #7384 from ThomasWaldmann/transfer-bugfix
...
transfer: fix exception in dry-run mode
2023-02-26 01:12:38 +01:00
2b935cfe41
transfer: fix exception in dry-run mode
...
Only call archive.stats.show_progress(final=True) if
we actually have an archive (== not in dry-run mode).
2023-02-26 00:41:13 +01:00
4d44b7d439
Merge pull request #7381 from ThomasWaldmann/rtd-config2-master
...
readthedocs: don't create a pdf
2023-02-25 02:27:57 +01:00
79d125212d
readthedocs: don't create a pdf
2023-02-25 02:27:08 +01:00
a96cba4ebd
Merge pull request #7380 from ThomasWaldmann/rtd-config-master
...
add .readthedocs.yaml
2023-02-25 02:17:03 +01:00
a40390b1ac
add .readthedocs.yaml
...
otherwise rtd uses:
- python 3.7, which is too old for borg.
- shallow git checkout, which might make setuptools_scm fail to create a correct version
2023-02-25 02:16:21 +01:00
cad138aa23
Add files changed while reading to Statistics class #7354 ( #7378 )
...
add files changed while reading to Statistics class, fixes #7354
Signed-off-by: Soumik Dutta <shalearkane@gmail.com>
2023-02-25 01:47:39 +01:00
b208785fff
Merge pull request #7351 from ThomasWaldmann/retry-failed-files
...
create: implement retries for individual fs files
2023-02-23 01:46:36 +01:00
7e6afc93e9
create: implement retries for individual fs files
...
Errors handled for backup src files:
- BackupOSError (converted from OSError), e.g. I/O Error
- BackupError (stats race, file changed while we backed it up)
Error Handling:
- retry the same file after some sleep time
- sleep time starts from 1ms, increases exponentially up to 10s
- 10 tries
If retrying does not help:
- BackupOSError: skip the file, log it with "E" status
- BackupError: last try will back it up, log it with "C" status
Works for:
- borg create's normal (builtin) fs recursion
- borg create --paths-from-command
- borg create --paths-from-stdin
Notes:
- update stats.files_stats late (so we don't get wrong
stats in case of e.g. IOErrors while reading the file).
- _process_any: no changes to the big block, just indented
for adding the retry loop and the try/except.
- test_create_erroneous_file succeeds because we retry the file.
2023-02-23 01:19:19 +01:00
6da5b7d1ba
Merge pull request #7367 from ThomasWaldmann/new-crypto-assert-id
...
assert_id: better be paranoid, fixes #7362
2023-02-23 01:14:25 +01:00
3f2aac8f00
Merge pull request #7368 from vhadzhiev/vhadzhiev_contribution
...
fixed Statistics.__add__(), fixes #7355
2023-02-20 18:07:21 +01:00
a08a3eb173
fixed Statistics.__add__(), fixes #7355
2023-02-20 11:25:28 +02:00
74a19ee2a0
verify_data: always decompress and call assert_id(), see #7362
2023-02-19 21:25:24 +01:00
fea630027c
assert_id: better be paranoid, fixes #7362
...
This makes borg2's new crypto do the same check as borg1's old crypto
and makes sure that no chunks created by an evil borg client would
go unnoticed.
2023-02-19 21:14:20 +01:00
93a4bd61f8
Merge pull request #7360 from voegelas/fedora-package-url
...
Installation: Update Fedora in distribution list
2023-02-17 14:32:34 +01:00
4b18980768
Installation: Update Fedora in distribution list
...
Fixes #7357
2023-02-16 18:27:48 +01:00
3849ebe312
Merge pull request #7349 from ThomasWaldmann/avoid-orphan-content-chunks3
...
avoid orphan content chunks (master)
2023-02-14 00:01:50 +01:00
71f8dd3a17
FilesystemObjectProcessors.process_pipe: also add same exception handler there
2023-02-13 20:46:48 +01:00
c9dbe323e3
TarfileObjectProcessors.process_file: also add same exception handler there
2023-02-13 20:46:46 +01:00
d0c61bbbf1
FilesystemObjectProcessors.process_file: clean up orphaned chunks in case of exceptions
...
Note: no changes inside the indented block,
just added the try and the except block.
2023-02-13 20:46:45 +01:00
f1981715e4
2nd+ hardlinks: add to item.chunks after incref'ing
...
we do book-keeping in item.chunks:
in case something goes wrong and we need to clean up,
we will have a list with chunks to decref in item.chunks.
also:
- make variable naming more consistent
- cosmetic changes
2023-02-13 20:46:21 +01:00
5cb3a17796
Revert "avoid orphan content chunks on BackupOSError, fixes #6709 "
...
This reverts commit ffe32316a5
2023-02-13 18:24:28 +01:00
6cfe77ebaf
Merge pull request #7350 from ThomasWaldmann/testing-chunker
...
implement "fail" chunker for testing purposes
2023-02-13 18:17:56 +01:00
11fd6afb0f
use "fail" chunker to test erroneous input file skipping
...
if a file can't be read (like here: there is a simulated
I/O error in the 2nd chunk of file2), it should be logged
with "E" status, skipped and backup shall proceed with
next file(s).
also, check that the repo has no orphan chunks (exception
handling code needs to deal with 1st chunk of file2 which
already has been written / incref'd in the repo).
2023-02-13 17:19:49 +01:00
7f973a5b34
implement "fail" chunker for testing purposes
...
--chunker-params=fail,4096,rrrEErrrr means:
- cut chunks of 4096b fixed size (last chunk in a file can be less)
- read chunks 0, 1 and 2 successfully
- error at chunk 3 and 4 (simulated OSError(errno.EIO))
- read successfully again for the next 4 chunks
Chunks are counted inside the chunker instance, starting
from 0, always increasing while the same instance is used.
Read chunks as well as failed chunks count up by 1.
2023-02-13 17:15:45 +01:00
52040bc043
Merge pull request #7347 from jdchristensen/hashindex_compact
...
Make hashindex_compact simpler and probably faster
2023-02-12 17:01:18 +01:00
3daf7e186d
testsuite/hashindex.py: add comments about validity of hashtables
2023-02-12 09:39:07 -05:00
ee7fee75fc
Merge pull request #7345 from ThomasWaldmann/update-changes
...
update CHANGES
2023-02-12 14:56:18 +01:00
c705c8573d
testsuite/hashindex.py: add a few more tests
2023-02-12 08:28:14 -05:00
8eff0b2f02
_hashindex.c: fix comment
2023-02-12 08:24:27 -05:00
2f9f22e2a8
hashindex.py: make black happy
2023-02-11 20:33:07 -05:00
36aa395e49
_hashindex.c: set min_empty and num_empty even when permit_compact=True
2023-02-11 20:11:09 -05:00
60bea46eb7
_hashindex.c: rewrite hashindex_compact
2023-02-11 20:10:02 -05:00
6f5efb3f74
testsuite/hashindex.py: create and use compare_compact to avoid repetition
2023-02-11 20:06:38 -05:00
d3fd93f82b
testsuite/hashindex.py: use compare_indexes in one more spot
2023-02-11 19:53:28 -05:00
cc78ef8939
testsuite/hashindex.py: add two more tests
2023-02-11 19:44:56 -05:00
6aa53a5627
hashindex_pytest.py: add test_hashindex_compact_stress
2023-02-11 19:13:20 -05:00
Thomas Waldmann