Commit Graph

7729 Commits

Author SHA1 Message Date
TW 5e85d043fd
Merge pull request #7433 from ThomasWaldmann/remove-os-directory-master
docs: remove OS directory from install docs
2023-03-11 19:15:41 +01:00
Thomas Waldmann 506652d4b2
docs: remove OS directory from install docs
- links did not work that way
- each OS has its own headline and can be discovered easily without
  that directory
2023-03-11 18:50:22 +01:00
TW 0c58378f08
Merge pull request #7423 from abebeos/7356-dev-setup-docs
docs: installation: add link to OS dependencies
2023-03-10 22:38:17 +01:00
TW a0e0d5ea74
Merge pull request #7427 from RayyanAnsari/windows-build-simplify
Windows: simplify building
2023-03-10 19:46:59 +01:00
Rayyan Ansari ce50c497b0
Windows: simplify building
Use the standard pip build command, and get rid of the build script.
2023-03-10 17:51:03 +00:00
abebeos f9f33044cc add link to OS dependencies
The "Building a development environment" section links to the
"Using git" section. This can result in developers overseeing
the os dependencies necessity.

re #7356
2023-03-10 16:44:01 +00:00
TW 16a0e2c3a4
Merge pull request #7421 from ThomasWaldmann/msgpack105-master
allow msgpack 1.0.5 also
2023-03-09 23:16:12 +01:00
Thomas Waldmann 1ab90b339e
allow msgpack 1.0.5 also 2023-03-09 22:26:38 +01:00
Michael Deyaso 2c232449b0
Modified Item.pyx to include diffs in ctime and mtime (#7335)
diff: include changes in ctime and mtime, fixes #7248

also:
- sort JSON output alphabetically
- add --content-only to ignore metadata changes

Co-authored-by: Michael Deyaso <mdeyaso@fusioniq.io>
2023-03-06 23:18:36 +01:00
TW bba91e4b8b
Merge pull request #7413 from snsmac/forwardport/autotest
"auto" compressor tests: do not assume zlib is better than lz4, fixes #7363 (forwardport-master)
2023-03-06 20:12:04 +01:00
Thomas Waldmann e7de9dcdcb "auto" compressor tests: do not assume zlib is better than lz4, fixes #7363
while that might be true for many cases, we can not assume it is
always true, as proven by the failing test on S390.
2023-03-06 18:43:09 +01:00
TW 7ce0887070
Merge pull request #7401 from ThomasWaldmann/unicode-filenames-docs-master
update FAQ about locale/unicode issues, fixes #6999
2023-03-05 17:49:14 +01:00
TW 9f703e9138
Merge pull request #7403 from ThomasWaldmann/mount-docs-master
docs: improve mount options rendering, fixes #7359
2023-03-05 17:48:24 +01:00
TW 611e391da9
Merge pull request #7405 from ThomasWaldmann/fix-debug-cmds-master
fix borg debug get-obj/put-obj (master)
2023-03-04 22:20:54 +01:00
Thomas Waldmann 9a39b53828
debug put-obj: id must be given on commandline, fixes #7290
this is an incompatible change:

before:
borg debug put-obj path1 path2 ...
(and borg computed all IDs automatically) (*)

after:
borg debug put-obj id path
(id must be given)

(*) the code just using sha256(data) was outdated and incorrect anyway.

also: debug get-obj: improve error handling
2023-03-04 20:05:23 +01:00
Thomas Waldmann 1632d6305e
docs: improve mount options rendering, fixes #7359 2023-03-04 16:56:18 +01:00
Thomas Waldmann 23dcc18bec
update FAQ about locale/unicode issues, fixes #6999 2023-03-04 16:30:24 +01:00
TW 8027c7b284
Merge pull request #7396 from ThomasWaldmann/improve-platformdirs-docs
clarify platformdirs requirements, fixes #7393
2023-03-01 17:24:14 +01:00
Thomas Waldmann 85cc7418ca
clarify platformdirs requirements, fixes #7393
3.0.0 is only required for macOS due to breaking changes.

2.6.0 was the last breaking change for Linux/UNIX.
2023-03-01 13:18:12 +01:00
TW e1fd24aa6e
Merge pull request #7394 from helmutg/reproducible-docs
Make timestamps in manual pages reproducible
2023-02-28 12:13:19 +01:00
Vagrant Cascadian 98352cf667 Make timestamps in manual pages reproducible
Refer to https://reproducible-builds.org/docs/source-date-epoch/ for
documentation on SOURCE_DATE_EPOCH.

Bug-Debian: https://bugs.debian.org/1029807
Signed-off-by: Helmut Grohne <helmut@subdivi.de>
2023-02-28 11:41:31 +01:00
TW 4b745f98c1
Merge pull request #7390 from ThomasWaldmann/rel200b5
release 2.0.0 beta 5
2023-02-27 01:20:15 +01:00
Thomas Waldmann f06d3cc9c8
build_man 2023-02-26 21:32:44 +01:00
Thomas Waldmann 52b9f8e7e9
build_usage 2023-02-26 21:32:42 +01:00
Thomas Waldmann 1233b47878
sphinx: fix extlinks configuration
otherwise sphinx crashes.
2023-02-26 21:32:40 +01:00
Thomas Waldmann 03cb4d4124
update CHANGES, set release date
also minor other changes.
2023-02-26 21:32:32 +01:00
TW 437ee97e66
Merge pull request #7388 from diivi/feat/log-cache-dir
feat: add cache dir to --debug
2023-02-26 21:02:12 +01:00
TW 9710c8f0a6
Merge pull request #7389 from ThomasWaldmann/vagrant-updates
updates and fixes done while working with the VMs
2023-02-26 20:55:16 +01:00
Thomas Waldmann a8792f466b
development.lock.txt: upgrade to more recent versions 2023-02-26 20:29:30 +01:00
Divyansh Singh 7dd186ccf3 feat: add cache dir to --debug 2023-02-26 23:48:35 +05:30
Thomas Waldmann a3ab390e59
test_create_read_special_symlink: fix exception in test cleanup code on FreeBSD, fixes #7386 2023-02-26 19:10:39 +01:00
Thomas Waldmann 98338f4cc0
hfs+ filesystem (darwin64 VM) has 1s ts granularity, fixes #7387 2023-02-26 19:07:10 +01:00
Thomas Waldmann 6160c0918f
vagrant: add debian bookworm (debian testing) VM 2023-02-26 18:05:59 +01:00
Thomas Waldmann dc773ffb81
vagrant: use Python 3.11.2 2023-02-26 18:03:24 +01:00
TW b04b4438bf
Merge pull request #7385 from ThomasWaldmann/update-changes
update CHANGES
2023-02-26 02:31:58 +01:00
Thomas Waldmann c8f5cab8b6
update CHANGES 2023-02-26 01:14:18 +01:00
TW 8f73f00fb5
Merge pull request #7384 from ThomasWaldmann/transfer-bugfix
transfer: fix exception in dry-run mode
2023-02-26 01:12:38 +01:00
Thomas Waldmann 2b935cfe41
transfer: fix exception in dry-run mode
Only call archive.stats.show_progress(final=True) if
we actually have an archive (== not in dry-run mode).
2023-02-26 00:41:13 +01:00
TW 4d44b7d439
Merge pull request #7381 from ThomasWaldmann/rtd-config2-master
readthedocs: don't create a pdf
2023-02-25 02:27:57 +01:00
Thomas Waldmann 79d125212d
readthedocs: don't create a pdf 2023-02-25 02:27:08 +01:00
TW a96cba4ebd
Merge pull request #7380 from ThomasWaldmann/rtd-config-master
add .readthedocs.yaml
2023-02-25 02:17:03 +01:00
Thomas Waldmann a40390b1ac
add .readthedocs.yaml
otherwise rtd uses:
- python 3.7, which is too old for borg.
- shallow git checkout, which might make setuptools_scm fail to create a correct version
2023-02-25 02:16:21 +01:00
Soumik Dutta cad138aa23
Add files changed while reading to Statistics class #7354 (#7378)
add files changed while reading to Statistics class, fixes #7354

Signed-off-by: Soumik Dutta <shalearkane@gmail.com>
2023-02-25 01:47:39 +01:00
TW b208785fff
Merge pull request #7351 from ThomasWaldmann/retry-failed-files
create: implement retries for individual fs files
2023-02-23 01:46:36 +01:00
Thomas Waldmann 7e6afc93e9
create: implement retries for individual fs files
Errors handled for backup src files:
- BackupOSError (converted from OSError), e.g. I/O Error
- BackupError (stats race, file changed while we backed it up)

Error Handling:
- retry the same file after some sleep time
- sleep time starts from 1ms, increases exponentially up to 10s
- 10 tries

If retrying does not help:
- BackupOSError: skip the file, log it with "E" status
- BackupError: last try will back it up, log it with "C" status

Works for:
- borg create's normal (builtin) fs recursion
- borg create --paths-from-command
- borg create --paths-from-stdin

Notes:
- update stats.files_stats late (so we don't get wrong
  stats in case of e.g. IOErrors while reading the file).
- _process_any: no changes to the big block, just indented
  for adding the retry loop and the try/except.
- test_create_erroneous_file succeeds because we retry the file.
2023-02-23 01:19:19 +01:00
TW 6da5b7d1ba
Merge pull request #7367 from ThomasWaldmann/new-crypto-assert-id
assert_id: better be paranoid, fixes #7362
2023-02-23 01:14:25 +01:00
TW 3f2aac8f00
Merge pull request #7368 from vhadzhiev/vhadzhiev_contribution
fixed Statistics.__add__(), fixes #7355
2023-02-20 18:07:21 +01:00
vhadzhiev a08a3eb173 fixed Statistics.__add__(), fixes #7355 2023-02-20 11:25:28 +02:00
Thomas Waldmann 74a19ee2a0
verify_data: always decompress and call assert_id(), see #7362 2023-02-19 21:25:24 +01:00
Thomas Waldmann fea630027c
assert_id: better be paranoid, fixes #7362
This makes borg2's new crypto do the same check as borg1's old crypto
and makes sure that no chunks created by an evil borg client would
go unnoticed.
2023-02-19 21:14:20 +01:00