Commit Graph

5615 Commits

Author SHA1 Message Date
Thomas Waldmann 75dcf93563 update CHANGES 2019-09-07 00:25:11 +02:00
TW 53f8882d31
Merge pull request #4751 from ThomasWaldmann/noatime-default
create: make --noatime the default, deprecate --noatime, fixes #4673
2019-09-06 23:08:38 +02:00
Thomas Waldmann 3f63234974 create: make --noatime the default, deprecate --noatime, fixes #4673
also: add --atime option to enable storing files' atime.
2019-09-06 21:48:54 +02:00
TW aa7df50a2d
Merge pull request #4635 from ThomasWaldmann/ctrlc-checkpoint
first ctrl-c: checkpoint and abort, fixes #4606
2019-09-06 21:44:07 +02:00
TW 6ac02764cd
Merge pull request #4741 from ThomasWaldmann/update-changes-master
update CHANGES (master)
2019-08-30 21:35:19 +02:00
Thomas Waldmann de88c87fd0 update CHANGES (master) 2019-08-30 20:55:31 +02:00
Dmitry Astapov dc1c8c062c Reiterate that 'file cache names are absolute' in FAQ (#4738)
Reiterate that 'file cache names are absolute'

Drive home the point that relative source names does not save you from re-chunking if absolute pathnames change.

Also: mention bind mount solution.
2019-08-30 15:29:17 +02:00
TW 975f5627b1
Merge pull request #4736 from saurvs/forward-port-4729
new BORG_WORKAROUNDS mechanism, basesyncfile, fixes #4710
2019-08-27 21:55:58 +02:00
TW e7a9147269
Merge pull request #4735 from saurvs/forward-port-4728
Forward port of #4728
2019-08-27 21:23:22 +02:00
Thomas Waldmann b43d3bb7fa new BORG_WORKAROUNDS mechanism, basesyncfile, fixes #4710
remove WSL autodetection. if WSL still has this problem, you need to
set BORG_WORKAROUNDS=basesyncfile in the borg process environment to
work around it.

(cherry picked from commit beb948fc71)
2019-08-27 19:37:40 +05:30
Thomas Waldmann cb2d31ed98 fix partial extract for hardlinked contentless file types, fixes #4725
if the file is not a regular file, but a hardlink slave with a not
extracted hardlink master, chunks will be None and we must not call
preload(chunks).

(cherry picked from commit 291d58efa1)
2019-08-27 19:20:20 +05:30
Thomas Waldmann 9732fe4965 special behaviour on first ctrl-c, fixes #4606
like:
 - try saving a checkpoint if borg create is ctrl-c-ed
2019-08-25 22:49:09 +02:00
TW 373bd8abd3
Merge pull request #4696 from jrast/win10
WIP jrast/borg:win10, PR for better review and testing
2019-08-25 22:41:05 +02:00
Jürg Rast a81dffa54e Updated windows readme with current state 2019-08-25 18:27:58 +02:00
Jürg Rast bff97a99e1 Windows specific directory handling
On windows os.open does not work for directories.
If borg tries to open an directory on windows, None is returned
as file descriptor. The archive and archiver where adjusted to
handle the case if a file descriptor is None.
2019-08-24 10:17:18 +02:00
Jürg Rast 6b426d08d7 Initial work to build and run borg under windows
- Created a batch file to build borg on windows
- Adjusted setup.py to be runnable on windows and build the windows
extension
- Extracted the free space check to a function in the platform module
- Created the minimal needed (dummy) functions for the windows platform
module
2019-08-24 10:17:18 +02:00
TW ae2ff8066c
add restore docs, fixes #4670 (#4723)
add restore docs, fixes #4670
2019-08-22 23:45:21 +02:00
Endareth 3445d4cca0 Updated doc to cover use of temp directory on remote (#4545)
docs about remote temp directory usage

Updated doc to cover use of temp directory on remote, in particular how to handle changing the directory used for systems such as QNAP with tiny default /tmp directories.

fixup by tw: do not mention specific brands, specific amounts

this is not QNAP specific, but may happen as well on other limited
systems. the amount of tmp files can also vary widely.
2019-08-10 00:08:10 +02:00
ntova 627ca1376b Fix various code blocks in the docs (#4708)
Fix various code blocks in the docs

- rst markup: put codeblock markup on separate line to make it better visible / separate it from normal text colons.

- borg help texts in archiver.py: put codeblock markup instead of colon - that way it looks like a single colon when using the cli help and also works as code block markup.
2019-08-09 23:13:11 +02:00
Stefan Majewsky fc2c92b054 add a push-style example to borg-create(1) (#4613)
add a push-style example to borg-create docs

When I browsed the readthedocs and manpages while setting up Borg for
myself for the first time, I saw multiple hints that pushing backups via
SSH is supported (e.g. the existence of the `borg serve` command and the
`--rsh` option), but I never found a clear example. I only found
<https://borgbackup.readthedocs.io/en/stable/usage/general.html#repository-urls>
after being pointed to it by @ThomasWaldmann.

Therefore, an explicit example in the `borg create` documentation seems
appropriate. I put it next to the pull-style example using sshfs which
serves a similar usecase.
2019-08-09 22:46:57 +02:00
TW 0db031ac4a
Merge pull request #4715 from ThomasWaldmann/forward-port-4583
timestamps in the files cache are now usually ctime, fixes #4583
2019-08-09 22:00:46 +02:00
Thomas Waldmann 8622014188 timestamps in the files cache are now usually ctime, fixes #4583 2019-08-09 21:27:30 +02:00
TW 97eca3d287
Merge pull request #4713 from saurvs/forward-port-4698
Forward port #4698
2019-08-09 16:02:29 +02:00
TW 8a401d3c0b
Merge pull request #4712 from saurvs/forward-port-4646
Forward port #4646
2019-08-09 15:58:11 +02:00
TW 1aaf16a480
Merge pull request #4711 from saurvs/forward-port-4707
Forward port #4705
2019-08-09 15:54:40 +02:00
Thomas Waldmann 8b49c4d2df Repository.check_can_create_repository: use stat() to check
similar issue as #4695.

(cherry picked from commit 4911720faf)
2019-08-09 15:10:15 +05:30
Thomas Waldmann bb7a9e6c20 Repository.open: use stat() to check for repo dir, fixes #4695
(cherry picked from commit ec3fad0f85)
2019-08-09 15:09:48 +05:30
Thomas Waldmann 9c3a572638 SecurityManager.known(): check all files, fixes #4614
Before this fix, because known() only checked the key-type file, the
location file could go missing without being automatically regenerated.

Now a save() is triggered if not all files are present.

(cherry picked from commit c68cad9727)
2019-08-09 15:05:30 +05:30
Thomas Waldmann d4d4b7e4a9 after double-force delete, warn about necessary repair, fixes #4704
the borg check --repair is needed to clean up all the orphaned chunks.

if the message is emitted on INFO log level, people likely do not see
it if they use default WARNING log level (they did not give -v).

(cherry picked from commit 389afcae9d)
2019-08-09 14:59:39 +05:30
TW e299ad824c
Merge pull request #4701 from ntova/py38-testing
tox / travis: add testing on py38-dev
2019-07-30 15:08:12 +02:00
ntova 3e0bed4b36 tox / travis: add testing on py38-dev 2019-07-30 11:08:03 +02:00
TW 171392d1ff
Merge pull request #4697 from ntova/docs-benchmark-compact-clarification
docs: benchmark crud: clarify that space is used until compact
2019-07-28 15:51:51 +02:00
ntova c2ae9673b4 docs: benchmark crud: clarify that space is used until compact 2019-07-28 15:29:44 +02:00
TW 5293d4987c
Merge pull request #4686 from tgdnt/master
Update documentation of borg create
2019-07-17 17:42:39 +02:00
Tiago Donato 8db4106150
Update documentation of borg create
Corrects a mention of borg 1.1 as a future version.
2019-07-15 21:53:30 -05:00
TW 6273c594b0
Merge pull request #4679 from nomeata/patch-1
RST syntax fix in docs
2019-07-11 15:58:01 +02:00
Joachim Breitner b86aaa606d
RST syntax fix in docs 2019-07-09 10:23:33 +02:00
TW 76655b18d0
Merge pull request #4669 from ThomasWaldmann/forward-ports-master
forward ports to master
2019-07-07 14:39:31 +02:00
Thomas Waldmann 097677b14f fix preloading for old remote servers, fixes #4652
if the remote server does not support the dict-based argument passing
yet (e.g. when accidentally using borg 0.29 on rsync.net), the GET rpc
call argument list failed to generate if the command currently being
processed was not a GET also.

note: rsync.net has a more recent borg as "borg1".
2019-07-02 23:13:30 +02:00
Thomas Waldmann c0a617c6a9 cope with ANY error when importing pytest into borg.testsuite, #4652
this happened because the user had pytest5 installed somehow,
although it is incompatible with python 3.4:

# python3 /usr/local/bin/borg --version
Traceback (most recent call last):
  File "/usr/local/lib/python3.4/dist-packages/borg/archiver.py", line 81, in <module>
    from .selftest import selftest
  File "/usr/local/lib/python3.4/dist-packages/borg/selftest.py", line 21, in <module>
    from .testsuite.hashindex import HashIndexDataTestCase, HashIndexRefcountingTestCase, HashIndexTestCase
  File "/usr/local/lib/python3.4/dist-packages/borg/testsuite/__init__.py", line 29, in <module>
    from pytest import raises
  File "/usr/local/lib/python3.4/dist-packages/pytest.py", line 6, in <module>
    from _pytest.assertion import register_assert_rewrite
  File "/usr/local/lib/python3.4/dist-packages/_pytest/assertion/__init__.py", line 6, in <module>
    from _pytest.assertion import rewrite
  File "/usr/local/lib/python3.4/dist-packages/_pytest/assertion/rewrite.py", line 443, in <module>
    ast.MatMult: "@",
AttributeError: 'module' object has no attribute 'MatMult'
2019-07-02 23:12:43 +02:00
TW d02356e9c0
Merge pull request #4656 from emichael/master
Fix invalid archive error message
2019-07-01 19:10:08 +02:00
Ellis Michael b6a7a0806e
Fix invalid archive error message 2019-06-30 18:04:54 -07:00
TW 5594f5b270
Merge pull request #4645 from thiagomacieira/fiz-zlib-bad-assumption
Fix broken test that relied on improper zlib assumptions
2019-06-28 17:14:39 +02:00
Thiago Macieira 575a348ce4 Fix broken test that relied on improper zlib assumptions
This test assumed that zlib would always produce the same output for a
given input, and that assumption has proven incorrect. It rested on
zlib never improving. The zlib shipped in Clear Linux has algorithm
improvements, which caused this test to break.

This patch instead decompresses the expected value and compares that.

Signed-off-by: Thiago Macieira <thiago.macieira@intel.com>
2019-06-25 16:00:11 -07:00
Elmar Hoffmann 443958a79b support xxh64 checksum in addition to the hashlib hashes in borg list
also: point out it is not a cryptographic hash
2019-06-24 08:46:58 +02:00
TW 70e921d022
Merge pull request #4640 from russelldavis/fix-osxfuse-link
Fix osxfuse github link in installation docs
2019-06-24 08:20:12 +02:00
Russell Davis 3fb5998bae Fix osxfuse github link in installation docs
It was broken because there's already a different reference named
github in `docs/global.rst.inc`. Fixed by using an anonymous hyperlink
reference, per https://stackoverflow.com/a/14067756/278488
2019-06-23 19:24:37 -07:00
TW fac8f57c31
Merge pull request #4636 from elho/second-archive-placeholder
Enable placeholder usage in all extra archive arguments
2019-06-23 12:54:06 +02:00
Elmar Hoffmann a26065064d enable placeholder usage in all extra archive arguments 2019-06-23 02:28:26 +02:00
TW 72979caf8b
Merge pull request #4625 from ThomasWaldmann/oi
vagrant: add up-to-date openindiana box (py35, openssl10)
2019-06-17 12:05:58 +02:00