Commit Graph

5010 Commits

Author SHA1 Message Date
Thomas Waldmann 337c86b470 recreate --recompress: add metavar, clarify description
(cherry picked from commit c0f56ed039)
2018-03-17 23:52:44 +01:00
Thomas Waldmann a48fffad6e borg config --cache: allow validated access to previous_location
(cherry picked from commit 810986f0f5)
2018-03-17 23:49:21 +01:00
Thomas Waldmann d5917204c3 fix borgfs patterns/paths processing, fixes #3551
Just checking for None in patterns.py (and removing the set_defaults
calls in archiver.py) did not work as other arg parsing code relies on
having an empty list (in .patterns, .paths) to append to.

Thus I stayed away from pattern.py and rather fixed the defaults for
.paths and .patterns in all parsers.

(cherry picked from commit df9020389c)
2018-03-17 23:46:36 +01:00
TW 996a3dc2be
Merge pull request #3699 from ThomasWaldmann/backports-19
Backports 19
2018-03-17 23:43:37 +01:00
TW 502f11b9da
Merge pull request #3698 from ThomasWaldmann/backports-18
Backports 18
2018-03-17 21:43:31 +01:00
Thomas Waldmann 920e144c81 be more clear in secure-erase warning message, fixes #3591
(cherry picked from commit fe65ccf95a)
2018-03-17 21:39:27 +01:00
Thomas Waldmann 1e7c87b23d be more helpful when parsing invalid --pattern values
say what the real problem is.
say what is valid.

(cherry picked from commit f5ba0fc649)
2018-03-17 21:37:40 +01:00
Thomas Waldmann 1db42a58a5 make sure all segment file offsets fit into uint32, fixes #3592
C code and the repo index use uint32 type for segment file offsets,
so when opening a repo and the config max_segment_size is too big,
fail early.

Also disallow setting a too big value via "borg config".

(cherry picked from commit 0e0e6da585)
2018-03-17 21:34:42 +01:00
Thomas Waldmann e96730ac24 borg config: add some validation, fixes #3566
only a few basic checks, it does not prevent all stupidities.

(cherry picked from commit 2d637d8ead)
2018-03-17 21:33:53 +01:00
TW 8f2d80e60b
Merge pull request #3697 from ThomasWaldmann/backports-17
Backports 17
2018-03-17 21:27:09 +01:00
Thomas Waldmann b6ed644d58 docs: clarify path semantics when matching, fixes #3598
(cherry picked from commit 9b73d31a40)
2018-03-17 21:24:19 +01:00
Thomas Waldmann bdc58c00ed docs: add an example for --pattern usage, fixes #3661
(cherry picked from commit cf72c9592c)
2018-03-17 21:24:08 +01:00
Thomas Waldmann 30db004de6 docs: improve logging docs, fixes #3549
(cherry picked from commit 99be106bc8)
2018-03-17 21:21:55 +01:00
Thomas Waldmann 1f943f228f quickstart: add note about permissions, borg@localhost, fixes #3452
(cherry picked from commit 7bc2138dcb)
2018-03-17 21:19:23 +01:00
Thomas Schwinge ea344260d6 Mark up Unicode string
Running Sphinx v1.4.8
    WARNING: the config value 'copyright' is set to a string with non-ASCII characters; this can lead to Unicode errors occurring. Please use Unicode strings, e.g. u'Content'.
    [...]
    Encoding error:
    'ascii' codec can't decode byte 0xc3 in position 23: ordinal not in range(128)

(cherry picked from commit 2458035057)
2018-03-17 21:18:17 +01:00
Thomas Waldmann 2f443cae73 docs: extend append-only repo rollback docs, fixes #3579
(cherry picked from commit 451b22ee51)
2018-03-17 21:12:41 +01:00
Thomas Waldmann 0555fe4869 security docs: add about combining compression and encryption
(cherry picked from commit be8913a93c)
2018-03-17 21:11:15 +01:00
enkore ac0b9fbdae sec docs: explicitly note what happens OUTSIDE the attack model
(cherry picked from commit 674ce72fda)
2018-03-17 21:09:13 +01:00
TW d7ec959ce2
Merge pull request #3692 from ThomasWaldmann/diff-deleted-empty
fix diff deleted/empty, fixes #3688
2018-03-17 19:41:38 +01:00
Thomas Waldmann c3b7d7b60c consider an empty file as different to a non-existing file, fixes #3688 2018-03-17 18:50:51 +01:00
Thomas Waldmann 01beee37a7 add test for issue #3688
(cherry picked from commit 0a46d3330c)
2018-03-17 18:30:44 +01:00
Thomas Waldmann d3274cd2c9 cleanup: move "processing files" message to expected place
(now possible as we do not lazy load the files cache any more)
2018-03-08 04:21:58 +01:00
Thomas Waldmann e4125b4b64 cleanup: get rid of ignore_inode, replace with cache_mode
ignore_inode == ('i' not in cache_mode)  # i)node
2018-03-08 04:10:43 +01:00
Thomas Waldmann c27c98ced0 cleanup: get rid of Cache.do_files, replace with cache_mode
not do_files == (cache_mode == 'd')  # d)isabled
2018-03-08 03:39:38 +01:00
Thomas Waldmann e9af3c6ab3 read files cache early, init checkpoint timer after that, see #3394
reading the files cache can take considerable amount of time (a user
reported 1h 42min for a 700MB files cache for a repo with 8M files and
15TB total), so we must init the checkpoint timer after that or borg
will create the checkpoint too early.

creating a checkpoint means (among other stuff) saving the files cache,
which will also take a lot of time in such a case, one time too much.

doing this in a clean way required some refactoring:
- cache_mode is now given to Cache initializer and stored in instance
- the files cache is loaded early in _do_open (if needed)
2018-03-08 03:20:56 +01:00
TW 767dccb24c
Merge pull request #3668 from anowlcalledjosh/docs-formatting-backport-1.1
Improve formatting of GPG output in documentation (backport to 1.1)
2018-03-05 17:39:09 +01:00
Josh Holland b0c441660f
Improve formatting of GPG output in documentation
(cherry picked from commit 9f2f4132ec)
2018-03-05 15:15:52 +00:00
TW bf6961f5bd
Merge pull request #3660 from dragetd/draget-backport-1.1-doc
Add docs on how to verify a signed release
2018-03-03 00:20:24 +01:00
Michael Gajda 17bb3f8f98 Add docs on how to verify a signed release
Short howto on using gpg to verify a signed binary release.
Fixes #3634
2018-03-02 22:11:49 +01:00
TW 1f84b0810d
Merge pull request #3654 from miek/backport-3633
Backport #3633 to 1.1-maint
2018-03-02 19:34:05 +01:00
TW 2e40f70911
Merge pull request #3655 from miek/backport-3607
Backport #3607 to 1.1-maint
2018-03-02 17:53:03 +01:00
TW 8f2b62522d
Merge pull request #3656 from miek/backport-3604
Backport #3604 to 1.1-maint
2018-03-02 16:53:14 +01:00
Thomas Waldmann d8cfd91b15 fix borg create never showing M status
the problem was that the upper layer code did not have enough information
about the file, whether it is known or not - and thus, could not decide
correctly whether status should be M)odified or A)dded.

now, file_known_and_unchanged method returns an additional "known"
boolean to fix this.

also: add comment about files cache loading in cache_mode='r'
2018-03-02 15:44:41 +00:00
Thomas Waldmann 44ba0bb319 fix erroneously skipped zstd compressor tests, fixes #3606 2018-03-02 15:44:33 +00:00
Thomas Waldmann 8eb2fee7a0 Revert "travis osx: run brew update first, fixes #3527"
This reverts commit e4828078bb.
2018-03-02 15:44:22 +00:00
TW fd79b90ec0
Merge pull request #3651 from miek/backport-3589
Backport #3589 to 1.1-maint
2018-03-02 16:08:57 +01:00
Rémi Oudin 4e50dc6d94 Link to offline documentation
Add a link to the offline documentation in README.rst.
Refers https://github.com/borgbackup/borg/issues/3502
2018-03-02 14:21:08 +00:00
TW 9135c73b1f
Merge pull request #3652 from miek/backport-3596-and-3600
Backport #3596 and #3600 to 1.1-maint
2018-03-02 13:08:33 +01:00
TW a3d1eb26c4
Merge pull request #3650 from miek/backport-3580-to-1.1-maint
Backport 3580 to 1.1-maint
2018-03-02 13:00:57 +01:00
TW ccfeb44822
Merge pull request #3649 from miek/backport-3520-to-maint-1.1
Backport 3520 to 1.1-maint

Chunk seed is generated per /repository/.
2018-03-02 01:13:25 +01:00
SanskritFritz c446d8d802 Using spaces instead of tabs for indentation. 2018-03-01 23:25:43 +00:00
Viktor Bale 4eeb969157 Fixed tab completion problem where a space is always added after path even when it shouldn't 2018-03-01 23:21:50 +00:00
Rémi Oudin fe807046b4 Better formatting of CPU usage documentation
This is now displayed as a list, with bold fonts for each bullet.
Refers https://github.com/borgbackup/borg/issues/3554
2018-03-01 23:20:02 +00:00
Thomas Waldmann 6e02e2e452 do .h file content checks in binary mode, fixes #3544
we can't know the encoding header file authors will use,
so using binary for our simple checks is the safest way.
2018-02-28 15:51:27 +00:00
Gregor Kleen 183966549f Chunk seed is generated per /repository/ 2018-02-28 15:46:23 +00:00
TW b602612a40
Merge pull request #3555 from leo-b/1.1-maint-archive-metadata
add chunker_params to borg archive info (--json)
2018-01-29 17:52:26 +01:00
Alexander 'Leo' Bergolth 42a9053771 add chunker_params to json docs 2018-01-22 09:05:24 +01:00
TW 19032f72da
Merge pull request #3567 from ThomasWaldmann/files-cache-exception-handling-1.1
files cache: improve exception handling, fixes #3553 (1.1)
2018-01-21 12:19:53 +01:00
Thomas Waldmann 21742faf26 fixup: tests
(cherry picked from commit 835fede85f)
2018-01-20 17:13:45 +01:00
Thomas Waldmann 423ec4ba1e files cache: improve exception handling, fixes #3553
now deals with:
- corrupted files cache (truncated or modified not by borg)
- inaccessible/unreadable files cache
- missing files cache

The latter fix is not sufficient, the cache transaction processing
would still stumble over expected, but missing files in the cache.
2018-01-20 06:36:54 +01:00