Commit Graph

4920 Commits

Author SHA1 Message Date
TW 4a71931e89
Merge pull request #3713 from ThomasWaldmann/fix-3707
Vagrant: xenial64 box now uses username 'vagrant', fixes #3707
2018-03-24 00:40:37 +01:00
Thomas Waldmann 3457439a45 Vagrant: xenial64 box now uses username 'vagrant', fixes #3707 2018-03-24 00:30:18 +01:00
TW 7127fb7f94
Merge pull request #3712 from ThomasWaldmann/fix-3706
Vagrant: move cleanup steps to fs_init, fixes #3706
2018-03-24 00:13:35 +01:00
TW c722bd303a
Merge pull request #3711 from ThomasWaldmann/fix-3705
skip test if argparse is broken, fixes #3705
2018-03-24 00:12:57 +01:00
Thomas Waldmann ad826cebad Vagrant: move cleanup steps to fs_init, fixes #3706
so after a vagrant up or vagrant reload (which both rsync), we
can just call the fs_init and run_tests provisioning steps and do
not need to call install_borg again.
2018-03-24 00:03:55 +01:00
Thomas Waldmann cb49431493 skip test if argparse is broken, fixes #3705
the borg command in the test has 0 path arguments.
Our PATH arg is specified with nargs='*', so that should be valid,
but it crashes python 3.4.0 .. 3.4.2. Python >=3.4.3 works.
2018-03-23 23:13:43 +01:00
TW 60ada21d7a
Merge pull request #3702 from ThomasWaldmann/fix-checkpoint-interval-default
fix Archive's checkpoint_interval arg default (300 -> 1800s)
2018-03-20 23:14:01 +01:00
Thomas Waldmann 8434f8360c fix Archive's checkpoint_interval arg default (300 -> 1800s)
the commandline arg default was already at 1800, so likely this is
only a cosmetic fix.
2018-03-18 14:45:25 +01:00
TW cbb19ca493
Merge pull request #3672 from ThomasWaldmann/files-cache-non-lazy
non-lazy files cache
2018-03-18 13:58:09 +01:00
TW 005c5a25cb
Merge pull request #3700 from ThomasWaldmann/backports-20
Backports 20
2018-03-18 01:30:51 +01:00
Thomas Waldmann 337c86b470 recreate --recompress: add metavar, clarify description
(cherry picked from commit c0f56ed039)
2018-03-17 23:52:44 +01:00
Thomas Waldmann a48fffad6e borg config --cache: allow validated access to previous_location
(cherry picked from commit 810986f0f5)
2018-03-17 23:49:21 +01:00
Thomas Waldmann d5917204c3 fix borgfs patterns/paths processing, fixes #3551
Just checking for None in patterns.py (and removing the set_defaults
calls in archiver.py) did not work as other arg parsing code relies on
having an empty list (in .patterns, .paths) to append to.

Thus I stayed away from pattern.py and rather fixed the defaults for
.paths and .patterns in all parsers.

(cherry picked from commit df9020389c)
2018-03-17 23:46:36 +01:00
TW 996a3dc2be
Merge pull request #3699 from ThomasWaldmann/backports-19
Backports 19
2018-03-17 23:43:37 +01:00
TW 502f11b9da
Merge pull request #3698 from ThomasWaldmann/backports-18
Backports 18
2018-03-17 21:43:31 +01:00
Thomas Waldmann 920e144c81 be more clear in secure-erase warning message, fixes #3591
(cherry picked from commit fe65ccf95a)
2018-03-17 21:39:27 +01:00
Thomas Waldmann 1e7c87b23d be more helpful when parsing invalid --pattern values
say what the real problem is.
say what is valid.

(cherry picked from commit f5ba0fc649)
2018-03-17 21:37:40 +01:00
Thomas Waldmann 1db42a58a5 make sure all segment file offsets fit into uint32, fixes #3592
C code and the repo index use uint32 type for segment file offsets,
so when opening a repo and the config max_segment_size is too big,
fail early.

Also disallow setting a too big value via "borg config".

(cherry picked from commit 0e0e6da585)
2018-03-17 21:34:42 +01:00
Thomas Waldmann e96730ac24 borg config: add some validation, fixes #3566
only a few basic checks, it does not prevent all stupidities.

(cherry picked from commit 2d637d8ead)
2018-03-17 21:33:53 +01:00
TW 8f2d80e60b
Merge pull request #3697 from ThomasWaldmann/backports-17
Backports 17
2018-03-17 21:27:09 +01:00
Thomas Waldmann b6ed644d58 docs: clarify path semantics when matching, fixes #3598
(cherry picked from commit 9b73d31a40)
2018-03-17 21:24:19 +01:00
Thomas Waldmann bdc58c00ed docs: add an example for --pattern usage, fixes #3661
(cherry picked from commit cf72c9592c)
2018-03-17 21:24:08 +01:00
Thomas Waldmann 30db004de6 docs: improve logging docs, fixes #3549
(cherry picked from commit 99be106bc8)
2018-03-17 21:21:55 +01:00
Thomas Waldmann 1f943f228f quickstart: add note about permissions, borg@localhost, fixes #3452
(cherry picked from commit 7bc2138dcb)
2018-03-17 21:19:23 +01:00
Thomas Schwinge ea344260d6 Mark up Unicode string
Running Sphinx v1.4.8
    WARNING: the config value 'copyright' is set to a string with non-ASCII characters; this can lead to Unicode errors occurring. Please use Unicode strings, e.g. u'Content'.
    [...]
    Encoding error:
    'ascii' codec can't decode byte 0xc3 in position 23: ordinal not in range(128)

(cherry picked from commit 2458035057)
2018-03-17 21:18:17 +01:00
Thomas Waldmann 2f443cae73 docs: extend append-only repo rollback docs, fixes #3579
(cherry picked from commit 451b22ee51)
2018-03-17 21:12:41 +01:00
Thomas Waldmann 0555fe4869 security docs: add about combining compression and encryption
(cherry picked from commit be8913a93c)
2018-03-17 21:11:15 +01:00
enkore ac0b9fbdae sec docs: explicitly note what happens OUTSIDE the attack model
(cherry picked from commit 674ce72fda)
2018-03-17 21:09:13 +01:00
TW d7ec959ce2
Merge pull request #3692 from ThomasWaldmann/diff-deleted-empty
fix diff deleted/empty, fixes #3688
2018-03-17 19:41:38 +01:00
Thomas Waldmann c3b7d7b60c consider an empty file as different to a non-existing file, fixes #3688 2018-03-17 18:50:51 +01:00
Thomas Waldmann 01beee37a7 add test for issue #3688
(cherry picked from commit 0a46d3330c)
2018-03-17 18:30:44 +01:00
Thomas Waldmann d3274cd2c9 cleanup: move "processing files" message to expected place
(now possible as we do not lazy load the files cache any more)
2018-03-08 04:21:58 +01:00
Thomas Waldmann e4125b4b64 cleanup: get rid of ignore_inode, replace with cache_mode
ignore_inode == ('i' not in cache_mode)  # i)node
2018-03-08 04:10:43 +01:00
Thomas Waldmann c27c98ced0 cleanup: get rid of Cache.do_files, replace with cache_mode
not do_files == (cache_mode == 'd')  # d)isabled
2018-03-08 03:39:38 +01:00
Thomas Waldmann e9af3c6ab3 read files cache early, init checkpoint timer after that, see #3394
reading the files cache can take considerable amount of time (a user
reported 1h 42min for a 700MB files cache for a repo with 8M files and
15TB total), so we must init the checkpoint timer after that or borg
will create the checkpoint too early.

creating a checkpoint means (among other stuff) saving the files cache,
which will also take a lot of time in such a case, one time too much.

doing this in a clean way required some refactoring:
- cache_mode is now given to Cache initializer and stored in instance
- the files cache is loaded early in _do_open (if needed)
2018-03-08 03:20:56 +01:00
TW 767dccb24c
Merge pull request #3668 from anowlcalledjosh/docs-formatting-backport-1.1
Improve formatting of GPG output in documentation (backport to 1.1)
2018-03-05 17:39:09 +01:00
Josh Holland b0c441660f
Improve formatting of GPG output in documentation
(cherry picked from commit 9f2f4132ec)
2018-03-05 15:15:52 +00:00
TW bf6961f5bd
Merge pull request #3660 from dragetd/draget-backport-1.1-doc
Add docs on how to verify a signed release
2018-03-03 00:20:24 +01:00
Michael Gajda 17bb3f8f98 Add docs on how to verify a signed release
Short howto on using gpg to verify a signed binary release.
Fixes #3634
2018-03-02 22:11:49 +01:00
TW 1f84b0810d
Merge pull request #3654 from miek/backport-3633
Backport #3633 to 1.1-maint
2018-03-02 19:34:05 +01:00
TW 2e40f70911
Merge pull request #3655 from miek/backport-3607
Backport #3607 to 1.1-maint
2018-03-02 17:53:03 +01:00
TW 8f2b62522d
Merge pull request #3656 from miek/backport-3604
Backport #3604 to 1.1-maint
2018-03-02 16:53:14 +01:00
Thomas Waldmann d8cfd91b15 fix borg create never showing M status
the problem was that the upper layer code did not have enough information
about the file, whether it is known or not - and thus, could not decide
correctly whether status should be M)odified or A)dded.

now, file_known_and_unchanged method returns an additional "known"
boolean to fix this.

also: add comment about files cache loading in cache_mode='r'
2018-03-02 15:44:41 +00:00
Thomas Waldmann 44ba0bb319 fix erroneously skipped zstd compressor tests, fixes #3606 2018-03-02 15:44:33 +00:00
Thomas Waldmann 8eb2fee7a0 Revert "travis osx: run brew update first, fixes #3527"
This reverts commit e4828078bb.
2018-03-02 15:44:22 +00:00
TW fd79b90ec0
Merge pull request #3651 from miek/backport-3589
Backport #3589 to 1.1-maint
2018-03-02 16:08:57 +01:00
Rémi Oudin 4e50dc6d94 Link to offline documentation
Add a link to the offline documentation in README.rst.
Refers https://github.com/borgbackup/borg/issues/3502
2018-03-02 14:21:08 +00:00
TW 9135c73b1f
Merge pull request #3652 from miek/backport-3596-and-3600
Backport #3596 and #3600 to 1.1-maint
2018-03-02 13:08:33 +01:00
TW a3d1eb26c4
Merge pull request #3650 from miek/backport-3580-to-1.1-maint
Backport 3580 to 1.1-maint
2018-03-02 13:00:57 +01:00
TW ccfeb44822
Merge pull request #3649 from miek/backport-3520-to-maint-1.1
Backport 3520 to 1.1-maint

Chunk seed is generated per /repository/.
2018-03-02 01:13:25 +01:00