Commit Graph

2340 Commits

Author SHA1 Message Date
Thomas Waldmann d7500a1191 create new platform_posix module
move common posix cython code there.
2016-05-18 17:40:04 +02:00
Thomas Waldmann b5404209bb add swidth call to determine string width on terminal
on posix platforms, this is a small wrapper around wcswidth(3).
2016-05-18 17:40:04 +02:00
TW 088bccc649 Merge pull request #1057 from enkore/issue/1055
Fix tox
2016-05-18 17:39:01 +02:00
Marian Beermann 24cd303ca9
When probing key files, do binary reads 2016-05-18 17:37:48 +02:00
Marian Beermann 43258abf21
Fix tox 2016-05-18 17:08:49 +02:00
enkore ac2617f665 Merge pull request #1050 from enkore/feature/linux-bsdflags
Translate Linux fsflags to BSD flags and vice versa
2016-05-18 00:23:17 +02:00
Marian Beermann 805f63167c
Translate Linux fsflags to BSD flags and vice versa 2016-05-18 00:22:53 +02:00
TW eaf0f62022 Merge pull request #1049 from enkore/feature/sigterm
Handle SIGTERM
2016-05-17 19:28:14 +02:00
Marian Beermann 6cf61024d9
Handle SIGTERM and make a clean exit 2016-05-17 18:57:55 +02:00
enkore 47d29e75b3 Merge pull request #1047 from enkore/feature/init-doc
init: move epilogue from docs/usage into help output
2016-05-17 15:33:46 +02:00
Marian Beermann deab8ca7e2
init: move epilogue from docs/usage into help output
Also tell which algos are used and that HW accel is supported.
2016-05-17 01:00:48 +02:00
enkore be555d423e Merge pull request #985 from enkore/feature/fastlio
Improved LoggedIO write performance
2016-05-15 02:06:17 +02:00
Marian Beermann c52861e0ca
Improve LoggedIO write performance, make commit mechanism more solid
- Instead of very small (5 MB-ish) segment files, use larger ones
- Request asynchronous write-out or write-through (TODO) where it is supported,
  to achieve a continuously high throughput for writes
- Instead of depending on ordered writes (write data, commit tag, sync)
  for consistency, do a double-sync commit as more serious RDBMS also do
  i.e. write data, sync, write commit tag, sync
  Since commits are very expensive in Borg at the moment this makes no
  difference performance-wise.

New platform APIs: SyncFile, sync_dir

[x] Naive implementation (equivalent to what Borg did before)
[x] Linux implementation
[ ] Windows implementation
[-] OSX implementation (F_FULLSYNC)
2016-05-14 22:47:18 +02:00
enkore 3bc22061f7 Merge pull request #975 from enkore/feature/paranoid-check
check: support integrity verification
2016-05-13 23:17:29 +02:00
Marian Beermann 0bceaf0736
check: support integrity verification with --verify-data 2016-05-13 22:50:36 +02:00
enkore 0e8bd0ac6d Merge pull request #912 from enkore/stuff/decrypt-integrity-test
decrypt integrity test + some other tests
2016-05-13 22:31:49 +02:00
Marian Beermann ad5ae32cc4
testsuite/key: Use pytest built-in fixture 2016-05-13 22:07:20 +02:00
Marian Beermann 6a15e8d138 testsuite/key: environment_variable -> monkeypatch.setenv 2016-05-13 22:07:18 +02:00
Marian Beermann c6f7866e35 testsuite/key: add TestPassphrase 2016-05-13 22:07:18 +02:00
Marian Beermann e5356b7f66 testsuite/key: port to pytest, test_decrypt_integrity w/ 'carpet bombing' 2016-05-13 22:07:18 +02:00
Marian Beermann dece06fba9 KeyTestCase, test_decrypt_integrity 2016-05-13 22:07:18 +02:00
Marian Beermann 037d54e442 ArchiverTestCase, test_symlink_extract 2016-05-13 22:07:18 +02:00
enkore d4225f7dda Merge pull request #1032 from ThomasWaldmann/remove-openssl-random
remove openssl RAND_bytes from crypto.pyx
2016-05-09 07:51:28 +02:00
Thomas Waldmann 595e7c1dcd remove openssl RAND_bytes from crypto.pyx
was forgotten there and not used any more since a while.

also removed the hint about PyCrypto being an alternative to crypto.pyx,
it was not updated since 2014, looks pretty stale.
2016-05-09 04:14:50 +02:00
TW 6222ec98ed Merge pull request #1029 from ThomasWaldmann/prune-fix-indexerror
prune: fix IndexError
2016-05-07 21:26:37 +02:00
Thomas Waldmann a44e131661 prune: fix IndexError
if giving --prefix resulted in an empty archives_checkpoints list, it crashed with an IndexError.
2016-05-07 21:03:31 +02:00
TW 2cc117f4b0 Merge pull request #1028 from ThomasWaldmann/improve-example-script
improve backup example script, fixes #1020
2016-05-07 20:41:53 +02:00
TW 7214c36ac2 Merge pull request #1023 from ThomasWaldmann/use-clean-lines
load_excludes: reuse existing clean_lines function
2016-05-07 20:41:30 +02:00
TW 7cd8793e43 Merge pull request #1026 from ThomasWaldmann/improve-extract-docs
better help / docs for borg extract --dry-run, fixes #1022
2016-05-07 19:24:07 +02:00
Thomas Waldmann 06caee2ed0 improve backup example script, fixes #1020 2016-05-07 19:22:48 +02:00
TW 512e7ec18a Merge pull request #1025 from ThomasWaldmann/remove-tabs
_chunker.c: remove tab characters
2016-05-07 18:54:58 +02:00
Thomas Waldmann d2988444c0 better help / docs for borg extract --dry-run, fixes #1022 2016-05-07 18:53:58 +02:00
Thomas Waldmann 61a73f5f91 _chunker.c: remove tab characters
always use 4 spaces for indenting.
2016-05-07 18:18:40 +02:00
Thomas Waldmann ee8f753946 load_excludes: reuse existing clean_lines function 2016-05-07 17:02:09 +02:00
TW 18263f6257 Merge pull request #1019 from ThomasWaldmann/pkgsrc-osx-prefix
seek /opt/pkg (pkgsrc OS X) for openssl and lz4
2016-05-06 17:04:51 +02:00
Thomas Waldmann 0fa663febe seek /opt/pkg (pkgsrc OS X) for openssl and lz4
Add /opt/pkg (used by pkgsrc on Mac OS X) to possible openssl and
lz4 header path.

    from 2015Q2 onwards the prefix has changed to /opt/pkg
    in order to be compatible with El Capitan's
    "System Integrity Protection" feature.

-- pkgsrc.joynet.com

thanks to @weakish for finding this!
2016-05-06 14:56:54 +02:00
TW d22bbe17c5 Merge pull request #1015 from ThomasWaldmann/checkpoint-docs
faq: be more detailed about how checkpoints work, fixes #994
2016-05-05 19:13:18 +02:00
Thomas Waldmann 4c52fcffcc faq: be more detailed about how checkpoints work, fixes #994 2016-05-05 18:59:03 +02:00
TW 571329e6ae Merge pull request #1013 from ThomasWaldmann/docs-fix-issue-links
faq: fix issue links
2016-05-05 18:31:04 +02:00
TW 6e12d9c92d Merge pull request #1012 from ThomasWaldmann/append-only-docs
FAQ: add entries about compromised machines and other troubles, fixes #1011
2016-05-05 18:30:20 +02:00
Thomas Waldmann 619654b802 faq: fix issue links 2016-05-05 18:16:32 +02:00
Thomas Waldmann 8304b8a591 FAQ: add entries about compromised machines and other troubles
also: fix append-only mode description - "multiple machines" and "central server" are over-specific and not required for this scenario.
2016-05-05 17:52:31 +02:00
TW 37de94e532 Merge pull request #1008 from ThomasWaldmann/cleanup-checkpoints
prune: kill all checkpoints except the latest, fixes #998
2016-05-05 15:38:23 +02:00
Thomas Waldmann dabf816364 prune: cleanup checkpoints
kill all the checkpoints when pruning, except the latest one which might be
useful for continuing an interrupted backup. kill the latest checkpoint also
if it is already superceded by a successful backup.

note: this only works on checkpoints matched by --prefix, other checkpoints
      are not touched.
2016-05-05 15:15:14 +02:00
Thomas Waldmann 39c0757020 Merge branch '1.0-maint' 2016-05-05 13:55:38 +02:00
TW f9638645d1 Merge pull request #996 from ThomasWaldmann/update-1.0-docs
update CHANGES in 1.0-maint
2016-05-05 13:51:59 +02:00
TW 6ae1999ff3 Merge pull request #1010 from ThomasWaldmann/doc-tags
borg create help: document format tags, fixes #894
2016-05-05 13:49:21 +02:00
Thomas Waldmann 7457c0f5da update CHANGES in 1.0-maint 2016-05-05 13:43:40 +02:00
Thomas Waldmann 9e09786b33 borg create help: document format tags, fixes #894
docs: rephrased, more useful examples
2016-05-05 13:38:08 +02:00
Thomas Waldmann f070e2313d Merge branch '1.0-maint' 2016-05-03 22:07:12 +02:00