Commit Graph

348 Commits

Author SHA1 Message Date
Jonas Borgström 6eb65d07f9 Switched to using avro serialization for archives 2010-10-17 17:44:41 +02:00
Jonas Borgström 5cd5d761cd Added basic unit tests. 2010-10-16 11:45:36 +02:00
Jonas Borgström 03b0e85d0b Move pretty_size to helpers.py 2010-10-15 22:29:36 +02:00
Jonas Borgström cbb62fd2a6 Removed unused store implementations 2010-10-15 22:22:29 +02:00
Jonas Borgström 98b1b5e0ce Switch from sha1 to sha256 2010-10-15 22:18:22 +02:00
Jonas Borgström 4bbd093a56 Added dedupestore "console script" 2010-10-15 20:46:17 +02:00
Jonas Borgström 767335e879 Use argparse instead of optparse 2010-10-15 20:35:49 +02:00
Jonas Borgström 885d267a42 Various bandstore improvements 2010-10-15 19:56:38 +02:00
Jonas Borgström f576c251b8 Fix cache reinitalization. 2010-10-15 19:33:15 +02:00
Jonas Borgström d0d8dc5f1e Improved robustness 2010-10-13 23:28:40 +02:00
Jonas Borgström af8c943694 bandedstore: Handle aborted transactions better 2010-10-13 22:18:54 +02:00
Jonas Borgström 2eea138c92 Use smarter chunkifier algorithm (same as git and rsyncable gzip) 2010-10-13 22:07:55 +02:00
Jonas Borgström 4e476d7653 An almost working banded store impl 2010-05-26 21:41:55 +02:00
Jonas Borgström 62a4a37544 An experimental sqlite based storage implementation. 2010-05-10 22:35:46 +02:00
Jonas Borgström 3d89bf7eac More accurate archive stats display 2010-04-22 22:34:33 +02:00
Jonas Borgström ddd32effba Fixed a chunk refcounting bug 2010-04-18 22:51:54 +02:00
Jonas Borgström 36d15b73e7 Initial archive stats implementation. 2010-04-18 22:34:21 +02:00
Jonas Borgström 357cad4d5d Nothing much. 2010-04-18 22:08:12 +02:00
Jonas Borgström eedf969f67 Fixed archive delete bug. 2010-03-29 21:40:09 +02:00
Jonas Borgström 42ff0a850b Store more chunk metadata in the archive. 2010-03-15 21:23:34 +01:00
Jonas Borgström 98f738fe7f Some code refactoring. 2010-03-09 22:27:37 +01:00
Jonas Borgström 723c636f06 Various code refactoring. 2010-03-06 18:25:35 +01:00
Jonas Borgström 7252c328dd A working c based chunkify implementation. Result: A 20+x speedup. YAY 2010-03-03 23:27:40 +01:00
Jonas Borgström c1a6a4f68c Partial C implementation of chunkifier 2010-03-03 22:52:57 +01:00
Jonas Borgström 3ce990ba19 Implemented checksum and roll_checksum in C.
About 30% Performance boost. Yay!
2010-03-02 20:21:13 +01:00
Jonas Borgström 61cbaf8642 Implemented checksum() in _speedups.c 2010-03-01 23:39:14 +01:00
Jonas Borgström 60126b6330 Some code refactoring. 2010-03-01 23:02:40 +01:00
Jonas Borgström ef4a035e53 Smarter buffer handling. 2010-03-01 22:16:07 +01:00
Jonas Borgström 8416de6219 Rename. 2010-03-01 22:04:43 +01:00
Jonas Borgström b1cf8b161c Better buffer handling. 2010-03-01 19:53:33 +01:00
Jonas Borgström 41a4842518 Switched to an inter based python implementation of chunkify. 2010-02-28 21:34:56 +01:00
Jonas Borgström f6473155c9 Various fixes. 2010-02-28 21:13:21 +01:00
Jonas Borgström aebf3cc6b1 Some ext experimentation. 2010-02-28 20:22:45 +01:00
Jonas Borgström 6c73f5dc86 Renamed chunker to chunkifier. 2010-02-28 16:20:19 +01:00
Jonas Borgström 0cca830981 Some chunker fixes. 2010-02-28 12:03:37 +01:00
Jonas Borgström 9f955bf9fb Working variable length file chunking. 2010-02-28 00:32:24 +01:00
Jonas Borgström bc959ebb37 Started added suppor for a using variable length chunks. 2010-02-27 23:23:39 +01:00
Jonas Borgström e4807b11c9 Improved optparse usage and implemented list archive(s) and verify_archive 2010-02-24 23:24:19 +01:00
Jonas Borgström 5cbafdfc20 Switched to a namespace base object store implementation. 2010-02-24 20:38:27 +01:00
Jonas Borgström e65ed8623f Initial optparse implementation. 2010-02-23 22:12:22 +01:00
Jonas Borgström 575efb5e0b Switch from Repository to Store. 2010-02-23 21:34:28 +01:00
Jonas Borgström 1e2ecae4e4 New object store implementation. 2010-02-22 23:17:49 +01:00
Jonas Borgström 1d76aab21e Persist cache info. 2010-02-22 21:29:31 +01:00
Jonas Borgström 246e3fa00e Added a uuid base id to repositoty. 2010-02-21 10:59:26 +01:00
Jonas Borgström 21069cc618 First on-disk archive format. 2010-02-20 22:28:46 +01:00
Jonas Borgström 695d5699ae Started work on archiver.py 2010-02-20 18:23:46 +01:00
Jonas Borgström 02c2490959 Implemented Repository.commit() and Repository.apply_txn() 2010-02-15 21:38:17 +01:00
Jonas Borgström 7d6aa3763d Initial import. 2010-02-14 14:44:18 +01:00