 Dietmar Maurer
|
34a816cc7b
|
src/bin/proxmox-backup-client.rs: add output-fromat options, implement status api
|
2019-07-16 13:35:25 +02:00 |
|
|
Dietmar Maurer
|
0eecf38fbf
|
src/api2/admin/datastore.rs: add status api call
|
2019-07-16 13:34:38 +02:00 |
|
|
Dietmar Maurer
|
25500cfa26
|
src/cli/command.rs: add helpers/schema to format output
|
2019-07-16 11:46:58 +02:00 |
|
|
Dietmar Maurer
|
aad2ee4947
|
src/bin/pxar.rs: only print archive name in verbose mode
|
2019-07-16 08:38:02 +02:00 |
|
|
Dietmar Maurer
|
6b9a071028
|
src/bin/pxar.rs: add --verbose parameter to list (replace dump)
|
2019-07-16 08:31:40 +02:00 |
|
|
Dietmar Maurer
|
2665cef703
|
src/bin/proxmox-backup-client.rs: make repository parameter optional
And allow to read it from $ENV{PBS_REPOSITORY}
|
2019-07-16 07:30:04 +02:00 |
|
|
Dietmar Maurer
|
c8fc4fec8d
|
Cargo.toml: update to latest hyper version
Which already includes our path.
|
2019-07-15 13:37:27 +02:00 |
|
|
Dietmar Maurer
|
9eae781ab8
|
src/bin/pxar.rs - extract: allow to read from stdin
|
2019-07-05 12:39:25 +02:00 |
|
|
Dietmar Maurer
|
c6c9e093d0
|
src/bin/pxar.rs - dump: allow to read from stdin
|
2019-07-05 12:32:15 +02:00 |
|
|
Dietmar Maurer
|
bf1252619a
|
src/bin/proxmox-backup-client.rs - restore: allow to pipe output to stdout
|
2019-07-05 12:14:50 +02:00 |
|
|
Dietmar Maurer
|
f8100e9623
|
src/bin/proxmox-backup-client.rs: remove download cli, do everything in restore
|
2019-07-05 11:36:45 +02:00 |
|
|
Dietmar Maurer
|
f4bf7dfcc7
|
src/client/remote_chunk_reader.rs: implement simple caching
|
2019-07-05 10:42:46 +02:00 |
|
|
Dietmar Maurer
|
afb4cd28be
|
src/backup/fixed_index.rs: implement BufferedFixedReader
|
2019-07-05 09:19:56 +02:00 |
|
|
Dietmar Maurer
|
b46c3fad03
|
src/backup/fixed_index.rs: use correct size
We need to consider that the last chunk may have smaller size.
|
2019-07-04 15:13:22 +02:00 |
|
|
Dietmar Maurer
|
9cc88a7c00
|
src/client/http_client.rs - finish: hold reference to avoid early connection close
|
2019-07-04 15:11:23 +02:00 |
|
|
Dietmar Maurer
|
5e04ec707d
|
src/api2/backup/environment.rs: improve chunk alignment/size checks
|
2019-07-04 13:40:43 +02:00 |
|
|
Dietmar Maurer
|
a24e3993e0
|
src/backup/chunk_store.rs: coding style fixes
|
2019-07-04 11:39:10 +02:00 |
|
|
Dietmar Maurer
|
e4c2fbf170
|
src/backup/chunk_store.rs: additionally log chunk count
|
2019-07-04 11:27:11 +02:00 |
|
|
Dietmar Maurer
|
9850bcdf19
|
src/backup/chunk_store.rs: improve error reporting
|
2019-07-04 11:21:54 +02:00 |
|
|
Dietmar Maurer
|
99168f43e6
|
src/client/http_client.rs: s/set_recv_buf_size/set_recv_buffer_size/
|
2019-07-04 10:51:18 +02:00 |
|
|
Dietmar Maurer
|
c698636a5d
|
src/tools/fs.rs - read_dir: return nix::Result
|
2019-07-04 10:47:16 +02:00 |
|
|
Dietmar Maurer
|
a57360983b
|
src/backup/chunk_store.rs - get_chunk_iterator: return percentage inside iterator item
|
2019-07-04 09:26:44 +02:00 |
|
|
Dietmar Maurer
|
0f0a35b390
|
src/backup/dynamic_index.rs: lock file inside new, code cleanup
|
2019-07-04 08:17:30 +02:00 |
|
|
Dietmar Maurer
|
a7c72ad9eb
|
src/backup/fixed_index.rs - FixedIndexReader: remove reference to chunk store
|
2019-07-04 08:13:16 +02:00 |
|
|
Dietmar Maurer
|
a660978c9a
|
src/backup/datastore.rs: generic index_mark_used_chunks implementation, improve GC stats
|
2019-07-04 07:57:43 +02:00 |
|
|
Dietmar Maurer
|
86eda3eb0d
|
src/bin/proxmox-backup-client.rs: implement restore using BackupReader
|
2019-07-03 15:45:12 +02:00 |
|
|
Dietmar Maurer
|
b2a6897982
|
src/client/remote_chunk_reader.rs: remove dead code
|
2019-07-03 14:56:24 +02:00 |
|
|
Dietmar Maurer
|
7f99bf691a
|
src/client/remote_chunk_reader.rs: implement remote chunk reader
|
2019-07-03 14:39:13 +02:00 |
|
|
Dietmar Maurer
|
4f6aaf542c
|
src/client/http_client.rs: avoid compiler warning
|
2019-07-03 14:36:02 +02:00 |
|
|
Dietmar Maurer
|
3467cd91e9
|
src/client/http_client.rs: return Arc<Self>
Avoid to call canceller for each clone on drop ...
|
2019-07-03 14:26:07 +02:00 |
|
|
Dietmar Maurer
|
1e0784841c
|
src/backup/read_chunk.rs: use &mut self
|
2019-07-03 14:25:18 +02:00 |
|
|
Dietmar Maurer
|
80af046794
|
src/server/rest.rs: avoid unwrap
|
2019-07-03 12:00:43 +02:00 |
|
|
Dietmar Maurer
|
7fb4f5642a
|
src/server/rest.rs: log peer address, use hyper MakeService
|
2019-07-03 11:54:35 +02:00 |
|
|
Dietmar Maurer
|
6d1f61b208
|
use hyper/tokio-openssl instead of hyper/tokio-tls
This exposes the complete SSL setup. And download is much faster
now (600MB/s instead of 130MB/s)!
|
2019-07-02 13:36:28 +02:00 |
|
|
Dietmar Maurer
|
74d0a6bc23
|
src/bin/proxmox-backup-proxy.rs: set socket options for max. performance
|
2019-07-02 10:48:58 +02:00 |
|
|
Dietmar Maurer
|
93f8bb0445
|
src/bin/h2s-client.rs: avoid compiler warnings
|
2019-07-02 08:59:33 +02:00 |
|
|
Dietmar Maurer
|
877dd11133
|
src/backup/{fixed, dynamic}_index.rs: improve error messages
|
2019-07-02 08:56:56 +02:00 |
|
|
Dietmar Maurer
|
5c593a4d56
|
src/backup/read_chunk.rs: use Arc for DataStore
|
2019-07-02 08:49:16 +02:00 |
|
|
Dietmar Maurer
|
b850673634
|
src/backup/read_chunk.rs: move read chunk trait into extra file
And implement LocalChunkReader.
|
2019-07-02 08:22:29 +02:00 |
|
|
Dietmar Maurer
|
8fad30a4b1
|
use latest hyper master branch to include socket buffer size fix
|
2019-07-02 07:09:46 +02:00 |
|
|
Dietmar Maurer
|
dc9775d1b0
|
src/bin/h2s-client.rs: increase tokio tcp stream read buffer size
This improves download speed by factor 10.
|
2019-06-29 18:09:50 +02:00 |
|
|
Dietmar Maurer
|
34f7131160
|
src/bin/h2s-client.rs: avoid hyper, use h2 directly
But performance is still bad.
|
2019-06-29 15:58:18 +02:00 |
|
|
Dietmar Maurer
|
5ed2277f0e
|
src/bin/h2s-server.rs: test to reproduce slow h2 download
Simplified code, use with h2s-client.rs.
|
2019-06-29 14:57:54 +02:00 |
|
|
Dietmar Maurer
|
17243003b3
|
src/bin/download-speed.rs: h2 download speedtest for our server
I get about 30MB/s (much too slow)
|
2019-06-29 13:43:10 +02:00 |
|
|
Dietmar Maurer
|
a2b29b68d4
|
src/client/http_client.rs: use maximal h2 window sizes
|
2019-06-29 11:05:36 +02:00 |
|
|
Dietmar Maurer
|
872debdefa
|
src/bin/h2client.rs: tune h2 client parameters to get reasonable speed
We now get about 2.5GB/s (not really good, but better)
|
2019-06-29 10:41:24 +02:00 |
|
|
Dietmar Maurer
|
38294bcc56
|
src/client.rs: make module put_to_stream public
|
2019-06-29 10:40:43 +02:00 |
|
|
Dietmar Maurer
|
fded1f3154
|
add code to test H2 speed
I currently get about 1MB/s, which is ways too slow (must be a bug)?
|
2019-06-29 10:08:12 +02:00 |
|
|
Dietmar Maurer
|
d48a9955a5
|
src/backup/dynamic_index.rs: introduce ReadChunk trait
|
2019-06-28 16:35:00 +02:00 |
|
|
Dietmar Maurer
|
09d7dc5024
|
src/api2/reader.rs: add download chunk api
|
2019-06-28 16:27:01 +02:00 |
|
|
Dietmar Maurer
|
fcf5dea56d
|
src/client/http_client.rs: increase h2 window size, set tcp nodelay option
To increase h2 download speed.
|
2019-06-28 16:00:58 +02:00 |
|
|
Dietmar Maurer
|
81a6ce6fde
|
src/backup/chunk_store.rs: new method chunk_path()
Returns the absolute path.
|
2019-06-28 15:48:09 +02:00 |
|
|
Dietmar Maurer
|
fcfb84fedf
|
file download: avoid unnecessary copy
|
2019-06-28 07:07:52 +02:00 |
|
|
Dietmar Maurer
|
984a7c3502
|
src/client/http_client.rs - h2 download: implement flow control
|
2019-06-28 07:02:43 +02:00 |
|
|
Dietmar Maurer
|
cf925b94ab
|
debian/control: add clang build dependency
|
2019-06-27 11:14:33 +02:00 |
|
|
Dietmar Maurer
|
dd066d28e2
|
src/api2/reader.rs: implement backup reader protocol
|
2019-06-27 09:01:41 +02:00 |
|
|
Dietmar Maurer
|
42a87f7b96
|
src/server/h2service.rs: implement generic h2 service
|
2019-06-26 17:38:33 +02:00 |
|
|
Dietmar Maurer
|
fb0470837b
|
src/client/http_client.rs: split out code to start new h2 connections
|
2019-06-26 12:09:18 +02:00 |
|
|
Dietmar Maurer
|
b208da8393
|
src/backup/data_{chunk,blob}.rs: add verify_crc method
|
2019-06-26 09:54:25 +02:00 |
|
|
Dietmar Maurer
|
fef44d4f78
|
src/bin/proxmox-backup-client.rs: decode blobs on download
No more need for that clumsy blob cli (removed).
|
2019-06-26 09:18:59 +02:00 |
|
|
Dietmar Maurer
|
c2b945341c
|
src/client/http_client.rs - download: use generic Write type, return writer.
Make it possible to write int Vec<u8>.
|
2019-06-26 09:17:13 +02:00 |
|
|
Dietmar Maurer
|
bb8231409e
|
src/backup/crypt_config.rs - generate_rsa_encoded_key: store as json
Use the KeyConfig serialization with kdf = None.
|
2019-06-26 07:32:34 +02:00 |
|
|
Dietmar Maurer
|
3031e44c58
|
src/bin/proxmox-backup-client.rs: remove stale download file, start blob cli
|
2019-06-25 13:00:37 +02:00 |
|
|
Dietmar Maurer
|
f14a8c9a85
|
src/api2/admin/datastore.rs: use correct path for download
|
2019-06-25 12:59:36 +02:00 |
|
|
Dietmar Maurer
|
81820b0d4d
|
src/client/http_client.rs - download: fix error handling
|
2019-06-25 12:43:55 +02:00 |
|
|
Dietmar Maurer
|
45db6f89e1
|
src/bin/proxmox-backup-client.rs: implement download command
|
2019-06-25 11:17:24 +02:00 |
|
|
Dietmar Maurer
|
9e47c0a56e
|
src/api2/admin/datastore.rs: implement generic download method
We simply allow to download raw binary data.
|
2019-06-25 10:16:59 +02:00 |
|
|
Dietmar Maurer
|
da7d67213e
|
src/api2/admin/datastore/pxar.rs: remove pxar upload api
Upload needs to be done using the backup protocol.
|
2019-06-25 09:45:35 +02:00 |
|
|
Dietmar Maurer
|
dd8e744f9a
|
src/api2/admin/datastore.rs: use a worker log log prune actions
|
2019-06-25 08:12:25 +02:00 |
|
|
Dietmar Maurer
|
6899dbfb47
|
src/bin/proxmox-backup-client.rs: strip .blob extension
|
2019-06-25 07:11:02 +02:00 |
|
|
Dietmar Maurer
|
c6d203bbd3
|
src/backup/backup_info.rs: also list .blob files
|
2019-06-25 07:07:45 +02:00 |
|
|
Dietmar Maurer
|
045e8a568d
|
src/bin/proxmox-backup-client.rs: change key name to rsa-encrypted.key
|
2019-06-25 07:00:07 +02:00 |
|
|
Dietmar Maurer
|
79bc7345e8
|
src/cli/command.rs: fix ReST output format
|
2019-06-25 06:19:51 +02:00 |
|
|
Dietmar Maurer
|
9f46c7de4b
|
src/bin/proxmox-backup-client.rs: upload rsa encoded key after backup
|
2019-06-24 13:56:37 +02:00 |
|
|
Dietmar Maurer
|
46bd880041
|
src/api2/backup/environment.rs: new helper add_blob()
|
2019-06-24 09:35:37 +02:00 |
|
|
Dietmar Maurer
|
cb08ac3efe
|
src/api2/backup.rs: replace upload_config with upload_blob
|
2019-06-23 11:44:30 +02:00 |
|
|
Dietmar Maurer
|
a38c5d4d12
|
src/backup/data_blob.rs: implement from_raw()
|
2019-06-23 09:35:44 +02:00 |
|
|
Dietmar Maurer
|
6f083b7a92
|
src/api2/backup/upload_chunk.rs: compute crc on upload
|
2019-06-23 09:04:42 +02:00 |
|
|
Dietmar Maurer
|
ba01828d38
|
try to use use proxmox::tools::io::ops::ReadExtOps
|
2019-06-22 16:29:10 +02:00 |
|
|
Dietmar Maurer
|
27042ce637
|
src/backup/file_formats.rs: improve docs
|
2019-06-22 15:45:36 +02:00 |
|
|
Dietmar Maurer
|
9f83e0f7ee
|
src/backup/crypt_config.rs: simplify decode interface
|
2019-06-22 13:24:29 +02:00 |
|
|
Dietmar Maurer
|
0066c6d972
|
src/backup/crypt_config.rs: remove encode_chunk, use encrypt_to instead
|
2019-06-22 13:02:53 +02:00 |
|
|
Dietmar Maurer
|
ee8a7e8080
|
src/backup/crypt_config.rs: implement encrypt_to (output to writer)
|
2019-06-22 12:25:04 +02:00 |
|
|
Dietmar Maurer
|
991abfa8b4
|
src/backup/file_formats.rs: split out file format data
|
2019-06-22 09:12:25 +02:00 |
|
|
Dietmar Maurer
|
b7f4f27d6c
|
add crc field for binary blobs formats
|
2019-06-21 18:49:04 +02:00 |
|
|
Dietmar Maurer
|
a7f67a9a9c
|
depend on crc32fast
We can use this to compute fast checksums to test file integrity (not crypto safe).
|
2019-06-21 15:58:00 +02:00 |
|
|
Dietmar Maurer
|
3025b3a53c
|
src/backup/data_blob.rs: new file format for binary blobs
|
2019-06-21 11:32:07 +02:00 |
|
|
Dietmar Maurer
|
077a8cae63
|
src/backup/crypt_config.rs: make code more flexible
Allow to pass magic numbers as parameters.
|
2019-06-21 10:50:48 +02:00 |
|
|
Dietmar Maurer
|
c38266c18d
|
renamed: src/backup/crypt_setup.rs -> src/backup/crypt_config.rs
|
2019-06-21 09:51:18 +02:00 |
|
|
Dietmar Maurer
|
3ea8bfc9c0
|
src/bin/proxmox-backup-client.rs: add import-master-pubkey command
|
2019-06-21 07:34:17 +02:00 |
|
|
Dietmar Maurer
|
37c5a17505
|
src/bin/proxmox-backup-client.rs: helper to generate RSA master key
|
2019-06-21 07:12:19 +02:00 |
|
|
Dietmar Maurer
|
ab44acff57
|
src/backup/key_derivation.rs: add modified field to key file
|
2019-06-20 07:58:33 +02:00 |
|
|
Dietmar Maurer
|
6d0983dbe1
|
src/bin/proxmox-backup-client.rs: add keyfile parameter for backup
|
2019-06-19 17:16:41 +02:00 |
|
|
Dietmar Maurer
|
181f097af9
|
src/bin/proxmox-backup-client.rs - key API: pass kdf parameter
Allow to store keys without password.
|
2019-06-18 18:21:01 +02:00 |
|
|
Dietmar Maurer
|
9b06db4563
|
src/bin/proxmox-backup-client.rs: use file system path to reference keys
|
2019-06-18 17:38:50 +02:00 |
|
|
Dietmar Maurer
|
091540298e
|
src/bin/proxmox-backup-client.rs - create_key: always read password from tty
|
2019-06-18 17:27:52 +02:00 |
|
|
Dietmar Maurer
|
826f309bf5
|
src/backup/key_derivation.rs: move kdf code into separate file
|
2019-06-18 11:17:22 +02:00 |
|
|
Dietmar Maurer
|
11515438cc
|
Cargo.toml: use serde feature derive
|
2019-06-18 06:23:25 +02:00 |
|
|
Dietmar Maurer
|
ac71623483
|
src/bin/proxmox-backup-client.rs: implement "key change-passphrase"
|
2019-06-17 13:10:00 +02:00 |
|
|
Dietmar Maurer
|
f2401311b0
|
src/bin/proxmox-backup-client.rs: start key management
|
2019-06-17 10:33:24 +02:00 |
|