0cad37f67f
Filepath over ssh should be wrapped in qoutes.
...
This is relevant for files with spaces or special characters that we
want interpreted as a single parameter.
2023-08-26 10:52:13 +02:00
42f909a251
Escape spaces in file path for du command
2023-08-25 20:30:09 +02:00
db03d8debf
du command incorrect, host instead of path
2023-08-25 20:28:22 +02:00
b75115515e
Files list should be logged as string
2023-08-25 19:49:24 +02:00
cedefbc42b
Re-wrote everything to be defined in Classes, better logging & exec
...
Abstracted remote and local filesystems into a System class.
Transporter does the file transfering, simplified this code. Removes a
lot of the error handling that was there in replacement of state that
will be more resilient, predictable and less error-prone.
2023-08-25 19:39:07 +02:00
9d77dd210b
Avg speed file should return integer or None
2023-08-25 19:31:18 +02:00
ed2a1d9a53
Make elastic logging optional with config flag
2023-08-25 19:30:50 +02:00
948eeb1d31
Updated default configuration
2023-08-25 19:12:35 +02:00
e697a54332
.avgspeed.txt file gitignored
2023-08-25 19:10:32 +02:00
7ac6583796
Ensure always writing a number to file
2023-08-22 20:25:25 +02:00
12f6d1bf3f
Error when moving files without parent folders
...
This will check if file ends with a know video extension, if so
use os.makedirs to create a folder at destination and update rsync
destination with this folder.
2023-08-22 20:21:33 +02:00
7dcbd60de4
All log messages before moving a file should be debug
2022-12-10 11:59:33 +01:00
0f5f050448
Compute, log and save to file estimated & actual transfer time
2022-11-28 00:49:13 +01:00
6ff33dcef1
Use delugeClient-kevin package instead of exec in os thread
2022-11-28 00:48:24 +01:00
8af5301d34
More metadata logged to es, also es apikey setting
2022-11-28 00:44:30 +01:00
23d7b7513f
Calculate, log & save estimated & actual transfer speed
2022-11-28 00:43:04 +01:00
2fc9948836
File for storing previous avg transfer speed
2022-11-28 00:40:36 +01:00
92441a41f3
Updated readme
2022-11-27 19:18:24 +01:00
a11567dcf6
Moved log message for when we move an item to below the Already exists skipping message. If the file already exists we dont print Moving message when its acctually not going to be moved.
2019-05-01 21:17:55 +02:00
1846d15cac
Changed elastic param from file to path to be more consistent with elastic fields.
2019-05-01 21:16:45 +02:00
02f4b1b371
Posts to unique index every day with suffix of todays date
2019-05-01 21:15:25 +02:00
0816b77352
Fixed issue where not supplying es argument to logger threw an error.
2019-05-01 12:30:01 +02:00
75faa5c949
Fixed syntax error. Missing wrapping dict
2019-05-01 12:16:09 +02:00
0d394b8d1d
All logs that have filenames or paths now also supply these as args to the logger. They then receive their own field mapping in the document sent to elastic.
2019-05-01 12:13:59 +02:00
829a60f570
Created a middleware for our logger that can receive a es parameter. If supplied the parameter values is stripped from log string and its key and value are added to the document sent to elastic. This way filenames and lists can get their own field mapping and more easily searchable.
2019-05-01 12:12:28 +02:00
8030cf5b36
Safer parameter strings for rsync command. Wrap filename in qoutes.
2019-05-01 10:50:28 +02:00
ce2a319447
Conver session id to string when attaching to json object.
2019-05-01 00:30:25 +02:00
c3a23ef344
Fixed syntax error at if test. Incorrect closing paranthese position
2019-05-01 00:28:11 +02:00
5559030199
Create a session id each time ES handler is initialized
2019-05-01 00:26:31 +02:00
3c976b398f
We collect files to move. Some cases another transfer can start and finish before this instance gets to the file. To not transfere duplicates we now check if the file exists with getFiles before we start a transfere. If its at the remote path we simply continue to the next file.
2019-04-30 23:52:49 +02:00
506a029a88
Config gets a new elastic field for logging to dynamic elastic host.
2019-04-30 19:24:36 +02:00
206606ca1e
Moved function for fetching config into separate utils file.
2019-04-30 19:23:04 +02:00
df5246b304
Elastic logging handler now dependency free (urllib in favor of requests)
2019-04-30 00:28:43 +02:00
eefe4f7aa0
Created a custom elastic logging handler.
2019-04-30 00:23:30 +02:00
0a88e3b376
Changed severity levels on some logs
2019-04-30 00:22:21 +02:00
8c67226823
Log-log-log! If files are found or not we output two different logs. Also info log every time we dont find anything.
2019-04-29 22:39:20 +02:00
524cc82020
Replaced all prints with logger messages. Also added more info logging of what files are found
2019-04-29 22:26:23 +02:00
9c95395827
Logg deluge stdout to log file on remove and fixed issue where the name to delete from deluge was the absolute path not just the filename.
2019-04-29 22:13:40 +02:00
4e5f5e5172
Renamed case-sensitive file
2019-04-29 22:03:35 +02:00
dc777f0812
Improved log levels for subprocess calls.
2019-04-29 22:01:19 +02:00
af136e7ce2
Now uses logging to file.
2019-04-29 21:53:29 +02:00
48266f7d1a
Added project config file to gitignore
2019-04-29 21:52:44 +02:00
40846e490f
Logger now also creates log file if it does not exist yet
2019-04-29 21:52:07 +02:00
80013af814
If config does not exist we exit and tell user to follow readme
2019-04-29 21:33:20 +02:00
dce5a070ca
Added default config file with empty variables.
2019-04-29 21:09:43 +02:00
15eeb3681f
Version 0.1 of the transatlantic torrent express.
2019-04-29 21:08:25 +02:00
ef1e671521
Initial commit
2019-04-29 21:07:04 +02:00