Commit graph

47 commits

Author SHA1 Message Date
raynormast
a4614e886b
Merge pull request #5 from bolstad/deduplicte-endpoint-urls
Deduplicte endpoint urls
2023-03-23 21:13:53 -04:00
Christian Bolstad
237840aa33 Do not process hostnames that starts with a single # (in case someone accidently used the incorrect format to comment out lines 2023-01-14 13:52:53 +01:00
Christian Bolstad
237ed1303d Make sure that we only process the same url once 2023-01-14 13:51:31 +01:00
Christian Bolstad
e66b06503d always reset hashtag-urls.txt 2023-01-14 13:50:32 +01:00
raynor
d466f59781 Iniitial commit of misc scripts; needs debugging 2023-01-02 09:23:00 -05:00
Raynor
dcc2a551d2 Added sudos 2022-12-28 01:28:48 +00:00
Raynor
1ccee8638d Fixed typo 2022-12-28 01:27:21 +00:00
Raynor
c33b08165f Cleaned gitignore 2022-12-27 23:34:46 +00:00
Raynor
2f35a3cad6 Updated todo list 2022-12-27 23:34:10 +00:00
Raynor
022ac7750f Cleaned up gitignore 2022-12-27 23:34:02 +00:00
Raynor
e4f1ac5688 Updated documentation 2022-12-27 23:27:50 +00:00
Raynor
046839eba5 Cleaned up some unneeded files. 2022-12-27 22:20:53 +00:00
Raynor
2cc0d91ca4 Fixed bug in how hashtags are found 2022-12-26 17:50:05 +00:00
Raynor
1f9d8adc14 Clarified logging output language 2022-12-26 17:42:01 +00:00
Raynor
4c316296a5 Better documentation on minURIs 2022-12-26 17:31:53 +00:00
Raynor
29eb750165 Allow for variable stream delay to debug 2022-12-26 17:25:37 +00:00
Raynor
64c2abf173 Updated logging output 2022-12-26 17:20:07 +00:00
Raynor
1d7a2faf0b Restart time is not configurable 2022-12-22 14:10:36 +00:00
Raynor
d2d7f4f621 Install some other helpful internet utils 2022-12-22 14:07:31 +00:00
Raynor
86d97397df Upped restart time, output now more helpful 2022-12-22 14:07:09 +00:00
Raynor
9d3f7f4873 Added archive mode and some basic health checks 2022-12-22 14:06:43 +00:00
Raynor
543f896d52 Clarified debug output 2022-12-22 14:06:19 +00:00
Raynor
bd71dc16b4 Changed restart time; added to todo 2022-12-21 03:37:10 +00:00
Raynor
3a5a2c34e3 Change how archive directory is structured; create folder if needed 2022-12-21 03:36:31 +00:00
Raynor
d3accb4d65 Added a basic backoff if in archive mode 2022-12-21 03:29:28 +00:00
Raynor
2acfdf264f Add archive mode where JSON is saved only 2022-12-21 03:21:55 +00:00
Raynor
f561bb4521 git 2022-12-21 03:20:48 +00:00
raynormast
e877becdb1
Merge pull request #3 from raynormast/dev
Fixed URL
2022-12-18 19:56:56 -05:00
raynor
eefa547a13 Fixed URL 2022-12-18 19:56:13 -05:00
raynormast
962cc9455c
Merge pull request #2 from raynormast/dev
Dev
2022-12-18 19:43:10 -05:00
raynor
8d17d14736 Updated readme. Didn't proofread. Might meed more. 2022-12-18 19:41:52 -05:00
raynor
243c64e2b2 Added some files 2022-12-18 19:31:07 -05:00
raynor
316e5e6efa Updated to not use hashtags at all, can delete in future 2022-12-18 19:31:03 -05:00
raynor
079dc3b7f3 Started a todo list I may or may not get to 2022-12-18 19:30:30 -05:00
raynor
8339a881d0 Updated to work with tags 2022-12-18 19:30:19 -05:00
raynor
54a544703b Updated sample files 2022-12-18 19:29:51 -05:00
raynor
4d72a59e9f Changed rebuild to stay attached 2022-12-18 19:28:17 -05:00
raynor
3ecd85b5b3 Added script to make rebuilding docker faster 2022-12-18 14:15:59 -05:00
raynor
c2d101b946 Auto restart in lieu of real health checks 2022-12-17 21:22:26 -05:00
raynormast
1478d505f6
Merge pull request #1 from raynormast/dev
Dev
2022-12-17 20:47:19 -05:00
raynor
ccfbbc1997 Deleted original domains file 2022-12-17 20:45:59 -05:00
raynor
df6920efc7 Separate federated vs local feeds 2022-12-17 20:45:49 -05:00
raynor
0fc0470eb1 Updated readme to barebones
Will update later when I have energy
2022-12-17 18:56:12 -05:00
raynor
8c00c00e5b Moved to docker format 2022-12-17 18:55:34 -05:00
raynor
3ba88451bb Save raw json stream to disk 2022-12-17 23:17:52 +00:00
raynor
a513670179 Allow domains to be commented out 2022-12-17 18:04:13 -05:00
raynor
47b61a6388 Initial commit 2022-12-17 00:20:35 -05:00