You can not select more than 25 topics Topics must start with a letter or number, can include dashes ('-') and can be up to 35 characters long.
chris 17d597168a respect robots.txt 1 month ago
.gitignore gitignore config 1 month ago add readme 1 month ago
config.example.yaml initial commit 1 month ago respect robots.txt 1 month ago


This terrible script scrapes configured mastodon instances for configured tags and feeds the resulting list of toot URLs to your (single-user?) instances search API to fetch them for the federated timelime (or hashtag search, if your instances software supports that and why would it?)

If you want to use this copy config.example.yaml to config.yaml and fill in the blanks. You can get a bearer token by using pinafore, logging into your instance, open the network console (F12 in firefox), search for something and check the request headers on the GET operation.

All search requests made by this script are slow and blocking. If you schedule this to run at periodic intervals be sure to have some sort of locking so the script is not executed while the previous run is still working.


  • Python
  • python-requests library