Commit Graph

93 Commits

Author SHA1 Message Date
codl d5e0b43c9e
fix: posts not getting refreshed
turns out i was not touching updated_at, so i'd always be refreshing
the same posts unless one of them actually changed

this is embarassing, there are posts in the DB that haven't been
refreshed since 2017
2019-02-24 16:28:59 +01:00
codl c54390801c
code quality fixes
also ran yapf on tasks.py
2018-08-14 03:51:14 +02:00
codl b3de8e10ac
add exponential backoff 2018-07-06 01:44:30 +02:00
codl e2f1ca1732
replace messy version stuff with versioneer 2018-01-31 23:16:54 +01:00
codl 51e070af3d
three-way favourite policy. closes #18 2018-01-03 18:00:59 +01:00
codl b11ffbbc11
more knob twiddling 2017-12-28 15:30:02 +01:00
codl e6a582431d
twiddle knob 2017-12-28 13:22:15 +01:00
codl 8b7db5cce2
simplify mastodon instance scoring 2017-12-28 13:12:55 +01:00
codl 9574476491
OOPS WHOOPS uh oh 2017-12-28 03:25:27 +01:00
codl ada719faeb
add ability to keep only posts without media
closes #16
2017-12-28 03:02:08 +01:00
codl c0c1591dfa
shorten delay between delete queue ups 2017-12-27 22:01:45 +01:00
codl f2cdc30c9e
fix #17 ignore fav on retweets
im not sure how it works on mastodon so i just took the safe option
2017-12-27 21:25:09 +01:00
codl 8422b6d89b
add soft and hard time limits to every task 2017-09-30 20:44:27 +02:00
codl a6870d3775
codacy 2017-09-24 23:54:03 +02:00
codl fd0bd49bdd
lol oops 2017-09-21 02:33:00 +02:00
codl fb65bcf0ac
dont open one redis client per task 👀 2017-09-21 02:27:30 +02:00
codl 0d7c1af13d
twiddle knob 2017-09-21 02:19:42 +02:00
codl 0ad980f499
twiddle knob 2017-09-21 01:25:25 +02:00
codl c135dc793e
rename lib to libforget 2017-09-20 23:04:44 +02:00
codl 89e35786d0
oops!!!!! 2017-09-20 14:44:01 +02:00
codl 06c0de29da
oops 2017-09-20 14:42:45 +02:00
codl 6bce7b1d04
make sure only one of each task runs at once 2017-09-20 14:39:31 +02:00
codl b0b17ae39f
oops 2017-09-20 12:58:16 +02:00
codl 53c2e8a023
another measure to avoid hitting rate limits 2017-09-20 12:41:10 +02:00
codl 02b564283f
twiddle the knob 2017-09-17 19:11:45 +02:00
codl 34b6f622a1
oops! oops. forgot to commit transaction 2017-09-17 15:21:48 +02:00
codl 614db2964d
update mastodon instance score based on active accounts
this is far more interesting than updating every time someone logs in,
since users don't have a reason to log in very often
2017-09-17 15:12:46 +02:00
codl 7c8c49a2ae
an attempt at preventing hitting rate limits on mastodon
most tasks don't need to be retried if they have failed, they will be
queued up again in the next batch
2017-09-16 20:08:06 +02:00
codl bde08c6c49
pylint 2017-09-06 13:08:06 +02:00
codl 840f56a769
send PermanentErrors to sentry 2017-09-05 13:01:33 +02:00
codl e8dbcb1d14
oops!!!!! 2017-09-05 00:08:33 +02:00
codl edf7732e67
overhaul and abstract errors in service libs
also add support for making an account dormant if there is a permanent
error
2017-09-04 22:15:05 +02:00
codl 5e22a0531f
capitalise service names 2017-09-04 22:15:04 +02:00
codl 7e677f4f97
whoops. move actions taken on unreachable accs to the celery task
it's not each service lib's job to deal with this
2017-09-02 20:00:44 +02:00
codl 1d677de7b4
add mechanism for showing reason for disabling account 2017-09-02 19:47:18 +02:00
codl 8506c920b6
fiddle with schedules 2017-09-01 01:45:24 +02:00
codl 2ad5df5fbb
lower minimum staleness for fetch 2017-08-31 20:48:26 +02:00
codl 20d765e0d1
pylint 2017-08-29 21:31:30 +02:00
codl 571ac0633b
fix 'cannot choose from an empty sequence' 2017-08-29 20:48:04 +02:00
codl 06bf189a33
an attempt at fixing the weird deadlock issue ive been having 2017-08-29 20:45:42 +02:00
codl 9a86b45268
fix twitter when all refreshed posts are gone 2017-08-29 17:50:19 +02:00
codl 20ed4175e4
limit to one tweet per delete round
deleting hundreds of tweets every 40 seconds is making us hit the rate
limit, dont do that
2017-08-29 17:44:50 +02:00
codl 007aec7529
flakes8 2017-08-29 14:46:32 +02:00
codl 2c4d6b9f63
fix issues raised by bandit 2017-08-29 13:26:32 +02:00
codl 19982af3ee
hgghn celery statsd bad 2017-08-28 17:24:02 +02:00
codl 2823f5fb76
celery statsd 2017-08-28 17:19:07 +02:00
codl 719c54b046
mastodon instances: lower max popularity to 40
100 is really high considering forget's popularity
2017-08-28 15:37:49 +02:00
codl 47ef77d0e2
ugggghhhhhh oops 2017-08-23 11:50:30 +02:00
codl 1dfb728805
add autocomplete for mastodon instances 2017-08-23 11:42:32 +02:00
codl 06f144f8b4
allow mastodon users to preserve DMs 2017-08-20 18:23:38 +02:00