Commit Graph

81 Commits

Author SHA1 Message Date
codl 8422b6d89b
add soft and hard time limits to every task 2017-09-30 20:44:27 +02:00
codl a6870d3775
codacy 2017-09-24 23:54:03 +02:00
codl fd0bd49bdd
lol oops 2017-09-21 02:33:00 +02:00
codl fb65bcf0ac
dont open one redis client per task 👀 2017-09-21 02:27:30 +02:00
codl 0d7c1af13d
twiddle knob 2017-09-21 02:19:42 +02:00
codl 0ad980f499
twiddle knob 2017-09-21 01:25:25 +02:00
codl c135dc793e
rename lib to libforget 2017-09-20 23:04:44 +02:00
codl 89e35786d0
oops!!!!! 2017-09-20 14:44:01 +02:00
codl 06c0de29da
oops 2017-09-20 14:42:45 +02:00
codl 6bce7b1d04
make sure only one of each task runs at once 2017-09-20 14:39:31 +02:00
codl b0b17ae39f
oops 2017-09-20 12:58:16 +02:00
codl 53c2e8a023
another measure to avoid hitting rate limits 2017-09-20 12:41:10 +02:00
codl 02b564283f
twiddle the knob 2017-09-17 19:11:45 +02:00
codl 34b6f622a1
oops! oops. forgot to commit transaction 2017-09-17 15:21:48 +02:00
codl 614db2964d
update mastodon instance score based on active accounts
this is far more interesting than updating every time someone logs in,
since users don't have a reason to log in very often
2017-09-17 15:12:46 +02:00
codl 7c8c49a2ae
an attempt at preventing hitting rate limits on mastodon
most tasks don't need to be retried if they have failed, they will be
queued up again in the next batch
2017-09-16 20:08:06 +02:00
codl bde08c6c49
pylint 2017-09-06 13:08:06 +02:00
codl 840f56a769
send PermanentErrors to sentry 2017-09-05 13:01:33 +02:00
codl e8dbcb1d14
oops!!!!! 2017-09-05 00:08:33 +02:00
codl edf7732e67
overhaul and abstract errors in service libs
also add support for making an account dormant if there is a permanent
error
2017-09-04 22:15:05 +02:00
codl 5e22a0531f
capitalise service names 2017-09-04 22:15:04 +02:00
codl 7e677f4f97
whoops. move actions taken on unreachable accs to the celery task
it's not each service lib's job to deal with this
2017-09-02 20:00:44 +02:00
codl 1d677de7b4
add mechanism for showing reason for disabling account 2017-09-02 19:47:18 +02:00
codl 8506c920b6
fiddle with schedules 2017-09-01 01:45:24 +02:00
codl 2ad5df5fbb
lower minimum staleness for fetch 2017-08-31 20:48:26 +02:00
codl 20d765e0d1
pylint 2017-08-29 21:31:30 +02:00
codl 571ac0633b
fix 'cannot choose from an empty sequence' 2017-08-29 20:48:04 +02:00
codl 06bf189a33
an attempt at fixing the weird deadlock issue ive been having 2017-08-29 20:45:42 +02:00
codl 9a86b45268
fix twitter when all refreshed posts are gone 2017-08-29 17:50:19 +02:00
codl 20ed4175e4
limit to one tweet per delete round
deleting hundreds of tweets every 40 seconds is making us hit the rate
limit, dont do that
2017-08-29 17:44:50 +02:00
codl 007aec7529
flakes8 2017-08-29 14:46:32 +02:00
codl 2c4d6b9f63
fix issues raised by bandit 2017-08-29 13:26:32 +02:00
codl 19982af3ee
hgghn celery statsd bad 2017-08-28 17:24:02 +02:00
codl 2823f5fb76
celery statsd 2017-08-28 17:19:07 +02:00
codl 719c54b046
mastodon instances: lower max popularity to 40
100 is really high considering forget's popularity
2017-08-28 15:37:49 +02:00
codl 47ef77d0e2
ugggghhhhhh oops 2017-08-23 11:50:30 +02:00
codl 1dfb728805
add autocomplete for mastodon instances 2017-08-23 11:42:32 +02:00
codl 06f144f8b4
allow mastodon users to preserve DMs 2017-08-20 18:23:38 +02:00
codl b219f2971b
OOPS oops 2017-08-19 15:17:22 +02:00
codl 126c24db5f
be smarter about rate limits on mastodon 2017-08-19 14:18:33 +02:00
codl ff358ed64f
ahhhhhh!! mastodon support 2017-08-19 13:12:22 +02:00
codl d3d93c3cef
ghfjklghjdkflhgjfklhgjkdflshgjdflshgjkdflshgjdfklshgjkdflghjkdflhgjkldfshjgkldfhjgldhfjkgldhfjgklfdhsjgklhfjkslghjdfklsg
mastodon why
2017-08-19 13:12:22 +02:00
codl 59c278b3dc
x 2017-08-14 21:22:42 +02:00
codl 1cd5b8fa47
replace last_delete with next_delete 2017-08-14 20:58:22 +02:00
codl c54f6d0eee
tasks: ignore inaccessible accounts for fetch as well 2017-08-14 20:01:59 +02:00
codl 3ebb9476ef
oops 2017-08-13 17:39:05 +02:00
codl 4fa65aa1fe
g 2017-08-13 17:10:53 +02:00
codl 6e39874578
oops 2017-08-13 11:16:43 +02:00
codl 1a54f5052f
refresh: take the 100 most stale posts
it doesn't make sense to sample random posts anymore since i don't use
the result of that for picking a post to delete anymore
2017-08-13 11:03:29 +02:00
codl bd574920b4
refresh task: ignore accounts with no tokens 2017-08-13 10:53:29 +02:00