Commit Graph

67 Commits

Author SHA1 Message Date
codl 614db2964d
update mastodon instance score based on active accounts
this is far more interesting than updating every time someone logs in,
since users don't have a reason to log in very often
2017-09-17 15:12:46 +02:00
codl 7c8c49a2ae
an attempt at preventing hitting rate limits on mastodon
most tasks don't need to be retried if they have failed, they will be
queued up again in the next batch
2017-09-16 20:08:06 +02:00
codl bde08c6c49
pylint 2017-09-06 13:08:06 +02:00
codl 840f56a769
send PermanentErrors to sentry 2017-09-05 13:01:33 +02:00
codl e8dbcb1d14
oops!!!!! 2017-09-05 00:08:33 +02:00
codl edf7732e67
overhaul and abstract errors in service libs
also add support for making an account dormant if there is a permanent
error
2017-09-04 22:15:05 +02:00
codl 5e22a0531f
capitalise service names 2017-09-04 22:15:04 +02:00
codl 7e677f4f97
whoops. move actions taken on unreachable accs to the celery task
it's not each service lib's job to deal with this
2017-09-02 20:00:44 +02:00
codl 1d677de7b4
add mechanism for showing reason for disabling account 2017-09-02 19:47:18 +02:00
codl 8506c920b6
fiddle with schedules 2017-09-01 01:45:24 +02:00
codl 2ad5df5fbb
lower minimum staleness for fetch 2017-08-31 20:48:26 +02:00
codl 20d765e0d1
pylint 2017-08-29 21:31:30 +02:00
codl 571ac0633b
fix 'cannot choose from an empty sequence' 2017-08-29 20:48:04 +02:00
codl 06bf189a33
an attempt at fixing the weird deadlock issue ive been having 2017-08-29 20:45:42 +02:00
codl 9a86b45268
fix twitter when all refreshed posts are gone 2017-08-29 17:50:19 +02:00
codl 20ed4175e4
limit to one tweet per delete round
deleting hundreds of tweets every 40 seconds is making us hit the rate
limit, dont do that
2017-08-29 17:44:50 +02:00
codl 007aec7529
flakes8 2017-08-29 14:46:32 +02:00
codl 2c4d6b9f63
fix issues raised by bandit 2017-08-29 13:26:32 +02:00
codl 19982af3ee
hgghn celery statsd bad 2017-08-28 17:24:02 +02:00
codl 2823f5fb76
celery statsd 2017-08-28 17:19:07 +02:00
codl 719c54b046
mastodon instances: lower max popularity to 40
100 is really high considering forget's popularity
2017-08-28 15:37:49 +02:00
codl 47ef77d0e2
ugggghhhhhh oops 2017-08-23 11:50:30 +02:00
codl 1dfb728805
add autocomplete for mastodon instances 2017-08-23 11:42:32 +02:00
codl 06f144f8b4
allow mastodon users to preserve DMs 2017-08-20 18:23:38 +02:00
codl b219f2971b
OOPS oops 2017-08-19 15:17:22 +02:00
codl 126c24db5f
be smarter about rate limits on mastodon 2017-08-19 14:18:33 +02:00
codl ff358ed64f
ahhhhhh!! mastodon support 2017-08-19 13:12:22 +02:00
codl d3d93c3cef
ghfjklghjdkflhgjfklhgjkdflshgjdflshgjkdflshgjdfklshgjkdflghjkdflhgjkldfshjgkldfhjgldhfjkgldhfjgklfdhsjgklhfjkslghjdfklsg
mastodon why
2017-08-19 13:12:22 +02:00
codl 59c278b3dc
x 2017-08-14 21:22:42 +02:00
codl 1cd5b8fa47
replace last_delete with next_delete 2017-08-14 20:58:22 +02:00
codl c54f6d0eee
tasks: ignore inaccessible accounts for fetch as well 2017-08-14 20:01:59 +02:00
codl 3ebb9476ef
oops 2017-08-13 17:39:05 +02:00
codl 4fa65aa1fe
g 2017-08-13 17:10:53 +02:00
codl 6e39874578
oops 2017-08-13 11:16:43 +02:00
codl 1a54f5052f
refresh: take the 100 most stale posts
it doesn't make sense to sample random posts anymore since i don't use
the result of that for picking a post to delete anymore
2017-08-13 11:03:29 +02:00
codl bd574920b4
refresh task: ignore accounts with no tokens 2017-08-13 10:53:29 +02:00
codl 74f20e3138
add a task to refresh the account with the longest time since a refresh 2017-08-12 23:22:22 +02:00
codl efeb5b6f41
extend /api/viewer to include various timers
also add a last_refresh field to accounts
2017-08-12 23:07:16 +02:00
codl cdff524e3d
fix 500 on tweet archive upload 2017-08-12 20:32:51 +02:00
codl 5a02d75f7c
close sqlalchemy session after a worker's work. closes #4
that was far easier than i anticipated...
2017-08-11 00:31:02 +02:00
codl 2f73ec3827
reduce tweet archive retention to 3 days from 7 2017-08-09 12:41:54 +02:00
codl 5bce4c9b17
massive optimisation on getting eligible posts
uhh the subquery is run for every single row so, with a long enough
time limit and enough posts thats. a several minute long SELECT
2017-08-09 10:25:41 +02:00
codl 1aaebc0ce2
add autoretries on all tasks that talk with twitter 2017-08-08 23:00:22 +02:00
codl 1039da665b
OOPS oops oops oops oops 2017-08-08 16:04:22 +02:00
codl ac6f7203d8
add ability to keep posts with media (close #1) 2017-08-08 15:40:56 +02:00
codl 4be6edb15f
cleanup anonymous oauth tokens 2017-08-08 04:16:57 +02:00
codl 4f40853b78
sentry: send version in tasks as well 2017-08-07 23:42:38 +02:00
codl a7f68fde9a
add sentry support to celery tasks too 2017-08-07 13:46:05 +02:00
codl fdf7148cf1
bad! 2017-08-04 16:41:12 +02:00
codl a7e414bae2
(screams) the time is nigh 2017-08-03 21:37:00 +02:00