Commit Graph

57 Commits

Author SHA1 Message Date
codl 2ad5df5fbb
lower minimum staleness for fetch 2017-08-31 20:48:26 +02:00
codl 20d765e0d1
pylint 2017-08-29 21:31:30 +02:00
codl 571ac0633b
fix 'cannot choose from an empty sequence' 2017-08-29 20:48:04 +02:00
codl 06bf189a33
an attempt at fixing the weird deadlock issue ive been having 2017-08-29 20:45:42 +02:00
codl 9a86b45268
fix twitter when all refreshed posts are gone 2017-08-29 17:50:19 +02:00
codl 20ed4175e4
limit to one tweet per delete round
deleting hundreds of tweets every 40 seconds is making us hit the rate
limit, dont do that
2017-08-29 17:44:50 +02:00
codl 007aec7529
flakes8 2017-08-29 14:46:32 +02:00
codl 2c4d6b9f63
fix issues raised by bandit 2017-08-29 13:26:32 +02:00
codl 19982af3ee
hgghn celery statsd bad 2017-08-28 17:24:02 +02:00
codl 2823f5fb76
celery statsd 2017-08-28 17:19:07 +02:00
codl 719c54b046
mastodon instances: lower max popularity to 40
100 is really high considering forget's popularity
2017-08-28 15:37:49 +02:00
codl 47ef77d0e2
ugggghhhhhh oops 2017-08-23 11:50:30 +02:00
codl 1dfb728805
add autocomplete for mastodon instances 2017-08-23 11:42:32 +02:00
codl 06f144f8b4
allow mastodon users to preserve DMs 2017-08-20 18:23:38 +02:00
codl b219f2971b
OOPS oops 2017-08-19 15:17:22 +02:00
codl 126c24db5f
be smarter about rate limits on mastodon 2017-08-19 14:18:33 +02:00
codl ff358ed64f
ahhhhhh!! mastodon support 2017-08-19 13:12:22 +02:00
codl d3d93c3cef
ghfjklghjdkflhgjfklhgjkdflshgjdflshgjkdflshgjdfklshgjkdflghjkdflhgjkldfshjgkldfhjgldhfjkgldhfjgklfdhsjgklhfjkslghjdfklsg
mastodon why
2017-08-19 13:12:22 +02:00
codl 59c278b3dc
x 2017-08-14 21:22:42 +02:00
codl 1cd5b8fa47
replace last_delete with next_delete 2017-08-14 20:58:22 +02:00
codl c54f6d0eee
tasks: ignore inaccessible accounts for fetch as well 2017-08-14 20:01:59 +02:00
codl 3ebb9476ef
oops 2017-08-13 17:39:05 +02:00
codl 4fa65aa1fe
g 2017-08-13 17:10:53 +02:00
codl 6e39874578
oops 2017-08-13 11:16:43 +02:00
codl 1a54f5052f
refresh: take the 100 most stale posts
it doesn't make sense to sample random posts anymore since i don't use
the result of that for picking a post to delete anymore
2017-08-13 11:03:29 +02:00
codl bd574920b4
refresh task: ignore accounts with no tokens 2017-08-13 10:53:29 +02:00
codl 74f20e3138
add a task to refresh the account with the longest time since a refresh 2017-08-12 23:22:22 +02:00
codl efeb5b6f41
extend /api/viewer to include various timers
also add a last_refresh field to accounts
2017-08-12 23:07:16 +02:00
codl cdff524e3d
fix 500 on tweet archive upload 2017-08-12 20:32:51 +02:00
codl 5a02d75f7c
close sqlalchemy session after a worker's work. closes #4
that was far easier than i anticipated...
2017-08-11 00:31:02 +02:00
codl 2f73ec3827
reduce tweet archive retention to 3 days from 7 2017-08-09 12:41:54 +02:00
codl 5bce4c9b17
massive optimisation on getting eligible posts
uhh the subquery is run for every single row so, with a long enough
time limit and enough posts thats. a several minute long SELECT
2017-08-09 10:25:41 +02:00
codl 1aaebc0ce2
add autoretries on all tasks that talk with twitter 2017-08-08 23:00:22 +02:00
codl 1039da665b
OOPS oops oops oops oops 2017-08-08 16:04:22 +02:00
codl ac6f7203d8
add ability to keep posts with media (close #1) 2017-08-08 15:40:56 +02:00
codl 4be6edb15f
cleanup anonymous oauth tokens 2017-08-08 04:16:57 +02:00
codl 4f40853b78
sentry: send version in tasks as well 2017-08-07 23:42:38 +02:00
codl a7f68fde9a
add sentry support to celery tasks too 2017-08-07 13:46:05 +02:00
codl fdf7148cf1
bad! 2017-08-04 16:41:12 +02:00
codl a7e414bae2
(screams) the time is nigh 2017-08-03 21:37:00 +02:00
codl 9722dbde26
ahhhhhhhhhhhhhh!!!!!!!!!!!!!!!!!!!!!!!!! posts 2017-08-03 20:01:06 +02:00
codl 1562182e33
clean up and sanitise model for release 2017-08-03 11:51:37 +02:00
codl e08a0eea13
ahhh im super good at computing 2017-08-02 01:35:09 +02:00
codl 0f80fc74a0
RESPONSIBILTIY'S COOL 2017-08-01 20:57:15 +02:00
codl aa92dbe268
prevent users from giving/taking posts from/to other users 2017-07-31 03:53:05 +02:00
codl f58f32e9aa
cleanup old twitter archives 2017-07-31 02:00:07 +02:00
codl ae4522400c
chunk imports per month 2017-07-31 01:57:03 +02:00
codl 4def0b3947
aaaaaaaa 2017-07-31 00:39:40 +02:00
codl 9053d587f3
tweet archive import 2017-07-31 00:07:34 +02:00
codl bc3def5152 make sessions last two days 2017-07-30 13:05:27 +02:00