GoToSocial/internal
kim a483bd9e38
[performance] massively improved ActivityPub delivery worker efficiency (#2812)
* add delivery worker type that pulls from queue to httpclient package

* finish up some code commenting, bodge a vendored activity library change, integrate the deliverypool changes into transportcontroller

* hook up queue deletion logic

* support deleting queued http requests by target ID

* don't index APRequest by hostname in the queue

* use gorun

* use the original context's values when wrapping msg type as delivery{}

* actually log in the AP delivery worker ...

* add uncommitted changes

* use errors.AsV2()

* use errorsv2.AsV2()

* finish adding some code comments, add bad host handling to delivery workers

* slightly tweak deliveryworkerpool API, use advanced sender multiplier

* remove PopCtx() method, let others instead rely on Wait()

* shuffle things around to move delivery stuff into transport/ subpkg

* remove dead code

* formatting

* validate request before queueing for delivery

* finish adding code comments, fix up backoff code

* finish adding more code comments

* clamp minimum no. senders to 1

* add start/stop logging to delivery worker, some slight changes

* remove double logging

* use worker ptrs

* expose the embedded log fields in httpclient.Request{}

* ensure request context values are preserved when updating ctx

* add delivery worker tests

* fix linter issues

* ensure delivery worker gets inited in testrig

* fix tests to delivering messages to check worker delivery queue

* update error type to use ptr instead of value receiver

* fix test calling Workers{}.Start() instead of testrig.StartWorkers()

* update docs for advanced-sender-multiplier

* update to the latest activity library version

* add comment about not using httptest.Server{}
2024-04-11 11:45:35 +02:00
..
ap [chore] Try to parse public key as both Actor + bare key (#2710) 2024-04-02 11:30:10 +01:00
api [performance] massively improved ActivityPub delivery worker efficiency (#2812) 2024-04-11 11:45:35 +02:00
cache [performance] massively improved ActivityPub delivery worker efficiency (#2812) 2024-04-11 11:45:35 +02:00
cleaner [feature] Add experimental `instance-federation-spam-filter` option (#2685) 2024-02-27 12:22:05 +00:00
config [chore] Move local account settings to separate db table (#2770) 2024-03-22 14:03:46 +01:00
db [bugfix] Sort follows chronologically (#2801) 2024-04-03 14:06:39 +01:00
email [bugfix] return 400 Bad Request on more cases of malformed AS data (#2399) 2023-11-30 16:22:34 +00:00
federation [performance] massively improved ActivityPub delivery worker efficiency (#2812) 2024-04-11 11:45:35 +02:00
filter [feature] Add experimental `instance-federation-spam-filter` option (#2685) 2024-02-27 12:22:05 +00:00
gotosocial [feature/performance] Wrap incoming HTTP requests in timeout handler (#2353) 2023-11-13 19:48:51 +01:00
gtscontext [bugfix] httpclient not signing subsequent redirect requests (#2798) 2024-04-02 13:12:26 +02:00
gtserror [bugfix] check remote status permissibility (#2703) 2024-03-04 12:30:12 +00:00
gtsmodel [feature] User-selectable preset CSS themes for accounts (#2777) 2024-03-25 17:32:24 +00:00
headerfilter [feature] request blocking by http headers (#2409) 2023-12-18 14:18:25 +00:00
httpclient [performance] massively improved ActivityPub delivery worker efficiency (#2812) 2024-04-11 11:45:35 +02:00
id [chore] Improve copyright header handling (#1608) 2023-03-12 16:00:57 +01:00
iotools [chore] Improve copyright header handling (#1608) 2023-03-12 16:00:57 +01:00
language [feature] Set/show instance language(s); show post language on frontend (#2362) 2023-11-17 11:35:28 +01:00
log [chore] Log less output on failed test (#2804) 2024-04-04 16:42:42 +01:00
media [performance] massively improved ActivityPub delivery worker efficiency (#2812) 2024-04-11 11:45:35 +02:00
messages [feature] Process incoming `Move` activity (#2724) 2024-03-12 14:34:08 +00:00
metrics [chore] Update usage of OTEL libraries (#2725) 2024-03-11 15:34:34 +01:00
middleware [feature] Try HTTP signature validation with and without query params for incoming requests (#2591) 2024-01-31 14:15:28 +00:00
oauth [chore] Refactor HTML templates and CSS (#2480) 2023-12-27 11:23:52 +01:00
oidc [chore] Improve copyright header handling (#1608) 2023-03-12 16:00:57 +01:00
paging [bugfix] self-referencing collection pages for status replies (#2364) 2023-11-20 12:22:28 +00:00
processing [performance] massively improved ActivityPub delivery worker efficiency (#2812) 2024-04-11 11:45:35 +02:00
queue [performance] massively improved ActivityPub delivery worker efficiency (#2812) 2024-04-11 11:45:35 +02:00
regexes [bugfix] use start + end line in regex when validating emoji via API (#2671) 2024-02-20 11:46:04 +01:00
router [chore] Refactor HTML templates and CSS (#2480) 2023-12-27 11:23:52 +01:00
scheduler [feature] add support for polls + receiving federated status edits (#2330) 2023-11-08 14:32:17 +00:00
state [feature] Process outgoing Move from clientAPI (#2750) 2024-03-13 13:53:29 +01:00
storage [feature/bugfix] Probe S3 storage for CSP uri, add config flag for extra URIs (#2134) 2023-08-20 13:35:55 +02:00
stream [bugfix] fix possible mutex lockup during streaming code (#2633) 2024-02-20 18:07:49 +00:00
text [bugfix] Parse links that contain non-ascii characters (#2762) 2024-03-15 17:26:53 +00:00
timeline [chore] Try to parse public key as both Actor + bare key (#2710) 2024-04-02 11:30:10 +01:00
tracing [chore] Update usage of OTEL libraries (#2725) 2024-03-11 15:34:34 +01:00
trans [chore] Move local account settings to separate db table (#2770) 2024-03-22 14:03:46 +01:00
transport [performance] massively improved ActivityPub delivery worker efficiency (#2812) 2024-04-11 11:45:35 +02:00
typeutils [chore] Try to parse public key as both Actor + bare key (#2710) 2024-04-02 11:30:10 +01:00
uris [feature] Process outgoing Move from clientAPI (#2750) 2024-03-13 13:53:29 +01:00
util [chore] Move `DoOnce` func wrapper to util (#2613) 2024-02-09 11:38:51 +00:00
validate [chore] Different error message for net/mail parsing on go 1.21.8 and above (#2760) 2024-03-15 11:36:43 +01:00
web [feature] User-selectable preset CSS themes for accounts (#2777) 2024-03-25 17:32:24 +00:00
workers [performance] massively improved ActivityPub delivery worker efficiency (#2812) 2024-04-11 11:45:35 +02:00