gotosocial/internal
kim acc95923da
[performance] processing media and scheduled jobs improvements (#1482)
* replace media workers with just runners.WorkerPool, move to state structure, use go-sched for global task scheduling

* improved code comment

* fix worker tryUntil function, update go-runners/go-sched

* make preprocess functions package public, use these where possible to stop doubled up processing

* remove separate emoji worker pool

* limit calls to time.Now() during media preprocessing

* use Processor{} to manage singular runtime of processing media

* ensure workers get started when media manager is used

* improved error setting in processing media, fix media test

* port changes from processingmedia to processing emoji

* finish code commenting

* finish code commenting and comment-out client API + federator worker pools until concurrency worker pools replaced

* linterrrrrrrrrrrrrrrr

---------

Signed-off-by: kim <grufwub@gmail.com>
2023-02-13 18:40:48 +00:00
..
ap [bugfix] Read Bookwyrm Articles more thoroughly (#1410) 2023-02-02 16:41:02 +01:00
api [chore] Do cache-control in a less silly way to avoid writing header twice (#1481) 2023-02-13 12:58:22 +01:00
cache fix cache startup (#1414) 2023-02-03 20:16:11 +00:00
concurrency [chore] Update/add license headers for 2023 (#1304) 2023-01-05 12:43:00 +01:00
config [chore/performance] Update media prune logic, add extra CLI command (#1474) 2023-02-11 12:48:38 +01:00
db [chore/performance] Update media prune logic, add extra CLI command (#1474) 2023-02-11 12:48:38 +01:00
email [chore] Update/add license headers for 2023 (#1304) 2023-01-05 12:43:00 +01:00
federation [performance] processing media and scheduled jobs improvements (#1482) 2023-02-13 18:40:48 +00:00
gotosocial [performance] processing media and scheduled jobs improvements (#1482) 2023-02-13 18:40:48 +00:00
gtserror [chore] Update/add license headers for 2023 (#1304) 2023-01-05 12:43:00 +01:00
gtsmodel [chore] reformat GetAccount() functionality, support updating accounts based on last_fetch (#1411) 2023-02-03 20:03:05 +00:00
httpclient [chore] Update/add license headers for 2023 (#1304) 2023-01-05 12:43:00 +01:00
id [chore] reformat GetAccount() functionality, support updating accounts based on last_fetch (#1411) 2023-02-03 20:03:05 +00:00
iotools [bugfix] Parse video metadata more accurately; allow Range in fileserver (#1342) 2023-01-16 16:19:17 +01:00
log [chore] Update/add license headers for 2023 (#1304) 2023-01-05 12:43:00 +01:00
media [performance] processing media and scheduled jobs improvements (#1482) 2023-02-13 18:40:48 +00:00
messages [chore] Update/add license headers for 2023 (#1304) 2023-01-05 12:43:00 +01:00
middleware [performance] remove throttling timers (#1466) 2023-02-10 20:16:01 +00:00
netutil [chore] Update/add license headers for 2023 (#1304) 2023-01-05 12:43:00 +01:00
oauth [chore] Update/add license headers for 2023 (#1304) 2023-01-05 12:43:00 +01:00
oidc [chore] Update/add license headers for 2023 (#1304) 2023-01-05 12:43:00 +01:00
processing [performance] processing media and scheduled jobs improvements (#1482) 2023-02-13 18:40:48 +00:00
regexes [feature] Federate reports to remote instance as Flag (if desired) (#1386) 2023-01-27 14:48:11 +01:00
router [performance] processing media and scheduled jobs improvements (#1482) 2023-02-13 18:40:48 +00:00
state [performance] processing media and scheduled jobs improvements (#1482) 2023-02-13 18:40:48 +00:00
storage [performance] media processing improvements (#1288) 2023-01-11 12:13:13 +01:00
stream [chore] Update/add license headers for 2023 (#1304) 2023-01-05 12:43:00 +01:00
text [chore] Text formatting overhaul (#1406) 2023-02-03 11:58:58 +01:00
timeline [chore] Update/add license headers for 2023 (#1304) 2023-01-05 12:43:00 +01:00
trans [chore] reformat GetAccount() functionality, support updating accounts based on last_fetch (#1411) 2023-02-03 20:03:05 +00:00
transport [performance] remove throttling timers (#1466) 2023-02-10 20:16:01 +00:00
typeutils [chore] reformat GetAccount() functionality, support updating accounts based on last_fetch (#1411) 2023-02-03 20:03:05 +00:00
uris [feature] Implement Report database model and utility functions (#1310) 2023-01-10 14:19:05 +00:00
util [chore] Text formatting overhaul (#1406) 2023-02-03 11:58:58 +01:00
validate [chore] reformat GetAccount() functionality, support updating accounts based on last_fetch (#1411) 2023-02-03 20:03:05 +00:00
visibility [chore] Update/add license headers for 2023 (#1304) 2023-01-05 12:43:00 +01:00
web [bugfix] Use SignatureCheck middleware for web profile endpoints too (#1451) 2023-02-07 14:57:09 +01:00
workers [performance] processing media and scheduled jobs improvements (#1482) 2023-02-13 18:40:48 +00:00