mirror of
https://github.com/superseriousbusiness/gotosocial.git
synced 2024-11-22 11:46:40 +00:00
[docs] Add database maintenance section; update info message on ANALYZE run (sqlite) (#2756)
* [chore] Limit size of ANALYZE run after migration (sqlite) * add basic db maintenance tips * update docs, analyze * amend info message a wee bit * update docs/admin/database_maintenance.md wording Co-authored-by: Daenney <daenney@users.noreply.github.com> --------- Co-authored-by: kim <89579420+NyaaaWhatsUpDoc@users.noreply.github.com> Co-authored-by: Daenney <daenney@users.noreply.github.com>
This commit is contained in:
parent
1fe4cdaf46
commit
9b94b1faa2
51
docs/admin/database_maintenance.md
Normal file
51
docs/admin/database_maintenance.md
Normal file
|
@ -0,0 +1,51 @@
|
||||||
|
# Database Maintenance
|
||||||
|
|
||||||
|
Regardless of whether you choose to run GoToSocial with SQLite or Postgres, you may need to occasionally take maintenance steps to keep your database running well.
|
||||||
|
|
||||||
|
!!! tip
|
||||||
|
|
||||||
|
Though the maintenance tips provided here are intended to be non-destructive, you should backup your database before manually performing maintenance. That way if you mistype something or accidentally run a bad command, you can restore your backup and try again.
|
||||||
|
|
||||||
|
!!! danger
|
||||||
|
|
||||||
|
Manually creating, deleting, or updating entries in your GoToSocial database is **heavily discouraged**, and such commands are not provided here. Even if you think you know what you are doing, running `DELETE` statements etc. may introduce issues that are very difficult to debug. The maintenance tips below are designed to help with the smooth running of your instance; they will not save your ass if you have manually gone into your database and hacked at entries, tables, and indexes.
|
||||||
|
|
||||||
|
## SQLite
|
||||||
|
|
||||||
|
To do manual SQLite maintenance, you should first install the SQLite command line tool `sqlite3` on the same machine that your GoToSocial sqlite.db file is stored on. See [here](https://sqlite.org/cli.html) for details about `sqlite3`.
|
||||||
|
|
||||||
|
### Analyze / Optimize
|
||||||
|
|
||||||
|
Following [SQLite best practice](https://sqlite.org/lang_analyze.html#recommended_usage_pattern), GoToSocial runs the `optimize` SQLite pragma with `analysis_limit=1000` on closing database connections to keep index information up to date.
|
||||||
|
|
||||||
|
After each set of database migrations (eg., when starting a newer version of GoToSocial), GoToSocial will run `ANALYZE` to ensure that any indexes added or removed by migrations are taken into account correctly by the query planner.
|
||||||
|
|
||||||
|
The `ANALYZE` command may take ~10 minutes depending on your hardware and the size of your database file.
|
||||||
|
|
||||||
|
Because of the above automated steps, in normal circumstances you should not need to run manual `ANALYZE` commands against your SQLite database file.
|
||||||
|
|
||||||
|
However, if you interrupted a previous `ANALYZE` command, and you notice that queries are running remarkably slowly, it could be the case that the index metadata stored in SQLite's internal tables has been removed or undesirably altered.
|
||||||
|
|
||||||
|
If this is the case, you can try manually running a full `ANALYZE` command, by doing the following:
|
||||||
|
|
||||||
|
1. Stop GoToSocial.
|
||||||
|
2. While connected to your GoToSocial database file in the `sqlite3` shell, run `PRAGMA analysis_limit=0; ANALYZE;` (this may take quite a few minutes).
|
||||||
|
3. Start GoToSocial.
|
||||||
|
|
||||||
|
[See here](https://sqlite.org/lang_analyze.html#approximate_analyze_for_large_databases) for more info.
|
||||||
|
|
||||||
|
### Vacuum
|
||||||
|
|
||||||
|
GoToSocial does not currently enable auto-vacuum for SQLite. To repack the database file to an optimal size you may want to run a `VACUUM` command on your SQLite database periodically (eg., every few months).
|
||||||
|
|
||||||
|
You can see lots of information about the `VACUUM` command [here](https://sqlite.org/lang_vacuum.html).
|
||||||
|
|
||||||
|
The basic steps are:
|
||||||
|
|
||||||
|
1. Stop GoToSocial.
|
||||||
|
2. While connected to your GoToSocial database file in the `sqlite3` shell, run `VACUUM;` (this may take quite a few minutes).
|
||||||
|
3. Start GoToSocial.
|
||||||
|
|
||||||
|
## Postgres
|
||||||
|
|
||||||
|
TODO: Maintenance recommendations for Postgres.
|
|
@ -112,7 +112,10 @@ func doMigration(ctx context.Context, db *bun.DB) error {
|
||||||
log.Infof(ctx, "MIGRATED DATABASE TO %s", group)
|
log.Infof(ctx, "MIGRATED DATABASE TO %s", group)
|
||||||
|
|
||||||
if db.Dialect().Name() == dialect.SQLite {
|
if db.Dialect().Name() == dialect.SQLite {
|
||||||
log.Info(ctx, "running ANALYZE to update table and index statistics")
|
log.Info(ctx,
|
||||||
|
"running ANALYZE to update table and index statistics; this will take somewhere between "+
|
||||||
|
"1-10 minutes, or maybe longer depending on your hardware and database size, please be patient",
|
||||||
|
)
|
||||||
_, err := db.ExecContext(ctx, "ANALYZE")
|
_, err := db.ExecContext(ctx, "ANALYZE")
|
||||||
if err != nil {
|
if err != nil {
|
||||||
log.Warnf(ctx, "ANALYZE failed, query planner may make poor life choices: %s", err)
|
log.Warnf(ctx, "ANALYZE failed, query planner may make poor life choices: %s", err)
|
||||||
|
|
|
@ -119,6 +119,7 @@ nav:
|
||||||
- "admin/backup_and_restore.md"
|
- "admin/backup_and_restore.md"
|
||||||
- "admin/media_caching.md"
|
- "admin/media_caching.md"
|
||||||
- "admin/spam.md"
|
- "admin/spam.md"
|
||||||
|
- "admin/database_maintenance.md"
|
||||||
- "Federation":
|
- "Federation":
|
||||||
- "federation/index.md"
|
- "federation/index.md"
|
||||||
- "federation/glossary.md"
|
- "federation/glossary.md"
|
||||||
|
|
Loading…
Reference in a new issue