mirror of
https://github.com/superseriousbusiness/gotosocial.git
synced 2024-11-26 21:56:39 +00:00
a156188b3e
* update dependencies, bump Go version to 1.19 * bump test image Go version * update golangci-lint * update gotosocial-drone-build * sign * linting, go fmt * update swagger docs * update swagger docs * whitespace * update contributing.md * fuckin whoopsie doopsie * linterino, linteroni * fix followrequest test not starting processor * fix other api/client tests not starting processor * fix remaining tests where processor not started * bump go-runners version * don't check last-webfingered-at, processor may have updated this * update swagger command * update bun to latest version * fix embed to work the same as before with new bun Signed-off-by: kim <grufwub@gmail.com> Co-authored-by: tsmethurst <tobi.smethurst@protonmail.com>
197 lines
8.6 KiB
Markdown
197 lines
8.6 KiB
Markdown
[![](https://godoc.org/github.com/jackc/pgx?status.svg)](https://pkg.go.dev/github.com/jackc/pgx/v4)
|
|
[![Build Status](https://travis-ci.org/jackc/pgx.svg)](https://travis-ci.org/jackc/pgx)
|
|
|
|
---
|
|
|
|
This is the stable `v4` release. `v5` is now in beta testing with final release expected in September. See https://github.com/jackc/pgx/issues/1273 for more information. Please consider testing `v5`.
|
|
|
|
---
|
|
# pgx - PostgreSQL Driver and Toolkit
|
|
|
|
pgx is a pure Go driver and toolkit for PostgreSQL.
|
|
|
|
pgx aims to be low-level, fast, and performant, while also enabling PostgreSQL-specific features that the standard `database/sql` package does not allow for.
|
|
|
|
The driver component of pgx can be used alongside the standard `database/sql` package.
|
|
|
|
The toolkit component is a related set of packages that implement PostgreSQL functionality such as parsing the wire protocol
|
|
and type mapping between PostgreSQL and Go. These underlying packages can be used to implement alternative drivers,
|
|
proxies, load balancers, logical replication clients, etc.
|
|
|
|
The current release of `pgx v4` requires Go modules. To use the previous version, checkout and vendor the `v3` branch.
|
|
|
|
## Example Usage
|
|
|
|
```go
|
|
package main
|
|
|
|
import (
|
|
"context"
|
|
"fmt"
|
|
"os"
|
|
|
|
"github.com/jackc/pgx/v4"
|
|
)
|
|
|
|
func main() {
|
|
// urlExample := "postgres://username:password@localhost:5432/database_name"
|
|
conn, err := pgx.Connect(context.Background(), os.Getenv("DATABASE_URL"))
|
|
if err != nil {
|
|
fmt.Fprintf(os.Stderr, "Unable to connect to database: %v\n", err)
|
|
os.Exit(1)
|
|
}
|
|
defer conn.Close(context.Background())
|
|
|
|
var name string
|
|
var weight int64
|
|
err = conn.QueryRow(context.Background(), "select name, weight from widgets where id=$1", 42).Scan(&name, &weight)
|
|
if err != nil {
|
|
fmt.Fprintf(os.Stderr, "QueryRow failed: %v\n", err)
|
|
os.Exit(1)
|
|
}
|
|
|
|
fmt.Println(name, weight)
|
|
}
|
|
```
|
|
|
|
See the [getting started guide](https://github.com/jackc/pgx/wiki/Getting-started-with-pgx) for more information.
|
|
|
|
## Choosing Between the pgx and database/sql Interfaces
|
|
|
|
It is recommended to use the pgx interface if:
|
|
1. The application only targets PostgreSQL.
|
|
2. No other libraries that require `database/sql` are in use.
|
|
|
|
The pgx interface is faster and exposes more features.
|
|
|
|
The `database/sql` interface only allows the underlying driver to return or receive the following types: `int64`,
|
|
`float64`, `bool`, `[]byte`, `string`, `time.Time`, or `nil`. Handling other types requires implementing the
|
|
`database/sql.Scanner` and the `database/sql/driver/driver.Valuer` interfaces which require transmission of values in text format. The binary format can be substantially faster, which is what the pgx interface uses.
|
|
|
|
## Features
|
|
|
|
pgx supports many features beyond what is available through `database/sql`:
|
|
|
|
* Support for approximately 70 different PostgreSQL types
|
|
* Automatic statement preparation and caching
|
|
* Batch queries
|
|
* Single-round trip query mode
|
|
* Full TLS connection control
|
|
* Binary format support for custom types (allows for much quicker encoding/decoding)
|
|
* COPY protocol support for faster bulk data loads
|
|
* Extendable logging support including built-in support for `log15adapter`, [`logrus`](https://github.com/sirupsen/logrus), [`zap`](https://github.com/uber-go/zap), and [`zerolog`](https://github.com/rs/zerolog)
|
|
* Connection pool with after-connect hook for arbitrary connection setup
|
|
* Listen / notify
|
|
* Conversion of PostgreSQL arrays to Go slice mappings for integers, floats, and strings
|
|
* Hstore support
|
|
* JSON and JSONB support
|
|
* Maps `inet` and `cidr` PostgreSQL types to `net.IPNet` and `net.IP`
|
|
* Large object support
|
|
* NULL mapping to Null* struct or pointer to pointer
|
|
* Supports `database/sql.Scanner` and `database/sql/driver.Valuer` interfaces for custom types
|
|
* Notice response handling
|
|
* Simulated nested transactions with savepoints
|
|
|
|
## Performance
|
|
|
|
There are three areas in particular where pgx can provide a significant performance advantage over the standard
|
|
`database/sql` interface and other drivers:
|
|
|
|
1. PostgreSQL specific types - Types such as arrays can be parsed much quicker because pgx uses the binary format.
|
|
2. Automatic statement preparation and caching - pgx will prepare and cache statements by default. This can provide an
|
|
significant free improvement to code that does not explicitly use prepared statements. Under certain workloads, it can
|
|
perform nearly 3x the number of queries per second.
|
|
3. Batched queries - Multiple queries can be batched together to minimize network round trips.
|
|
|
|
## Testing
|
|
|
|
pgx tests naturally require a PostgreSQL database. It will connect to the database specified in the `PGX_TEST_DATABASE` environment
|
|
variable. The `PGX_TEST_DATABASE` environment variable can either be a URL or DSN. In addition, the standard `PG*` environment
|
|
variables will be respected. Consider using [direnv](https://github.com/direnv/direnv) to simplify environment variable
|
|
handling.
|
|
|
|
### Example Test Environment
|
|
|
|
Connect to your PostgreSQL server and run:
|
|
|
|
```
|
|
create database pgx_test;
|
|
```
|
|
|
|
Connect to the newly-created database and run:
|
|
|
|
```
|
|
create domain uint64 as numeric(20,0);
|
|
```
|
|
|
|
Now, you can run the tests:
|
|
|
|
```
|
|
PGX_TEST_DATABASE="host=/var/run/postgresql database=pgx_test" go test ./...
|
|
```
|
|
|
|
In addition, there are tests specific for PgBouncer that will be executed if `PGX_TEST_PGBOUNCER_CONN_STRING` is set.
|
|
|
|
## Supported Go and PostgreSQL Versions
|
|
|
|
pgx supports the same versions of Go and PostgreSQL that are supported by their respective teams. For [Go](https://golang.org/doc/devel/release.html#policy) that is the two most recent major releases and for [PostgreSQL](https://www.postgresql.org/support/versioning/) the major releases in the last 5 years. This means pgx supports Go 1.16 and higher and PostgreSQL 10 and higher. pgx also is tested against the latest version of [CockroachDB](https://www.cockroachlabs.com/product/).
|
|
|
|
## Version Policy
|
|
|
|
pgx follows semantic versioning for the documented public API on stable releases. `v4` is the latest stable major version.
|
|
|
|
## PGX Family Libraries
|
|
|
|
pgx is the head of a family of PostgreSQL libraries. Many of these can be used independently. Many can also be accessed
|
|
from pgx for lower-level control.
|
|
|
|
### [github.com/jackc/pgconn](https://github.com/jackc/pgconn)
|
|
|
|
`pgconn` is a lower-level PostgreSQL database driver that operates at nearly the same level as the C library `libpq`.
|
|
|
|
### [github.com/jackc/pgx/v4/pgxpool](https://github.com/jackc/pgx/tree/master/pgxpool)
|
|
|
|
`pgxpool` is a connection pool for pgx. pgx is entirely decoupled from its default pool implementation. This means that pgx can be used with a different pool or without any pool at all.
|
|
|
|
### [github.com/jackc/pgx/v4/stdlib](https://github.com/jackc/pgx/tree/master/stdlib)
|
|
|
|
This is a `database/sql` compatibility layer for pgx. pgx can be used as a normal `database/sql` driver, but at any time, the native interface can be acquired for more performance or PostgreSQL specific functionality.
|
|
|
|
### [github.com/jackc/pgtype](https://github.com/jackc/pgtype)
|
|
|
|
Over 70 PostgreSQL types are supported including `uuid`, `hstore`, `json`, `bytea`, `numeric`, `interval`, `inet`, and arrays. These types support `database/sql` interfaces and are usable outside of pgx. They are fully tested in pgx and pq. They also support a higher performance interface when used with the pgx driver.
|
|
|
|
### [github.com/jackc/pgproto3](https://github.com/jackc/pgproto3)
|
|
|
|
pgproto3 provides standalone encoding and decoding of the PostgreSQL v3 wire protocol. This is useful for implementing very low level PostgreSQL tooling.
|
|
|
|
### [github.com/jackc/pglogrepl](https://github.com/jackc/pglogrepl)
|
|
|
|
pglogrepl provides functionality to act as a client for PostgreSQL logical replication.
|
|
|
|
### [github.com/jackc/pgmock](https://github.com/jackc/pgmock)
|
|
|
|
pgmock offers the ability to create a server that mocks the PostgreSQL wire protocol. This is used internally to test pgx by purposely inducing unusual errors. pgproto3 and pgmock together provide most of the foundational tooling required to implement a PostgreSQL proxy or MitM (such as for a custom connection pooler).
|
|
|
|
### [github.com/jackc/tern](https://github.com/jackc/tern)
|
|
|
|
tern is a stand-alone SQL migration system.
|
|
|
|
### [github.com/jackc/pgerrcode](https://github.com/jackc/pgerrcode)
|
|
|
|
pgerrcode contains constants for the PostgreSQL error codes.
|
|
|
|
## 3rd Party Libraries with PGX Support
|
|
|
|
### [github.com/georgysavva/scany](https://github.com/georgysavva/scany)
|
|
|
|
Library for scanning data from a database into Go structs and more.
|
|
|
|
### [https://github.com/otan/gopgkrb5](https://github.com/otan/gopgkrb5)
|
|
|
|
Adds GSSAPI / Kerberos authentication support.
|
|
|
|
### [https://github.com/vgarvardt/pgx-google-uuid](https://github.com/vgarvardt/pgx-google-uuid)
|
|
|
|
Adds support for [`github.com/google/uuid`](https://github.com/google/uuid).
|