Daenney 0cce2c0838 [feature] Block a bunch of "AI" crawlers (#2239) ... * [feature] Block Google Bard/AI crawlers * [feature] Block the other OpenAI crawler * [feature] Block Common Crawl crawler This is used in research, but also gleefully advertises itself as the training source used in all LLMs and GPT-3. Fixes: #2240 * [feature] Block Omgilikebot Used by some shady big web data engine company. * [feature] Block Meta's language model crawler * [feature] Block well-known.dev crawler		2023-09-30 20:44:57 +01:00
..
about.go
assets.go
base.go
confirmemail.go
customcss.go
domain-blocklist.go
etag.go	[feature] simpler cache size configuration (#2051)	2023-08-03 11:34:35 +02:00
opengraph.go	[bugfix] Use custom bluemonday policy to disallow inline img tags (#2100)	2023-08-11 14:40:11 +02:00
opengraph_test.go
profile.go
robots.go	[feature] Block a bunch of "AI" crawlers (#2239)	2023-09-30 20:44:57 +01:00
rss.go	[bugfix] Tidy up rss feed serving; don't error on empty feed (#1970)	2023-07-10 17:05:59 +02:00
settings-panel.go
tag.go	[feature] Hashtag federation (in/out), hashtag client API endpoints (#2032)	2023-07-31 15:47:35 +02:00
thread.go
web.go	[feature] Hashtag federation (in/out), hashtag client API endpoints (#2032)	2023-07-31 15:47:35 +02:00