alemi.dev d0de3ad492
[bug] respect X-Robots-Tag and robots.txt on api/v1/instance and nodeinfo (#3756)
* feat: check X-Robots-Tag

when accessing /api/v1/instance or /nodeinfo endpoints respect
X-Robots-Tag

* chore: go fmt ./...

* Check robots.txt as well, add tests

---------

Co-authored-by: tobi <tobi.smethurst@protonmail.com>
2025-02-11 13:16:14 +01:00
..
2021-08-12 21:03:24 +02:00
2021-08-12 21:03:24 +02:00
2021-11-27 15:26:58 +01:00
2021-08-12 21:03:24 +02:00
2021-08-12 21:03:24 +02:00
2021-08-12 21:03:24 +02:00