Skip to content
New issue

Have a question about this project? # for a free GitHub account to open an issue and contact its maintainers and the community.

#

By clicking “#”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? # to your account

Jump to bottom

feat: include robots.txt to prevent search engine crawling #271

Open
adan89lion opened this issue Aug 15, 2024 · 0 comments
Open

feat: include robots.txt to prevent search engine crawling #271

adan89lion opened this issue Aug 15, 2024 · 0 comments
Labels
enhancement New feature or request good-first-issue If you want to start contributing, have a look at this smaller issue first

Comments

@adan89lion
Copy link

Is your feature request related to a problem? Please describe.
I am hosting MicroBin for personal and family use, but I am afraid that some PII/sensitive data would be leaked if robots.txt is not implemented. Sites like Wayback Machine would also archive any possible pastes.

Describe the solution you'd like
Add an environmental variable to prevent search engine indexing/web archiving crawlers.

Describe alternatives you've considered
N/A

Additional context
N/A
@szabodanika szabodanika added enhancement New feature or request good-first-issue If you want to start contributing, have a look at this smaller issue first labels Nov 2, 2024
# for free to join this conversation on GitHub. Already have an account? # to comment
Assignees
No one assigned
Labels
enhancement New feature or request good-first-issue If you want to start contributing, have a look at this smaller issue first
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
2 participants
@adan89lion @szabodanika