Fixes T4610. Open to suggestions, etc., if there's anything I'm missing.
Also:
- Moves these "system" endpoints into a real application.
- Makes isUnlisted() work a little more consistently.
Details
Details
- Reviewers
btrahan chad - Maniphest Tasks
- T4610: Implement robots.txt
- Commits
- Restricted Diffusion Commit
rP838f78128544: Add a robots.txt file to disallow /diffusion/
Accessed /robots.txt, /status/ and /debug/.
Diff Detail
Diff Detail
- Repository
- rP Phabricator
- Branch
- robotstxt
- Lint
Lint Passed - Unit
Tests Passed
Event Timeline
Comment Actions
Makes sense to me.
I think diffusion being in SEO is really for cases where diviner should be in SEO. (i.e. code documentation, which should be getting pulled into diviner automagically.) We'll get there.