Page MenuHomePhabricator

Add a robots.txt file to disallow /diffusion/
ClosedPublic

Authored by epriestley on Mar 14 2014, 2:23 PM.
Tags
None
Referenced Files
F15458641: D8532.id20241.diff
Mon, Mar 31, 5:50 AM
F15422213: D8532.id20255.diff
Mar 22 2025, 6:41 AM
F15422212: D8532.id.diff
Mar 22 2025, 6:41 AM
F15422211: D8532.id20241.diff
Mar 22 2025, 6:41 AM
F15421824: D8532.diff
Mar 22 2025, 2:26 AM
F15385909: D8532.id.diff
Mar 14 2025, 11:38 PM
Unknown Object (File)
Feb 14 2025, 10:57 PM
Unknown Object (File)
Feb 14 2025, 10:57 PM
Subscribers

Details

Summary

Fixes T4610. Open to suggestions, etc., if there's anything I'm missing.

Also:

  • Moves these "system" endpoints into a real application.
  • Makes isUnlisted() work a little more consistently.
Test Plan

Accessed /robots.txt, /status/ and /debug/.

Diff Detail

Repository
rP Phabricator
Lint
Lint Skipped
Unit
Tests Skipped

Event Timeline

epriestley retitled this revision from to Add a robots.txt file to disallow /diffusion/.
epriestley updated this object.
epriestley edited the test plan for this revision. (Show Details)
epriestley added reviewers: btrahan, chad.
btrahan edited edge metadata.

Makes sense to me.

I think diffusion being in SEO is really for cases where diviner should be in SEO. (i.e. code documentation, which should be getting pulled into diviner automagically.) We'll get there.

This revision is now accepted and ready to land.Mar 14 2014, 5:43 PM
epriestley updated this revision to Diff 20255.

Closed by commit rP838f78128544 (authored by @epriestley).