Page MenuHomePhabricator

Add a robots.txt file to disallow /diffusion/
ClosedPublic

Authored by epriestley on Mar 14 2014, 2:23 PM.
Tags
None
Referenced Files
F14008137: D8532.diff
Tue, Oct 29, 4:14 PM
F13988117: D8532.id20255.diff
Mon, Oct 21, 1:16 PM
F13975036: D8532.id20241.diff
Oct 18 2024, 8:25 AM
F13960891: D8532.id.diff
Oct 15 2024, 1:58 AM
Unknown Object (File)
Oct 11 2024, 4:44 PM
Unknown Object (File)
Oct 9 2024, 3:39 PM
Unknown Object (File)
Sep 14 2024, 7:13 PM
Unknown Object (File)
Sep 14 2024, 7:12 PM
Subscribers

Details

Summary

Fixes T4610. Open to suggestions, etc., if there's anything I'm missing.

Also:

  • Moves these "system" endpoints into a real application.
  • Makes isUnlisted() work a little more consistently.
Test Plan

Accessed /robots.txt, /status/ and /debug/.

Diff Detail

Repository
rP Phabricator
Lint
Lint Skipped
Unit
Tests Skipped

Event Timeline

epriestley retitled this revision from to Add a robots.txt file to disallow /diffusion/.
epriestley updated this object.
epriestley edited the test plan for this revision. (Show Details)
epriestley added reviewers: btrahan, chad.
btrahan edited edge metadata.

Makes sense to me.

I think diffusion being in SEO is really for cases where diviner should be in SEO. (i.e. code documentation, which should be getting pulled into diviner automagically.) We'll get there.

This revision is now accepted and ready to land.Mar 14 2014, 5:43 PM
epriestley updated this revision to Diff 20255.

Closed by commit rP838f78128544 (authored by @epriestley).