Page MenuHomePhabricator

Add a robots.txt file to disallow /diffusion/
ClosedPublic

Authored by epriestley on Mar 14 2014, 2:23 PM.
Tags
None
Referenced Files
F12848235: D8532.id.diff
Fri, Mar 29, 3:23 AM
Unknown Object (File)
Feb 3 2024, 4:20 PM
Unknown Object (File)
Feb 2 2024, 11:06 PM
Unknown Object (File)
Jan 24 2024, 8:04 PM
Unknown Object (File)
Jan 24 2024, 8:04 PM
Unknown Object (File)
Jan 24 2024, 8:04 PM
Unknown Object (File)
Jan 22 2024, 10:40 AM
Unknown Object (File)
Jan 20 2024, 3:33 AM
Subscribers

Details

Summary

Fixes T4610. Open to suggestions, etc., if there's anything I'm missing.

Also:

  • Moves these "system" endpoints into a real application.
  • Makes isUnlisted() work a little more consistently.
Test Plan

Accessed /robots.txt, /status/ and /debug/.

Diff Detail

Repository
rP Phabricator
Lint
Lint Skipped
Unit
Tests Skipped

Event Timeline

epriestley retitled this revision from to Add a robots.txt file to disallow /diffusion/.
epriestley updated this object.
epriestley edited the test plan for this revision. (Show Details)
epriestley added reviewers: btrahan, chad.
btrahan edited edge metadata.

Makes sense to me.

I think diffusion being in SEO is really for cases where diviner should be in SEO. (i.e. code documentation, which should be getting pulled into diviner automagically.) We'll get there.

This revision is now accepted and ready to land.Mar 14 2014, 5:43 PM
epriestley updated this revision to Diff 20255.

Closed by commit rP838f78128544 (authored by @epriestley).