Page MenuHomePhabricator

Disallow /source/ in robots.txt
ClosedPublic

Authored by epriestley on Apr 6 2017, 10:53 PM.
Tags
None
Referenced Files
Unknown Object (File)
Mon, Sep 14, 3:18 AM
Unknown Object (File)
Sep 2 2026, 7:28 AM
Unknown Object (File)
Aug 24 2026, 7:01 AM
Unknown Object (File)
Jul 30 2026, 3:18 AM
Unknown Object (File)
Jul 1 2026, 2:42 PM
Unknown Object (File)
Jun 8 2026, 7:36 AM
Unknown Object (File)
Apr 16 2026, 3:09 PM
Unknown Object (File)
Apr 16 2026, 1:03 AM
Subscribers
None

Details

Summary

Ref T4245. We disallow /diffusion/ in robots.txt already because indexers tend to get lost blaming every line of every file throughout history, but didn't update the list for the /source/ alias. Update it.

Test Plan

Visited /robots.txt locally.

Diff Detail

Repository
rP Phabricator
Lint
Lint Not Applicable
Unit
Tests Not Applicable

Event Timeline

This revision is now accepted and ready to land.Apr 6 2017, 11:19 PM
This revision was automatically updated to reflect the committed changes.