Page MenuHomePhabricator

Disallow /source/ in robots.txt
ClosedPublic

Authored by epriestley on Apr 6 2017, 10:53 PM.
Tags
None
Referenced Files
F15502872: D17637.id42418.diff
Mon, Apr 14, 5:09 AM
F15422049: D17637.id.diff
Mar 22 2025, 5:00 AM
F15420711: D17637.id42419.diff
Mar 21 2025, 4:15 PM
F15419224: D17637.id42418.diff
Mar 21 2025, 4:35 AM
F15410783: D17637.id.diff
Mar 19 2025, 8:25 AM
F15405059: D17637.diff
Mar 18 2025, 10:09 AM
F15388818: D17637.diff
Mar 15 2025, 4:26 AM
Unknown Object (File)
Feb 21 2025, 3:19 PM
Subscribers
None

Details

Summary

Ref T4245. We disallow /diffusion/ in robots.txt already because indexers tend to get lost blaming every line of every file throughout history, but didn't update the list for the /source/ alias. Update it.

Test Plan

Visited /robots.txt locally.

Diff Detail

Repository
rP Phabricator
Lint
Lint Not Applicable
Unit
Tests Not Applicable

Event Timeline

This revision is now accepted and ready to land.Apr 6 2017, 11:19 PM
This revision was automatically updated to reflect the committed changes.