Page MenuHomePhabricator

Disallow /source/ in robots.txt
ClosedPublic

Authored by epriestley on Apr 6 2017, 10:53 PM.
Tags
None
Referenced Files
F19942165: D17637.id42418.diff
Wed, Apr 15, 4:29 PM
F19913707: D17637.id42419.diff
Fri, Apr 3, 5:04 AM
F19911859: D17637.diff
Thu, Apr 2, 3:31 PM
F19907061: D17637.diff
Wed, Apr 1, 7:35 AM
F19907059: D17637.diff
Wed, Apr 1, 7:34 AM
F19872212: D17637.diff
Mar 15 2026, 12:35 PM
F19869117: D17637.id42419.diff
Mar 15 2026, 5:11 AM
F19868700: D17637.diff
Mar 15 2026, 3:36 AM
Subscribers
None

Details

Summary

Ref T4245. We disallow /diffusion/ in robots.txt already because indexers tend to get lost blaming every line of every file throughout history, but didn't update the list for the /source/ alias. Update it.

Test Plan

Visited /robots.txt locally.

Diff Detail

Repository
rP Phabricator
Branch
robot1
Lint
Lint Passed
Unit
Tests Passed
Build Status
Buildable 16346
Build 21737: Run Core Tests
Build 21736: arc lint + arc unit

Event Timeline

This revision is now accepted and ready to land.Apr 6 2017, 11:19 PM
This revision was automatically updated to reflect the committed changes.