Page MenuHomePhabricator

Disallow /source/ in robots.txt
ClosedPublic

Authored by epriestley on Apr 6 2017, 10:53 PM.
Tags
None
Referenced Files
Unknown Object (File)
Fri, Feb 21, 3:19 PM
Unknown Object (File)
Jan 31 2025, 1:25 PM
Unknown Object (File)
Jan 28 2025, 10:31 AM
Unknown Object (File)
Jan 28 2025, 2:28 AM
Unknown Object (File)
Jan 24 2025, 1:02 AM
Unknown Object (File)
Jan 23 2025, 11:29 PM
Unknown Object (File)
Jan 21 2025, 9:18 AM
Unknown Object (File)
Jan 15 2025, 6:41 PM
Subscribers
None

Details

Summary

Ref T4245. We disallow /diffusion/ in robots.txt already because indexers tend to get lost blaming every line of every file throughout history, but didn't update the list for the /source/ alias. Update it.

Test Plan

Visited /robots.txt locally.

Diff Detail

Repository
rP Phabricator
Branch
robot1
Lint
Lint Passed
Unit
Tests Passed
Build Status
Buildable 16346
Build 21737: Run Core Tests
Build 21736: arc lint + arc unit

Event Timeline

This revision is now accepted and ready to land.Apr 6 2017, 11:19 PM
This revision was automatically updated to reflect the committed changes.