Page MenuHomePhabricator

Excessive memory usage when importing symbols of large projects
Closed, ResolvedPublic

Description

When importing symbols for a large project (the Linux kernel for example), the import_project_symbols.php script consumes excessive memory, eventually exhausting the maximum memory available to a single process on a 32 bit host.

A possible workaround might be to split the symbol table into smaller chunks (say 100,000 lines) and use --no-purge, but the symbol script should be able to do that automatically.

Event Timeline

wotte raised the priority of this task from to Needs Triage.
wotte updated the task description. (Show Details)
wotte added a project: Phabricator.
wotte added a subscriber: wotte.
epriestley triaged this task as Wishlist priority.Nov 17 2013, 10:14 PM
epriestley added a subscriber: epriestley.
epriestley claimed this task.

Some possible refinements in D7596 for the next time this gets updated. Thanks for the patch, let us know if you run into anything else.