We have the workflow 'Audits in Small Teams' set up as described here: https://secure.phabricator.com/book/phabricator/article/audit/#audits-in-small-teams
Is it possibly the configure the Herald rule so that it doesn't trigger an audit if the commit has only touched binary files?