I couldn't figure out how to do this.
When observing a repo, you have the ability to tell diffusion what branches to track, but there doesn't seem to be the ability to track everything besides certain refs/branches.
My issue is that I am observing a GitHub repo and I have no need for all of the pull requests to be imported. So I want everything besides `refs/pull/*`