I probably tried 10 different things to make the security pop up described below go away
The problem is that it takes a day to see if you fix actually works and your CI runs are dirty because it requires human intervention to get it running the following day. I was disabling CI when I went home and enabling it when I fixed the agents the next morning. The solution that worked for me was near the bottom. On Yosemite 10.10.5 the command that worked is:
$ DevToolsSecurity Developer mode is now enabled.