
As AI tools proliferate for engineering, our security team has faced a tough balancing act: enable engineers to leverage these tools while keeping our company data safe.
Over the past year, Chris Bailey, our Head of Security, and his team have taken several measures to navigate this balance successfully.
Here’s just a snapshot of what they’ve done.
Before even looking at a developer tool’s technical security posture, our security team reviews their terms of service and data ownership policies.
Many dev tools reserve rights to use or retain customer data for model training. This means that if your team uploads sensitive information, you may unknowingly grant them broad usage rights.
Chris explains why this is so harmful:
Whenever our security team sees this during a vendor evaluation, they’ll determine whether there’s a strong enough business case to warrant upgrading to their enterprise plan (where they’d typically waive ownership and training rights).
For dev tools, this involves taking a holistic and quantitative approach for reviewing each tool:
Based on our security team’s answers to these items, they can quickly glean if a tool doesn’t offer a compelling ROI. And when it doesn’t, they’ll typically block it from being used and identify the best alternative options.
Chris’ team classifies data into categories, such as end-user data, code and internal documentation, and they evaluate risk based on the type of data processed.
Based on the type of data that’d be collected and/or created in a tool, they can then assign it a certain level of risk—which informs the security review they’d go on to perform.
Here’s how this looks for dev tools:
This tiered approach helps teams move fast when risk is low and remain cautious when there’s potentially harmful exposure.
Chris and his team work closely with engineering leadership to identify the best tools for specific use cases and purchase enterprise licenses for them.
Chris explains why this is a win-win:
For example, for code generation, they evaluated tools based on the frequency and nature of hallucinations, the prevalence of insecure code patterns, and the potential for synthetic vulnerabilities.
After reviewing several code generation platforms, our security and engineering teams found that Windsurf and Claude best met our security requirements and engineering use cases, so they purchased enterprise licenses for both.
Chris has already seen this approach help build goodwill with engineering:
Chris’ team provides communications on AI developments (that’s not only relevant to developers but also the team at large) in highly-visible ways, from posting in the "#general" Slack channel to speaking at all-hands meetings.
They time these communications by the type of AI advancement they see and its potential impact on our security posture.
For example, if there’s a trending AI product, and they immediately see potential security risks, they’d notify the team that it hasn’t been vetted yet and shouldn’t be used until further notice.
In addition to providing proactive communications, Chris has found it helpful to remind Mergies of a tool’s security policy right when it’s launched:
Our security team has proven that you don’t have to sacrifice security to embrace AI (and vice versa).
By pairing smart data classification with proactive enablement, strategic reviews, and continuous education, they’re empowering our engineers—and the rest of our team—to leverage AI successfully.
“At the end of the day, AI risk management isn’t about reinventing the wheel. It's the same preventative risk assessment we’ve always done, just through a new lens,” says Chris.
When you think about it this way, you should feel confident in helping your team use AI securely.