Announcing our partnership with Sourcegraph

At DX, we help engineering leaders measure developer productivity and get recommendations on how to improve. Accordingly, our customers frequently ask us for our perspectives on best-in-class tools that can help them deliver improvements.

To provide objective recommendations, we partner with forward-thinking vendors to study and measure the effectiveness of their products. By leveraging measurements like the DX Core 4, DXI, and Experiencing Sampling we can draw a direct line between the use of specific tools and developer productivity.

As budgets tighten, leadership is demanding concrete data to justify costs and demonstrate the impact of these strategic tooling investments. Nothing seems to be of higher importance for organizations right now than understanding the impact AI coding assistants are having on software development.

Partnering with Sourcegraph

With this focus in mind, we’re excited to announce our latest partnership with Sourcegraph. Sourcegraph is a code intelligence platform that allows engineering teams to understand and write code in complex codebases. Sourcegraph has the most scalable code search on the market and the AI assistant with the best LLMs and the most extensive developer context. These capabilities allow engineers to find relevant code, understand the impact of code changes, write code faster, and automate large-scale code changes.

Through our partnership, we will study Sourcegraph’s impact on developer productivity and share our learnings with the broader engineering community. As a part of this partnership, Sourcegraph customers will gain unique access to DX’s measurement and benchmarking capabilities to help them better understand and optimize their use of Sourcegraph.

We invite all customers of Sourcegraph, as well as those evaluating it, to leverage DX to measure your current state of productivity and assess the benefit that Sourcegraph can bring to your organization.

Like DX, Sourcegraph is committed to helping their customers reduce developer toil, increase engineering velocity, and make data-informed decisions about their investments. We’re excited to partner with them on this shared mission.

Case study: Booking.com measures the impact of Sourcegraph using DX

Booking.com’s engineering leadership team wanted to better understand and quantify the impact that Sourcegraph’s AI code assistant was having on software development. By using DX, they were able to measure the output, time savings, and satisfaction of Sourcegraph users compared to Non-users and get a clear answer about the tool’s ROI.

Here are a few highlights of what Booking saw in their data:

• Daily active users of Sourcegraph had a 16% higher PR merge rate than non-users
• Dev Satisfaction with Sourcegraph increased by 15 percentage points over a 6-month period, a testament to recent product enhancements
• Developers using Sourcegraph are saving significant time on tedious work, freeing up capacity for ambitious projects

After posting about their 90%+ participation rate, Bruno Passos, Group Product Manager on Booking’s Developer Experience team, shared with us that “Using DX to quantify the impact of Sourcegraph has given us confidence in the outcomes it’s driving for our developers. Not only did it confirm that Sourcegraph is helping us ship faster, but these insights are helping us refine and guide our continued rollout.”

He continued: “Using DX and Sourcegraph together has helped us answer a handful of important questions: How much time are we saving using Sourcegraph? Does using Sourcegraph impact quality? And how do AI coding assistants impact the developer experience more broadly?”

Booking will continue to study the impact that Sourcegraph is having as the product evolves and developers become more proficient with it.

What’s next

DX will continue working with companies like Booking to help them study the impact of using tools like Sourcegraph, and gain insights into how to improve adoption. We look forward to sharing findings from this work along the way.

If you’re using or evaluating Sourcegraph and want to measure the impact it’s having, we’d love to help. Reach out to us to learn how DX can support your efforts and help you make the most of Sourcegraph’s capabilities.