Enterprise

MergeStat channels open source and SQL to bring ‘operational analytics’ to software engineering

Comment

MergeStat
Image Credits: MergeStat

A new open source startup is setting out to help software development teams glean deeper insights from their codebases, using SQL to query all the data sources they use in the software building process.

MergeStat, as the startup is known, has flown under the radar until now, but with plans to launch a commercial product on top of its existing open source project, the company today announced a $1.2 million pre-seed round of funding and gave some insights on where it is and where it’s going in the months ahead.

For context, MergeStat’s origins can be traced back to mid-2020 when the first commits to a project called Gitqlite were made, which was essentially an experiment that brought together SQLite and Git to make it easier to query historical data in code repositories.

“At the time, I was very interested in exploring the history of source code to learn about legacy codebases I was working in,” MergeStat founder and CEO Patrick DeVivo explained to TechCrunch. “Could Git history be used to determine the best people to contact for questions about certain features or parts of a codebase? As a way to identify ‘experts’ in certain areas of code, and provide aggregated context around who was responsible for what parts of the source code? Similarly, could it surface areas of high risk that were dependent on someone who no longer works on a project?”

In essence, it’s all about diving into code history — this includes querying basic elements such as commit history and displaying author metadata via the “Git blame” command, but its intention is to go far beyond this and enable developers to leverage SQL to ask questions about the code itself.

“Operational analytics”

Fast-forward to April 2021, and the commercial MergeStat company was officially born, with DeVivo going on to lure Josue Lopez from cloud giant Equinix to serve as chief operating officer (COO), as well as official co-founder.

“This has led us to where we are today, where our mission is to support operational analytics for software engineering teams,” DeVivo said. “If it’s involved in building or shipping software, we’d like to make it possible to query with SQL.”

Essentially, any tool that works with PostgreSQL — including most business intelligence (BI) and data visualization tools — works with MergeStat. The platform itself includes a management interface and a PostgreSQL database, with MergeStat synchronizing data from various software development lifecycle (SDLC) sources into the main PostgreSQL database. Users can then query that data from within MergeStat’s app, or connect it to a third-party tool such as Grafana, Tableau or Superset.

But what are the kinds of use cases that MergeStat might support? Well, at its core it’s about garnering insights from information that may be spread across different codebases and developer teams. For example, if a manager at a large enterprise wants to know how many teams — and which teams — have adopted a new tool, or how many codebases use a specific version of a programming language or library, they can use MergeStat to ask that. Alternatively, they might want to extract all the third-party dependencies or configuration file values, and again MergeStat could help here.

Knowing the answers to such questions are vitally important if a company is conducting a huge migration project, or if they’re figuring out their potential attack surface area where there is a known vulnerability in a particular dependency.

MergeStat in action. Image Credits: MergeStat

Other potential use cases include auditing and compliance, so that companies can follow proper procedures and best practices as part of a regulatory framework. For example, a service provider might need to demonstrate that they are properly managing their customers’ data as part of a SOC 2 audit — MergeStat can be used to gather and present this evidence, showing who has accessed a specific file or who has modified what code.

Competitive landscape

It’s worth pointing out here that it’s already possible to get answers to these questions, but this typically involves a manual process involving multiple screens and tools, and copying text into spreadsheets, which can be a resource-intensive process. MergeStat automates much of it by allowing engineers to ask questions via SQL, and viewing answers in dashboards, reports and alerts through BI tools.

“MergeStat can continuously answer these questions, as teams go about their normal work — the underlying data MergeStat accesses changes to reflect the updated state,” DeVivo added.

Example pull request (PR) data derived via MergeStat. Image Credits: MergeStat

There are also many SaaS tools out there that fulfill at least one segment of what MergeStat promises. For instance, engineering metrics is covered by the likes of LinearB or Jellyfish, while code search is a core component of Sourcegraph and GitHub itself. And in the audit and compliance sphere, there is Drata, Vanta and Laika, which integrate with GitHub for evidence gathering.

While these all bring value, MergeStat is betting that many engineering leads don’t want pre-built “canned” metrics and charts around subjective concepts such as “velocity” or “productivity.” MergeStat posits that many would prefer access to the underlying data across the software development lifecycle, with the flexibility to query it in ways that are relevant to their specific organization and use case.

“Every organization is different, and we believe giving them tools to work with their data, to craft more specific questions, leads to better outcomes,” DeVivo said. “We are positioning ourselves as a data infrastructure product and believe that giving ‘lower level’ access to the data involved in building and shipping software is generally useful for engineering organizations to operationalize it.”

Being open source, of course, is also a big part of MergeStat’s flexibility promise. It gives companies full control of their data and deployment, while they are able to slice-and-dice it however they see fit — locally on a laptop, if they like — to figure it all out before going all-in.

What’s next

While MergeStat is still pretty much an open source project for now, the company is currently working on a hosted cloud product and an enterprise-focused incarnation that can be self-hosted or deployed on any cloud of the customer’s choosing. Much of this will be built around its recently announced “PostgreSQL approach,” which involves synchronizing data into a Postgres database for powering queries further downstream.

In the build up to its commercial launch, MergeStat said that it’s already working with “a number of companies” in early tests, including the team at Equinix Metal, which DeVivo says is currently using a self-hosted MergeStat instance across 800 repositories.

MergeStat’s pre-seed round was led by OSS Capital, with participation from Caffeinated Capital and a slew of angel investors.

More TechCrunch

The TechCrunch team runs down all of the biggest news from the Apple WWDC 2024 keynote in an easy-to-skim digest.

Here’s everything Apple announced at the WWDC 2024 keynote, including Apple Intelligence, Siri makeover

Hello and welcome back to TechCrunch Space. What a week! In the same seven-day period, we watched Boeing’s Starliner launch astronauts to space for the first time, and then we…

TechCrunch Space: A week that will go down in history

Elon Musk’s posts seem to misunderstand the relationship Apple announced with OpenAI at WWDC 2024.

Elon Musk threatens to ban Apple devices from his companies over Apple’s ChatGPT integrations

“We’re looking forward to doing integrations with other models, including Google Gemini, for instance, in the future,” Federighi said during WWDC 2024.

Apple confirms plans to work with Google’s Gemini ‘in the future’

When Urvashi Barooah applied to MBA programs in 2015, she focused her applications around her dream of becoming a venture capitalist. She got rejected from every school, and was told…

How Urvashi Barooah broke into venture after everyone told her she couldn’t

Slack CEO Denise Dresser is speaking at TechCrunch Disrupt 2024.

Slack CEO Denise Dresser is coming to TechCrunch Disrupt this October

Apple kicked off its weeklong Worldwide Developers Conference (WWDC 2024) event today with the customary keynote at 1 p.m. ET/10 a.m. PT. The presentation focused on the company’s software offerings…

Watch the Apple Intelligence reveal, and the rest of WWDC 2024 right here

Apple’s SDKs (software development kits) have been updated with a variety of new APIs and frameworks.

Apple brings its GenAI ‘Apple Intelligence’ to developers, will let Siri control apps

Older iPhones or iPhone 15 users won’t be able to use these features.

Apple Intelligence features will be available on iPhone 15 Pro and devices with M1 or newer chips

Soon, Siri will be able to tap ChatGPT for “expertise” where it might be helpful, Apple says.

Apple brings ChatGPT to its apps, including Siri

Apple Intelligence will have an understanding of who you’re talking with in a messaging conversation.

Apple debuts AI-generated … Bitmoji

To use InSight, Apple TV+ subscribers can swipe down on their remote to bring up a display with actor names and character information in real time.

Apple TV+ introduces InSight, a new feature similar to Amazon’s X-Ray, at WWDC 2024

Siri is now more natural, more relevant and more personal — and it has new look.

Apple gives Siri an AI makeover

The company has been pushing the feature as integral to all of its various operating system offerings, including iOS, macOS and the latest, VisionOS.

Apple Intelligence is the company’s new generative AI offering

In addition to all the features you can find in the Passwords menu today, there’s a new column on the left that lets you more easily navigate your password collection.

Apple is launching its own password manager app

With Smart Script, Apple says it’s making handwriting your notes even smoother and straighter.

Smart Script in iPadOS 18 will clean up your handwriting when using an Apple Pencil

iOS’ perennial tips calculating app is finally coming to the larger screen.

Calculator for iPad does the math for you

The new OS, announced at WWDC 2024, will allow users to mirror their iPhone screen directly on their Mac and even control it.

With macOS Sequoia, you can mirror your iPhone on your Mac

At Apple’s WWDC 2024, the company announced MacOS Sequoia.

Apple unveils macOS Sequoia

“Messages via Satellite,” announced at Apple’s WWDC 2024 keynote, works much like the SOS feature does.

iPhones will soon text via satellite

Apple says the new design will lead to less time searching for photos.

Apple revamps its Photos app for iOS 18

Users will be able to lock an app when they hand over their phone.

iOS 18 will let you hide and lock apps

Apple’s WWDC 2024 keynote was packed, including a number of key new updates for iOS 18. One of the more interesting additions is Tap to Cash, which is more or…

Tap to Cash lets you pay by touching iPhones

In iOS 18, Apple will now support long-requested functionality, like the ability to set app icons and widgets wherever you want.

iOS 18 will finally let you customize your icons and unlock them from the grid

As expected, this is a pivotal moment for the mobile platform as iOS 18 is going to focus on artificial intelligence.

Apple unveils iOS 18 with tons of AI-powered features

Apple today kicked off what it promised would be a packed WWDC 2024 with a handful of visionOS announcements. At the top of the list is the ability to turn…

visionOS can now make spatial photos out of 3D images

The Apple Vision Pro is now available in eight new countries.

Apple to release Vision Pro in international markets

VisionOS 2 will come to Vision Pro as a free update later this year.

Apple debuts visionOS 2 at WWDC 2024

The security firm said the attacks targeting Snowflake customers is “ongoing,” suggesting the number of affected companies may rise.

Mandiant says hackers stole a ‘significant volume of data’ from Snowflake customers

French startup Kelvin, which uses computer vision and machine learning to make it easier to audit homes for energy efficiency, has raised $5.1M.

Kelvin wants to help save the planet by applying AI to home energy audits