Enterprise

MergeStat channels open source and SQL to bring ‘operational analytics’ to software engineering

Comment

MergeStat
Image Credits: MergeStat

A new open source startup is setting out to help software development teams glean deeper insights from their codebases, using SQL to query all the data sources they use in the software building process.

MergeStat, as the startup is known, has flown under the radar until now, but with plans to launch a commercial product on top of its existing open source project, the company today announced a $1.2 million pre-seed round of funding and gave some insights on where it is and where it’s going in the months ahead.

For context, MergeStat’s origins can be traced back to mid-2020 when the first commits to a project called Gitqlite were made, which was essentially an experiment that brought together SQLite and Git to make it easier to query historical data in code repositories.

“At the time, I was very interested in exploring the history of source code to learn about legacy codebases I was working in,” MergeStat founder and CEO Patrick DeVivo explained to TechCrunch. “Could Git history be used to determine the best people to contact for questions about certain features or parts of a codebase? As a way to identify ‘experts’ in certain areas of code, and provide aggregated context around who was responsible for what parts of the source code? Similarly, could it surface areas of high risk that were dependent on someone who no longer works on a project?”

In essence, it’s all about diving into code history — this includes querying basic elements such as commit history and displaying author metadata via the “Git blame” command, but its intention is to go far beyond this and enable developers to leverage SQL to ask questions about the code itself.

“Operational analytics”

Fast-forward to April 2021, and the commercial MergeStat company was officially born, with DeVivo going on to lure Josue Lopez from cloud giant Equinix to serve as chief operating officer (COO), as well as official co-founder.

“This has led us to where we are today, where our mission is to support operational analytics for software engineering teams,” DeVivo said. “If it’s involved in building or shipping software, we’d like to make it possible to query with SQL.”

Essentially, any tool that works with PostgreSQL — including most business intelligence (BI) and data visualization tools — works with MergeStat. The platform itself includes a management interface and a PostgreSQL database, with MergeStat synchronizing data from various software development lifecycle (SDLC) sources into the main PostgreSQL database. Users can then query that data from within MergeStat’s app, or connect it to a third-party tool such as Grafana, Tableau or Superset.

But what are the kinds of use cases that MergeStat might support? Well, at its core it’s about garnering insights from information that may be spread across different codebases and developer teams. For example, if a manager at a large enterprise wants to know how many teams — and which teams — have adopted a new tool, or how many codebases use a specific version of a programming language or library, they can use MergeStat to ask that. Alternatively, they might want to extract all the third-party dependencies or configuration file values, and again MergeStat could help here.

Knowing the answers to such questions are vitally important if a company is conducting a huge migration project, or if they’re figuring out their potential attack surface area where there is a known vulnerability in a particular dependency.

MergeStat in action. Image Credits: MergeStat

Other potential use cases include auditing and compliance, so that companies can follow proper procedures and best practices as part of a regulatory framework. For example, a service provider might need to demonstrate that they are properly managing their customers’ data as part of a SOC 2 audit — MergeStat can be used to gather and present this evidence, showing who has accessed a specific file or who has modified what code.

Competitive landscape

It’s worth pointing out here that it’s already possible to get answers to these questions, but this typically involves a manual process involving multiple screens and tools, and copying text into spreadsheets, which can be a resource-intensive process. MergeStat automates much of it by allowing engineers to ask questions via SQL, and viewing answers in dashboards, reports and alerts through BI tools.

“MergeStat can continuously answer these questions, as teams go about their normal work — the underlying data MergeStat accesses changes to reflect the updated state,” DeVivo added.

Example pull request (PR) data derived via MergeStat. Image Credits: MergeStat

There are also many SaaS tools out there that fulfill at least one segment of what MergeStat promises. For instance, engineering metrics is covered by the likes of LinearB or Jellyfish, while code search is a core component of Sourcegraph and GitHub itself. And in the audit and compliance sphere, there is Drata, Vanta and Laika, which integrate with GitHub for evidence gathering.

While these all bring value, MergeStat is betting that many engineering leads don’t want pre-built “canned” metrics and charts around subjective concepts such as “velocity” or “productivity.” MergeStat posits that many would prefer access to the underlying data across the software development lifecycle, with the flexibility to query it in ways that are relevant to their specific organization and use case.

“Every organization is different, and we believe giving them tools to work with their data, to craft more specific questions, leads to better outcomes,” DeVivo said. “We are positioning ourselves as a data infrastructure product and believe that giving ‘lower level’ access to the data involved in building and shipping software is generally useful for engineering organizations to operationalize it.”

Being open source, of course, is also a big part of MergeStat’s flexibility promise. It gives companies full control of their data and deployment, while they are able to slice-and-dice it however they see fit — locally on a laptop, if they like — to figure it all out before going all-in.

What’s next

While MergeStat is still pretty much an open source project for now, the company is currently working on a hosted cloud product and an enterprise-focused incarnation that can be self-hosted or deployed on any cloud of the customer’s choosing. Much of this will be built around its recently announced “PostgreSQL approach,” which involves synchronizing data into a Postgres database for powering queries further downstream.

In the build up to its commercial launch, MergeStat said that it’s already working with “a number of companies” in early tests, including the team at Equinix Metal, which DeVivo says is currently using a self-hosted MergeStat instance across 800 repositories.

MergeStat’s pre-seed round was led by OSS Capital, with participation from Caffeinated Capital and a slew of angel investors.

More TechCrunch

Featured Article

More neobanks are becoming mobile networks — and Nubank wants a piece of the action

Nubank is taking its first tentative steps into the mobile network realm, as the NYSE-traded Brazilian neobank rolls out an eSIM (embedded SIM) service for travelers. The service will give customers access to 10GB of free roaming internet in more than 40 countries without having to switch out their own existing physical SIM card or…

3 hours ago
More neobanks are becoming mobile networks — and Nubank wants a piece of the action

Infra.Market, an Indian startup that helps construction and real estate firms procure materials, has raised $50M from MARS Unicorn Fund.

MARS doubles down on India’s Infra.Market with new $50M investment

Small operations can lose customers by not offering financing, something the Berlin-based startup wants to change.

Cloover wants to speed solar adoption by helping installers finance new sales

India’s Adani Group is in discussions to venture into digital payments and e-commerce, according to a report.

Adani looks to battle Reliance, Walmart in India’s e-commerce, payments race, report says

Ledger, a French startup mostly known for its secure crypto hardware wallets, has started shipping new wallets nearly 18 months after announcing the latest Ledger Stax devices. The updated wallet…

Ledger starts shipping its high-end hardware crypto wallet

A data protection taskforce that’s spent over a year considering how the European Union’s data protection rulebook applies to OpenAI’s viral chatbot, ChatGPT, reported preliminary conclusions Friday. The top-line takeaway…

EU’s ChatGPT taskforce offers first look at detangling the AI chatbot’s privacy compliance

Here’s a shoutout to LatAm early-stage startup founders! We want YOU to apply for the Startup Battlefield 200 at TechCrunch Disrupt 2024. But you’d better hurry — time is running…

LatAm startups: Apply to Startup Battlefield 200

The countdown to early-bird savings for TechCrunch Disrupt, taking place October 28–30 in San Francisco, continues. You have just five days left to save up to $800 on the price…

5 days left to get your early-bird Disrupt passes

Venture investment into Spanish startups also held up quite well, with €2.2 billion raised across some 850 funding rounds.

Spanish startups reached €100 billion in aggregate value last year

Featured Article

Onyx Motorbikes was in trouble — and then its 37-year-old owner died

James Khatiblou, the owner and CEO of Onyx Motorbikes, was watching his e-bike startup fall apart.  Onyx was being evicted from its warehouse in El Segundo, Los Angeles. The company’s unpaid bills were stacking up. His chief operating officer had abruptly resigned. A shipment of around 100 CTY2 dirt bikes from Chinese supplier Suzhou Jindao…

21 hours ago
Onyx Motorbikes was in trouble — and then its 37-year-old owner died

Featured Article

Iyo thinks its gen AI earbuds can succeed where Humane and Rabbit stumbled

Iyo represents a third form factor in the push to deliver standalone generative AI devices: Bluetooth earbuds.

21 hours ago
Iyo thinks its gen AI earbuds can succeed where Humane and Rabbit stumbled

Arati Prabhakar, profiled as part of TechCrunch’s Women in AI series, is director of the White House Office of Science and Technology Policy.

Women in AI: Arati Prabhakar thinks it’s crucial to get AI ‘right’

AniML, the French startup behind a new 3D capture app called Doly, wants to create the PhotoRoom of product videos, sort of. If you’re selling sneakers on an online marketplace…

Doly lets you generate 3D product videos from your iPhone

Elon Musk’s AI startup, xAI, has raised $6 billion in a new funding round, it said today, as Musk shores up capital to aggressively compete with rivals including OpenAI, Microsoft,…

Elon Musk’s xAI raises $6B from Valor, a16z, and Sequoia

Indian startup Zypp Electric plans to use fresh investment from Japanese oil and energy conglomerate ENEOS to take its EV rental service into Southeast Asia early next year, TechCrunch has…

Indian EV startup Zypp Electric secures backing to fund expansion to Southeast Asia

Last month, one of the Bay Area’s better-known early-stage venture capital firms, Uncork Capital, marked its 20th anniversary with a party in a renovated church in San Francisco’s SoMa neighborhood,…

A venture capital firm looks back on changing norms, from board seats to backing rival startups

The families of victims of the shooting at Robb Elementary School in Uvalde, Texas are suing Activision and Meta, as well as gun manufacturer Daniel Defense. The families bringing the…

Families of Uvalde shooting victims sue Activision and Meta

Like most Silicon Valley VCs, what Garry Tan sees is opportunities for new, huge, lucrative businesses.

Y Combinator’s Garry Tan supports some AI regulation but warns against AI monopolies

Everything in society can feel geared toward optimization – whether that’s standardized testing or artificial intelligence algorithms. We’re taught to know what outcome you want to achieve, and find the…

How Maven’s AI-run ‘serendipity network’ can make social media interesting again

Miriam Vogel, profiled as part of TechCrunch’s Women in AI series, is the CEO of the nonprofit responsible AI advocacy organization EqualAI.

Women in AI: Miriam Vogel stresses the need for responsible AI

Google has been taking heat for some of the inaccurate, funny, and downright weird answers that it’s been providing via AI Overviews in search. AI Overviews are the AI-generated search…

What are Google’s AI Overviews good for?

When it comes to the world of venture-backed startups, some issues are universal, and some are very dependent on where the startups and its backers are located. It’s something we…

The ups and downs of investing in Europe, with VCs Saul Klein and Raluca Ragab

Welcome back to TechCrunch’s Week in Review — TechCrunch’s newsletter recapping the week’s biggest news. Want it in your inbox every Saturday? Sign up here. OpenAI announced this week that…

Scarlett Johansson brought receipts to the OpenAI controversy

Accurate weather forecasts are critical to industries like agriculture, and they’re also important to help prevent and mitigate harm from inclement weather events or natural disasters. But getting forecasts right…

Deal Dive: Can blockchain make weather forecasts better? WeatherXM thinks so

pcTattletale’s website was briefly defaced and contained links containing files from the spyware maker’s servers, before going offline.

Spyware app pcTattletale was hacked and its website defaced

Featured Article

Synapse, backed by a16z, has collapsed, and 10 million consumers could be hurt

Synapse’s bankruptcy shows just how treacherous things are for the often-interdependent fintech world when one key player hits trouble. 

3 days ago
Synapse, backed by a16z, has collapsed, and 10 million consumers could be hurt

Sarah Myers West, profiled as part of TechCrunch’s Women in AI series, is managing director at the AI Now institute.

Women in AI: Sarah Myers West says we should ask, ‘Why build AI at all?’

Keeping up with an industry as fast-moving as AI is a tall order. So until an AI can do it for you, here’s a handy roundup of recent stories in the world…

This Week in AI: OpenAI and publishers are partners of convenience

Evan, a high school sophomore from Houston, was stuck on a calculus problem. He pulled up Answer AI on his iPhone, snapped a photo of the problem from his Advanced…

AI tutors are quietly changing how kids in the US study, and the leading apps are from China

Welcome to Startups Weekly — Haje‘s weekly recap of everything you can’t miss from the world of startups. Sign up here to get it in your inbox every Friday. Well,…

Startups Weekly: Drama at Techstars. Drama in AI. Drama everywhere.