Comparison of engineering metrics tools

Developer Tools Comparison

Disclaimer

We believe in transparency, so want you to know upfront that we have a product in this space. That said, we have done our best to do a feature-based, non-biased comparison of various tools for engineering metrics - you'll see we've even included areas where our competitors have more features.

This comparison draws from the public documentation for these tools; if they didn't have public documentation, we name that below.

If you spot any inaccuracies or would like to suggest additional tools for comparison, please let us know! We'll review and update accordingly. 😀

Features	Multitudes	Apache DevLake	Cortex	GetDX	Jellyfish	LinearB	Sleuth	Swarmia
DORA metrics & integrations
4 key DORA metrics	✅	✅	✅	✅	✅	✅	✅	✅
DORA-related integrations:
Version Source Control (VSC)	✅ GitHub ❌ GitLab, BitBucket, Azure DevOps (Coming soon)	✅ GitHub, Azure DevOps, BitBucket, GitLab	✅ GitHub, Azure DevOps, BitBucket, GitLab	No public docs available, therefore we can't confirm	No public docs available, therefore we can't confirm	✅ GitHub, Azure DevOps, BitBucket, GitLab	✅ Azure DevOps, Bitbucket, GitHub, GitLab, Custom Git, Terraform Cloud	✅ GitHub ❌ GitLab, BitBucket, Azure DevOps (Coming soon)
Deployments (CI/CD)	✅ GitHub Actions , Deployments API	✅ GitHub Actions, Deployments API for other tools	✅ GitHub Actions, Deployments API for other tools			✅ Deployments API for other tools ❌ GitHub Actions	✅ Deployment API, Azure Pipelines, Bitbucket Pipelines, CircleCI, Buildkite, Github Actions, GitLab CI/CD Pipelines, Jenkins	✅ Deployments API
Issue Tracking	✅ Jira , Linear	✅ Jira, TAPD, Zentao, Teambition	❌			✅ Jira, Clubhouse	✅ Jira, Linear, Shortcut	✅ Jira, Linear
Incidents	✅ PagerDuty , Opsgenie ❌ Incidents API (Coming soon)	✅ PagerDuty, Opsgenie, ServiceNow (Coming soon), 'type-incident' configuration in Jira, GitHub	✅ PagerDuty, Opsgenie, Incident.io			✅ Incident API	✅ Incident API, Blameless, PagerDuty, Datadog Monitors, Statuspage, Opsgenie, Jira (Coud/Data Center), FireHydrant, Rootly, ServiceNow, Custom	❌
SPACE metrics & integrations
Focus Time & Meeting Load Insights	✅ Focus Time , Meeting Load	❌	❌	No public docs available, therefore we can't confirm	No public docs available, therefore we can't confirm	❌	❌	❌
Review Wait Time & Review depth insights	✅ Review Wait Time	✅ PR Review Time, PR Review Depth	✅ Time to first review, time to approval, PRs reviewed/week			✅ Reviews, Review Depth, Time to Approve	✅ Review Lag and Review Time	✅ Review time
PR Collaboration insights	✅ PR Participation Gap , Feedback Given & Received , Feedback Flows	❌	❌			❌	❌	❌
Out-of-hours work (pages, commits, meetings)	✅ Out-of-Hours Work , Out-of-Hours Pages , Out-of-Hours Meetings	❌	❌			❌	❌	❌
Satisfaction survey	❌ (Coming soon)	❌	❌			❌	❌	✅
SPACE-related integrations:
Calendar	✅ Google & Outlook Calendar	❌	❌			❌	❌	❌
PLUS All the DORA-related integrations above	See above	See above	See above			See above	See above	See above
Link to action
Goal-setting / Targets	✅	❌	✅	No public docs available, therefore we can't confirm	No public docs available, therefore we can't confirm	✅	✅	✅
Slack notifications	✅	❌	✅			✅	✅	✅
Recommended actions – dynamic based on your data	✅	❌	❌			✅	✅	❓
Retro discussion guide	✅	❌	❌			❓	✅	❓
Data accuracy
Exclude weekend hours	✅	❌	❓	No public docs available, therefore we can't confirm	No public docs available, therefore we can't confirm	✅	✅	❌
GitHub Teams Sync - for automated team updates	✅	❌	✅			✅	✅	❓Manually with GitHub API
Bot activity filtering	✅	❌	❓			❌	❓Custom automation	✅
Adjust for individual differences in working hours	✅	❌	❓			❌	✅	❌
Conventional commits analysis	✅	❌	✅			❌	❌	❓
Filter for collaborative PRs	✅	❌	❓			❓ Merged without Review	❓Custom automation	❓
Builds team trust
Public docs	✅	✅	✅	❌	❌	✅	✅	✅
Annotations on charts – show context next to the data	✅	❌	❌	❓	❓	❌	❌	❌
Data ethics principles	✅ Our data principles	❌	❌	❌	❌	❌	❌	❌
Transparency between leaders and ICs	✅	❌	❌	❌	❌	❌	❓Focus on Alignment	❌
No stack-ranking on lines of code or count of PRs	✅	❌ Allows stack-ranking	❌ Allows stack-ranking	❌ Allows stack-ranking	❓	❌ Stack-ranks	❓	✅

‍

We value transparency at Multitudes, so if you spot any inaccuracies or would like to suggest additional tools for comparison, please let us know!

Notes:

Apache DevLake runs on SQL queries so you can set it up to do any number of things; we've done this comparison based on what they do out of the box.

Contributor

Laura Kerrison

Product & Design Lead



Back to blog articles

Comparison of engineering metrics tools

Contributor

Share this

Start making data-informed decisions.