Reliability & Availability

Curious about MTTR? We explain what the mean time to recovery is, why it matters to your development team, and how to reduce it.

SLAs and SLOs are both reliability metrics based on SLIs. Here we explain their differences and the importance of each for reliability teams.

Service level management requires airtight processes to ensure SLAs are on track and to catch any issues beforehand, while following these ITIL best practices.

A "Service Level Objective" (SLO) is an internal target that measures how well a service is performing. Here's how they relate to SLAs, SLIs, and error budgets.

Wondering what error budgets (EBs) are and how they are useful? We explain what they are, how they are defined, and how they can help your team.

Blameless is excited to announce that our SLO Manager is now generally available! SLO Manager is a new service added to the Blameless platform. This service helps SRE and engineering teams proactively make data-driven decisions about reliability efforts.

MTTx metrics rarely tell the whole story of a system’s reliability. To understand what MTTx metrics are really telling you, you’ll need to combine them with other data. In this blog post, we'll share some alternatives to the basic MTTx metrics you might be using.

In this blog post, we’ll cover common metrics in incident response as well as how to connect your incident metrics to customer happiness, measure an incident’s impact on development, and integrate your metrics into your cycle of learning.

In this blog, we’ll look at the basics of error budgeting, how to set corresponding policies, and how to operationalize SLOs for the long term.

In this blog post, we’ll walk you through holistic measures and best practices that you can employ starting today. These will include challenges and pain points in gaining insight as well as key metrics and how they evolve as organizations mature.

Curious about MTTR? We explain what the mean time to recovery is, why it matters to your development team, and how to reduce it.

SLAs and SLOs are both reliability metrics based on SLIs. Here we explain their differences and the importance of each for reliability teams.

Service level management requires airtight processes to ensure SLAs are on track and to catch any issues beforehand, while following these ITIL best practices.

A "Service Level Objective" (SLO) is an internal target that measures how well a service is performing. Here's how they relate to SLAs, SLIs, and error budgets.

Wondering what error budgets (EBs) are and how they are useful? We explain what they are, how they are defined, and how they can help your team.

Blameless is excited to announce that our SLO Manager is now generally available! SLO Manager is a new service added to the Blameless platform. This service helps SRE and engineering teams proactively make data-driven decisions about reliability efforts.

MTTx metrics rarely tell the whole story of a system’s reliability. To understand what MTTx metrics are really telling you, you’ll need to combine them with other data. In this blog post, we'll share some alternatives to the basic MTTx metrics you might be using.

In this blog post, we’ll cover common metrics in incident response as well as how to connect your incident metrics to customer happiness, measure an incident’s impact on development, and integrate your metrics into your cycle of learning.

In this blog, we’ll look at the basics of error budgeting, how to set corresponding policies, and how to operationalize SLOs for the long term.

In this blog post, we’ll walk you through holistic measures and best practices that you can employ starting today. These will include challenges and pain points in gaining insight as well as key metrics and how they evolve as organizations mature.

Blameless is now SOC 2 compliant! Here, we share, define and walk through the steps required to earn SOC 2 compliance and certification. Learn more.

We explain how a DevOps team is structured, the roles and responsibilities within the team, and the balance between an individual contributor and the needs of the team.

Looking into DevOps automation? We explain how automation can improve your process, how to prioritize which tasks to automate, best practices, and how to avoid common mistakes.

Looking into DevOps pipelines? We explain what a DevOps pipeline is, how to build one, and the best practices for building one for your team.

Curious about shift right testing? We explain what shift right is, how it’s done, how it differs from a shift left approach, and whether it is important.

Wondering about shift left testing? We explain what shift left testing is, how it relates to DevOps and SRE, why it’s done, and how to get started.

Five nines uptime is a goal to have a system that is fully operational 99.999% of the time, which would result in approximately 6 minutes downtime per year.

Looking to build or improve your DevOps Team? We will explain the roles and responsibilities of a DevOps Team within your organization, and how to start building one.

Wondering about DevOps Tools? We explain the best tools for every step of the DevOps development process.

Wondering what DevOps Methodology is all about? We will explain what it is, how it works, and the principles and processes that make it successful.

Today, we are thrilled to announce that Blameless has been acquired by FireHydrant, a leader in innovative reliability platforms. This strategic move marks a significant milestone in our journey and opens up new horizons for our customers, our team, and the future of incident management.

The new SEC rules set standards for reporting on incidents and proactively publishing incident response plans. See how we can help you become compliant.

Want to learn more about the Blameless Reliability Scholarship? We’re looking for current & prospective comp sci and STEM students in the U.S. interested in SRE.

Big news everyone! We’re excited to promote our own, Matt Davis, to SRE Advocate. Hear what Matt has to say about his journey into this role, and what it means to him.

Do blameless retrospectives (or postmortems) help your team? We will explain what they are, if they really work, and how to do them right.

Here’s the template we use for incident postmortems (retrospectives!) at Blameless. Use this as a checklist for your own organization.

It's always important to retrospect, whether it's the latest outage or the latest sprint. This blog breaks down how to analyze both.

Discover various incident retrospective templates designed to reduce overhead and improve efficiencies. Learn more from Blameless.

A post-incident review is an evaluation of the incident response process. The goal is to have clear actions to improve the process and prevent further incidents.

Something big happened at Blameless this month — our “Postmortem” feature was updated to its new name, “Retrospective”. To the naysayer, I suppose you’re thinking, This seems trivial. Different teams call it different names anyway, so why bother making the change? First let me say, thank you for reading our blog and I hope you finish this one through to the end. Now, allow me to explain our reasoning and why we’re excited about this update.

What is root cause analysis and contributing factor analysis? Let's take a look at the best practices.

In this post, we’ll construct a basic reliability model and show you how to create one for your own organization.

For many SREs, Google’s 99.999% availability seems like an untouchable dream. If anything, getting out of pager hell is already worth celebrating with all your coworkers, friends, and family. How can you get to a stage where you have time to proactively prevent incidents, and enter a mental state of calm and control?

The concept of service level objectives (SLOs) and error budgets have been key to this transformation, as SLOs shape an organization’s ability to make data-oriented decisions around reliability. (Read here for a definition of SLOs and how they transformed Evernote.). Today, the Twitter team has invested in centralized tooling to measure, track, and visualize SLOs and their corresponding error budgets.

To be effective, service level indicators must be relevant to the users’ needs and experience. By consolidating a number of internal metrics into one indicator that reflects the typical use of the service, we can ensure that meeting our SLO means keeping users happy. A good way to think about this is by looking at the user’s experience or journey.

Service Level Objectives, or SLOs, are an internal goal for the essential metrics of a service, such as uptime or response speed. We’re probably familiar with this definition, but what is the value of setting these goals?

A remarkable milestone for any company’s site reliability engineering (SRE) is five 9s availability. That’s less than 30 seconds of service unavailability per month! Exactly what Twilio has accomplished. Tyler Wells, the Director of Engineering at Twilio, shares the key building blocks of getting to five 9s.

Whether you are a hiring manager or an SRE job candidate, there are certain questions you should be prepared to ask or respond to. Find out what they are here.

SRE is a practice that creates a bridge between operations and development. We discuss the roles and responsibilities of a site reliability engineer.

Development velocity is a measurement of how much work a software team can complete, based on similar work completed in previous iterations

Being affected by SRE toil? We define what SRE toil is, discuss how it can adversely affect your productivity, and tell you the best techniques to reduce it.

Wondering about severity levels? We explain what incident severity levels are, how to classify them, and how they will affect your incident management process.

Alert fatigue is the phenomenon of employees becoming desensitized to alert messages because of the overwhelming volume and number of false positives received.

Wondering about Cloud-Native Development? We explain what cloud-native development is and how it can help build fast and reliable applications.

As organizations progress in their reliability journey, they may build a dedicated team of site reliability engineers. This team can be structured in two major ways: a distributed model, where SREs are embedded in each project team, providing guidance and support for that team; and a centralized model, where one team provides infrastructure and processes for the entire organization. Most structures will be some combination of these ideas, with some SREs focusing on specific projects and other SRE projects completed as an SRE team.

Curious about microservice architecture? We explain what microservice architecture is, and how it can be used to quickly produce reliable lightweight applications.

Learn how to resist the urge to self-blame as an SRE by understanding the downsides and discovering how to be self-compassionate.

Are you an MS Teams shop that wants to level up your incident resolution strategy? Blameless has you covered. Learn all about our MS Teams integration.

DevOps tools play many important roles in modern business. Keep reading to discover 26 useful tools SaaS companies love in 2023.

Why manually work through a runbook when a computer can do it? We’ll give you the best tips for automating runbooks for speed and consistency in this blog!

Blameless now integrates with OpsGenie to further automate your incident response process. Determine service ownership instantly!

As responding to incidents becomes both more complex and important, how do you leverage tools to bridge the gap?

The integration between Blameless and Microsoft Teams is significant for our customers, because it enhances their main line of communication during the most pressing moments of incident response. Directly from Microsoft Teams, an on-call engineer initiates an incident, notifies stakeholders, and orchestrates rapid response, all while automatically collecting each event or “touch” that adds value to the retrospective (postmortem) for learning.

Distributed software systems have many points of failure. Can the process of chaos engineering help identify problems and gauge resiliency?

Blameless released a new integration to ServiceNow’s incident management ticketing solution. If you are a DevOps team moving towards SRE, this is worth a look.

Wondering about DevOps monitoring tools? We explain what DevOps monitoring is, the tools you need, how they work, and their pros and cons.

Wondering about SRE Tools? We explain the best tools for every step of the SRE development process.