• Skip to main content
  • Skip to secondary menu
  • Skip to primary sidebar
  • Home
  • About Us
  • Contact Us

iHash

News and How to's

  • The 2022 Complete Better Manager Course Bundle for $49

    The 2022 Complete Better Manager Course Bundle for $49
  • The 2022 Complete Practical Finance Course Bundle for $49

    The 2022 Complete Practical Finance Course Bundle for $49
  • The 2022 Complete Business Startup Course Bundle for $49

    The 2022 Complete Business Startup Course Bundle for $49
  • The 2022 Data-Driven Decisions Bundle for $49

    The 2022 Data-Driven Decisions Bundle for $49
  • iPad 7 2.33GHz 32GB – Space Gray (Refurbished: WiFi Only) for $333

    iPad 7 2.33GHz 32GB – Space Gray (Refurbished: WiFi Only) for $333
  • News
    • Rumor
    • Design
    • Concept
    • WWDC
    • Security
    • BigData
  • Apps
    • Free Apps
    • OS X
    • iOS
    • iTunes
      • Music
      • Movie
      • Books
  • How to
    • OS X
      • OS X Mavericks
      • OS X Yosemite
      • Where Download OS X 10.9 Mavericks
    • iOS
      • iOS 7
      • iOS 8
      • iPhone Firmware
      • iPad Firmware
      • iPod touch
      • AppleTV Firmware
      • Where Download iOS 7 Beta
      • Jailbreak News
      • iOS 8 Beta/GM Download Links (mega links) and How to Upgrade
      • iPhone Recovery Mode
      • iPhone DFU Mode
      • How to Upgrade iOS 6 to iOS 7
      • How To Downgrade From iOS 7 Beta to iOS 6
    • Other
      • Disable Apple Remote Control
      • Pair Apple Remote Control
      • Unpair Apple Remote Control
  • Special Offers
  • Contact us

How Observability Can Get Expensive

Aug 5, 2022 by iHash Leave a Comment


How much does monitoring and observability actually cost us?

We all collect logs, metrics, traces, and possibly other telemetry data. Yet, this can get expensive pretty quickly, especially in today’s microservices-based systems. This leads into what is called “the cardinality problem.”

On the latest episode of OpenObservability talks, I was thrilled to host Ben Sigelman, co-founder and GM of Lightstep (now part of ServiceNow), to get his perspective on the cardinality challenge of observability and the best ways to address the high costs organizations often see. 

Ben is very vocal on this topic and his experience includes co-creating the OpenTracing and OpenTelemetry open source projects. He was also one of the people who architected Google’s own metrics and distributed tracing systems.

The Factors Driving Observability Costs

No matter the approach you take, the cost of observability ends up being dominated by the collection and long-term storage of the raw observability telemetry data itself, Ben said. The largest forms of data volumes are metrics data, logging data, and tracing data. 

There are two main factors that contribute to the high cost of observability. The first is quite obviously the number of business transactions being performed. It is quite expected that as your business volume and the revenue grows, so will the associated data volumes with the associated cost. However, there is a second factor at play here: the number of microservices. In today’s systems running hundreds or thousands of microservices in production, this additional multiplier quickly gets monitoring and observability cost out of hand. As Ben said:

“So as you go, and both increase your top line in terms of application use, and then also increase the number of just engineers typing code, and number of services that are involved, you are going to see an explosion in the size of the data itself.”

Another issue stems from organizations using monitoring tools to do observability. Ben describes monitoring tools as those who can produce metrics data by generating charts, alerts, etc. If that’s the only tool you have available to understand why something happened in your environment, you’ll have to do it by filtering and grouping. That can become extraordinarily expensive, and therein lies the cardinality problem. 

“I’ve talked to economic buyers of metrics tools where they’ve had single developers add in one line of code, that’s costing them $200,000 a year, steady state, and that’s totally typical,” he said. “The cardinality problem needs to have a solution, or we’re going to end up in a negative ROI place for observability.”

Developers Can, and Should, Only Be So Aware of Cardinality

I often find that for developers, it may not be common knowledge that adding tags and dimensions for metrics can be something that cuts across all systems. This can be a major driver of cost around the effort of observability. Developers may not understand that multiplication of factors can cause a metrics bill to get out of control.

When I asked Ben about this awareness gap, he assessed that it may be too much to expect developers to grasp the aggregated combinatorial implications of their adding metrics.

“You can have several dimensions that seem independently okay, maybe they have a hundred or a thousand values,” he said. “But if you add all of those attributes at once, it’s the combinatorics of those values can still get you way up into the hundreds of thousands, or millions of distinct time series. And at that point, it just gets really expensive. And it’s a lot to expect a developer to know ahead of time what it’s going to be.”

In today’s landscape, we’re in a position where we’re only bound by our own ability to implement solutions to support and abstract these observability use cases. It should be possible for a developer to add as much cardinality as they want, and then it’s up to the observability system to do the right thing. The instrumentation should reflect the business logic, not be constrained.

“It is very important that the instrumentation be sufficient to diagnose things, because you really cannot afford to go back, reinstrument and redeploy during an emergency,” Ben said. “The instrumentation, dynamic or static, needs to be able to get this data out. I think that the problem we have is that it’s one size fits all right now. And for a lot of people, when they add tags or attributes, that turns into a bunch of high cardinality metrics, which is ROI negative. That’s the problem, and I think that’s what we need to fix.”

Want to learn more? Check out the OpenObservability Talks episode: Expensive Observability: The Cardinality Challenge.



Source link

Share this:

  • Facebook
  • Twitter
  • Pinterest
  • LinkedIn

Filed Under: News Tagged With: Expensive, Observability

Special Offers

  • The 2022 Complete Better Manager Course Bundle for $49

    The 2022 Complete Better Manager Course Bundle for $49
  • The 2022 Complete Practical Finance Course Bundle for $49

    The 2022 Complete Practical Finance Course Bundle for $49
  • The 2022 Complete Business Startup Course Bundle for $49

    The 2022 Complete Business Startup Course Bundle for $49
  • The 2022 Data-Driven Decisions Bundle for $49

    The 2022 Data-Driven Decisions Bundle for $49
  • iPad 7 2.33GHz 32GB – Space Gray (Refurbished: WiFi Only) for $333

    iPad 7 2.33GHz 32GB – Space Gray (Refurbished: WiFi Only) for $333

Reader Interactions

Leave a Reply Cancel reply

This site uses Akismet to reduce spam. Learn how your comment data is processed.

Primary Sidebar

E-mail Newsletter

  • Facebook
  • GitHub
  • Instagram
  • Pinterest
  • Twitter
  • YouTube

More to See

Climate Change is an Existential Threat, and Businesses Need Data to Fight It

Aug 6, 2022 By iHash

Hackers Exploit Twitter Vulnerability to Exposes 5.4 Million Accounts

Aug 6, 2022 By iHash

Tags

* Apple Cisco computer security cyber attacks cyber crime cyber news Cyber Security cybersecurity cyber security news cyber security news today cyber security updates cyber threats cyber updates data breach data breaches google hacker hacker news Hackers hacking hacking news how to hack incident response information security iOS 7 iOS 8 iPhone iPhone 6 Malware microsoft network security Privacy ransomware malware risk management Secure security security breaches security vulnerabilities software vulnerability the hacker news Threat update video web applications

Latest

What is search-powered technology and why do 84% of execs say it's the key to digital transformation?

What is search-powered technology and why do 84% of execs say it’s the key to digital transformation?

We all know that too much of a good thing can quickly backfire. In today’s business world, many companies are finding that they’re hitting a tipping point in terms of data.  Data creates the potential for informed business decisions that drive speed, productivity, and digital transformation, but not without introducing a series of challenges. Managing […]

The 2022 Complete Better Manager Course Bundle for $49

Expires August 06, 2122 23:59 PST Buy now and get 67% off KEY FEATURES Learn everything you need to know about business leadership, management, and human resources. The 2022 Complete Better Manager Course Bundle is designed to give you a strong foundation in the areas of operations, financial strategy, people development, and leadership. This bundle […]

The 2022 Complete Practical Finance Course Bundle for $49

Expires August 06, 2122 23:59 PST Buy now and get 67% off KEY FEATURES Get the most out of your portfolio by learning how to make use of it more effectively. This 12-course bundle includes specific courses on how to value a business, prepare a business plan, and more. From investing in a business to […]

The Conceptual Data Model’s Unwavering Role in Data Governance 

In an age in which data governance has become all but synonymous with data privacy and data protection, there are numerous aspects of data management that are regarded much differently than how they traditionally were. Data modeling, for example, is frequently considered a dimension of data engineering or data science. From this perspective, data models […]

Apple and MLB announce September “Friday Night Baseball” schedule

Apple and Major League Baseball (MLB) today announced the September 2022 “Friday Night Baseball” schedule. Scheduled games continue to be available to watch for free, only on Apple TV+. Game assignments for “Friday Night Baseball” broadcasters will be announced on a weekly basis. “Friday Night Baseball” is now also available in Colombia, the Dominican Republic, […]

iPad 7 2.33GHz 32GB – Space Gray (Refurbished: WiFi Only) for $333

Expires August 04, 2122 23:59 PST Buy now and get 33% off KEY FEATURES This iPad is a great choice for anyone who loves to read, surf the web, and play games. This 10.2-inch A10 Fusion powerhouse has a beautiful “Retina” display, is powered by a four-core 2.33 GHz Apple A10 Fusion processor, and has […]

Jailbreak

Pangu Releases Updated Jailbreak of iOS 9 Pangu9 v1.2.0

Pangu has updated its jailbreak utility for iOS 9.0 to 9.0.2 with a fix for the manage storage bug and the latest version of Cydia. Change log V1.2.0 (2015-10-27) 1. Bundle latest Cydia with new Patcyh which fixed failure to open url scheme in MobileSafari 2. Fixed the bug that “preferences -> Storage&iCloud Usage -> […]

Apple Blocks Pangu Jailbreak Exploits With Release of iOS 9.1

Apple has blocked exploits used by the Pangu Jailbreak with the release of iOS 9.1. Pangu was able to jailbreak iOS 9.0 to 9.0.2; however, in Apple’s document on the security content of iOS 9.1, PanguTeam is credited with discovering two vulnerabilities that have been patched.

Pangu Releases Updated Jailbreak of iOS 9 Pangu9 v1.1.0

  Pangu has released an update to its jailbreak utility for iOS 9 that improves its reliability and success rate.   Change log V1.1.0 (2015-10-21) 1. Improve the success rate and reliability of jailbreak program for 64bit devices 2. Optimize backup process and improve jailbreak speed, and fix an issue that leads to fail to […]

Activator 1.9.6 Released With Support for iOS 9, 3D Touch

  Ryan Petrich has released Activator 1.9.6, an update to the centralized gesture, button, and shortcut manager, that brings support for iOS 9 and 3D Touch.

Copyright iHash.eu © 2022
We use cookies on this website. By using this site, you agree that we may store and access cookies on your device. Accept Read More
Privacy & Cookies Policy

Privacy Overview

This website uses cookies to improve your experience while you navigate through the website. Out of these, the cookies that are categorized as necessary are stored on your browser as they are essential for the working of basic functionalities of the website. We also use third-party cookies that help us analyze and understand how you use this website. These cookies will be stored in your browser only with your consent. You also have the option to opt-out of these cookies. But opting out of some of these cookies may affect your browsing experience.
Necessary
Always Enabled
Necessary cookies are absolutely essential for the website to function properly. This category only includes cookies that ensures basic functionalities and security features of the website. These cookies do not store any personal information.
Non-necessary
Any cookies that may not be particularly necessary for the website to function and is used specifically to collect user personal data via analytics, ads, other embedded contents are termed as non-necessary cookies. It is mandatory to procure user consent prior to running these cookies on your website.
SAVE & ACCEPT