Math In Big Systems

6000107052

2015-11-24T12:34:26-05:00

6000210337

false

Tech Talks 3

2015-11-24T12:34:37-05:00

2015-08-18T14:06:17-04:00

by Theo Schlossnagle At LISA14, our CEO presented what we’ve been doing in the realm of automatic anomaly detection on high-frequency time-series data; an otherwise dry subject was cordially delivered by Theo and very well received.

<div> <div> by Theo Schlossnagle <iframe width="560" height="315" src="https://www.youtube.com/embed/3-L5NC5OQkM" frameborder="0" allowfullscreen=""></iframe> At LISA14, our CEO presented what we’ve been doing in the realm of automatic anomaly detection on high-frequency time-series data; an otherwise dry subject was cordially delivered by Theo and very well received. </div> </div>

6000210337

140 6000044568

2016-06-12T22:55:16-04:00

6003235491

Math In Big Systems

2016-06-12T22:26:50-04:00

6003235491

2015-08-18T14:17:57-04:00

The Architecture of a Distributed Analytics and Storage Engine for Massive Time-Series Data by Theo Schlossnagle The numerical analysis of time-series data isn't new. The scale of today's problems is. With millions of concurrent data streams, some of which run at 1MM samples per second, the challenge of storing the data and making it continuously available for analysis is a daunting challenge.

The Architecture of a Distributed Analytics and Storage Engine for Massive Time-Series Data by Theo Schlossnagle <iframe width="560" height="315" src="https://www.youtube.com/embed/hwHpd20NciE" frameborder="0" allowfullscreen=""></iframe> The numerical analysis of time-series data isn't new. The scale of today's problems is. With millions of concurrent data streams, some of which run at 1MM samples per second, the challenge of storing the data and making it continuously available for analysis is a daunting challenge.

6000210337

249 6000044580

2015-08-18T14:25:45-04:00

Architecture of an Analytics and Storage Engine for Time Series Data

2015-11-24T12:40:51-05:00

6002695175

2015-08-18T14:24:56-04:00

How Do You Eat An Elephant? - RICON East 2013 by Theo Schlossnagle & Robert Treat When OmniTI first set out to build a next generation monitoring system, we turned to one of our most trusted tools for data management; Postgres. While this worked well for developing the initial Open Source application, as we continued to grow the Circonus public monitoring service, we eventually ran into scaling issues. This talk will cover some of the changes we made to make the original Postgres system work better, talk about some of the other systems we evaluated, and discuss the eventual solution to our problem; building our own time series database. Of course, that's only half the story. We'll also go into how we swapped out these backend data storage pieces in our production environment, all the while capturing and reporting on millions of metrics, without downtime or customer interruption.

How Do You Eat An Elephant? - RICON East 2013 by Theo Schlossnagle & Robert Treat <iframe width="560" height="315" src="https://www.youtube.com/embed/dllla97nE60" frameborder="0" allowfullscreen=""></iframe> When OmniTI first set out to build a next generation monitoring system, we turned to one of our most trusted tools for data management; Postgres. While this worked well for developing the initial Open Source application, as we continued to grow the Circonus public monitoring service, we eventually ran into scaling issues. This talk will cover some of the changes we made to make the original Postgres system work better, talk about some of the other systems we evaluated, and discuss the eventual solution to our problem; building our own time series database. Of course, that's only half the story. We'll also go into how we swapped out these backend data storage pieces in our production environment, all the while capturing and reporting on millions of metrics, without downtime or customer interruption.

6000210337

85 6000044587

2015-08-18T14:24:56-04:00

How Do You Eat An Elephant? - RICON East 2013

2015-11-24T12:41:06-05:00

6002695175

2015-11-19T18:02:01-05:00

Surge 2013 Speaker: Theo Schlossnagle Closing remarks from Surge 2013.

Surge 2013 Speaker: Theo Schlossnagle <iframe width="560" height="315" src="https://www.youtube.com/embed/EiZ-L0cosqU" frameborder="0" allowfullscreen=""></iframe> Closing remarks from Surge 2013.

6000210337

44 6000090378

2015-11-19T18:02:01-05:00

6003235491

Surge 2013 Speaker: Theo Schlossnagle

2015-11-24T12:41:18-05:00

6003235491

2015-11-19T18:17:05-05:00

Theo Schlossnagle - Node Summit 2012 - theCUBE The Cube - Node Summit 2012 - Theo Schlossnagle, Circonus, with John Furrier and Alex Williams Theo Schlossangle, the founder of service provider OmniIT and the CEO of Circonus, the maker of an app monitoring SaaS, attended this week’s Node Summit and gave his take on the value that can be found in Node.js, the open-source programming language that is the gathering’s main theme. He shared his insight at theCube with SiliconANGLE’s John Furrier and Alex Williams (see full interview below). Schlossangle summed up his hands-on experience with Node.js, which has been rather positive. His engineers discovered that it can help reduce the time it takes to complete projects, and there’s less maintenance required in the long run. He noted that simplicity is one of the major advantages of Node.js, which borrows a lot from JavaScript, and that this aspect is driving a lot of adoption among developers who seek to make their jobs somewhat easier. The industry veteran said that this very factor can solve a lot of tension between the front-end and backend of IT infrastructure. Schlossangle pointed out that software engineering best practices don’t always encompass how an app runs on an operational level; too often poorly, due to reasons such as tempered office culture and rivalry between different departments. Node.js offers a workaround for this category of broken code, at least to some extent. Sclossangle expanded on this, discussing the positive points of the Stanford-developed language. Scalability came up first, followed by the ability to run the same code on both the backend and frontend, though only a few companies have implemented this approach so far. Overall, he thinks of Node.js as a young ecosystem that’s likely to stick around, and see handsome growth in the future. It still needs to find a solid direction though, and mobile is a particularly strong candidate because of the way Node.js’s architecture works.

Theo Schlossnagle - Node Summit 2012 - theCUBE <iframe width="560" height="315" src="https://www.youtube.com/embed/qOpRgJyylnQ" frameborder="0" allowfullscreen=""></iframe> The Cube - Node Summit 2012 - Theo Schlossnagle, Circonus, with John Furrier and Alex Williams Theo Schlossangle, the founder of service provider OmniIT and the CEO of Circonus, the maker of an app monitoring SaaS, attended this week’s Node Summit and gave his take on the value that can be found in Node.js, the open-source programming language that is the gathering’s main theme. He shared his insight at theCube with SiliconANGLE’s John Furrier and Alex Williams (see full interview below). Schlossangle summed up his hands-on experience with Node.js, which has been rather positive. His engineers discovered that it can help reduce the time it takes to complete projects, and there’s less maintenance required in the long run. He noted that simplicity is one of the major advantages of Node.js, which borrows a lot from JavaScript, and that this aspect is driving a lot of adoption among developers who seek to make their jobs somewhat easier. The industry veteran said that this very factor can solve a lot of tension between the front-end and backend of IT infrastructure. Schlossangle pointed out that software engineering best practices don’t always encompass how an app runs on an operational level; too often poorly, due to reasons such as tempered office culture and rivalry between different departments. Node.js offers a workaround for this category of broken code, at least to some extent. Sclossangle expanded on this, discussing the positive points of the Stanford-developed language. Scalability came up first, followed by the ability to run the same code on both the backend and frontend, though only a few companies have implemented this approach so far. Overall, he thinks of Node.js as a young ecosystem that’s likely to stick around, and see handsome growth in the future. It still needs to find a solid direction though, and mobile is a particularly strong candidate because of the way Node.js’s architecture works.

6000210337

61 6000090389

2015-11-19T18:17:05-05:00

6003235491

Theo Schlossnagle - Node Summit 2012 - theCUBE

2015-11-24T12:41:32-05:00

6003235491

2015-08-18T14:21:33-04:00

Surge 2011 - Architectures for real-time data by Theo Schlossnagle At Circonus we process a lot of data. We learned early on that some data can be sampled and some data cannot. The way you treat data when you "need it all" to make good sense of things is radically different than the way you must treat sampled datapoints.

Surge 2011 - Architectures for real-time data by Theo Schlossnagle <iframe width="560" height="315" src="https://www.youtube.com/embed/OkUxOpSAqh0" frameborder="0" allowfullscreen=""></iframe> At Circonus we process a lot of data. We learned early on that some data can be sampled and some data cannot. The way you treat data when you "need it all" to make good sense of things is radically different than the way you must treat sampled datapoints.

6000210337

83 6000044584

2015-08-18T14:25:26-04:00

Surge 2011 - Architectures for real-time data

2015-11-24T12:41:41-05:00

6002695175

2015-11-19T18:19:09-05:00

Surge 2011 ~ Building a Real-Time Cloud Analytics Service with Node.js We present our experience designing, implementing, and deploying a Node.js-based distributed system for analyzing system and application performance across a datacenter. Our system's design, and particularly the choice of programming environment, were driven by our goals of supporting real-time analysis of problems spanning hundreds of production systems, which requires that the system deal with large volumes of data with very low latency. We will briefly discuss these considerations and why we chose Node.js for the implementation. We will then present our actual experience building and deploying the software, including topics of software development speed; availability of libraries and tools for development, testing, and verification; difficulties observing and debugging Node applications (especially post-mortem); packaging issues related to lack of C++ binary compatibility; and other development and deployment issues. Finally, we will close with a demonstration of the facility itself, and some discussions of the production pathologies that it has found—including the results of using the facility to analyze its own performance.

Surge 2011 ~ Building a Real-Time Cloud Analytics Service with Node.js <iframe width="560" height="315" src="https://www.youtube.com/embed/iqzKBvQcHps" frameborder="0" allowfullscreen=""></iframe> We present our experience designing, implementing, and deploying a Node.js-based distributed system for analyzing system and application performance across a datacenter. Our system's design, and particularly the choice of programming environment, were driven by our goals of supporting real-time analysis of problems spanning hundreds of production systems, which requires that the system deal with large volumes of data with very low latency. We will briefly discuss these considerations and why we chose Node.js for the implementation. We will then present our actual experience building and deploying the software, including topics of software development speed; availability of libraries and tools for development, testing, and verification; difficulties observing and debugging Node applications (especially post-mortem); packaging issues related to lack of C++ binary compatibility; and other development and deployment issues. Finally, we will close with a demonstration of the facility itself, and some discussions of the production pathologies that it has found—including the results of using the facility to analyze its own performance.

6000210337

27 6000090391

2015-11-19T18:19:09-05:00

6003235491

Surge 2011 ~ Building a Real-Time Cloud Analytics Service with Node.js

2015-11-24T12:41:50-05:00

6003235491

2015-11-19T18:06:46-05:00

Surge 2011 ~ Closing Plenary ~ Theo Schlossnagle

Surge 2011 ~ Closing Plenary ~ Theo Schlossnagle <iframe width="560" height="315" src="https://www.youtube.com/embed/ieCTIPG43no" frameborder="0" allowfullscreen=""></iframe>

6000210337

19 6000090383

2015-11-19T18:06:46-05:00

6003235491

Surge 2011 ~ Closing Plenary ~ Theo Schlossnagle

2015-11-24T12:42:01-05:00

6003235491

2015-11-19T18:09:03-05:00

AppNexus Engineering@Scale: Building and Shipping a Scalable Product

AppNexus Engineering@Scale: Building and Shipping a Scalable Product <iframe width="560" height="315" src="https://www.youtube.com/embed/ZjtN_f_B1UU" frameborder="0" allowfullscreen=""></iframe>

6000210337

34 6000090385

2015-11-19T18:09:03-05:00

6003235491

Engineering at Scale: Building and Shipping a Scalable Product

2015-11-24T12:42:15-05:00

6003235491

2015-11-19T18:11:45-05:00

The InstallShield of the 21st Century - Theo Schlossnagle Today's systems are complex and the most successful products are SaaS. When you need to ship a SaaS architecture to someone (private SaaS) there are a lot of moving parts to install and maintain. I'll talk about what we do at Circonus to provide our complex software stack on large clusters on-premise using Chef as the orchestration framework. Follow along with the slideshow here.

The InstallShield of the 21st Century - Theo Schlossnagle <iframe width="560" height="315" src="https://www.youtube.com/embed/TkffUcBNZx0" frameborder="0" allowfullscreen="" sandbox="allow-scripts allow-forms allow-same-origin allow-presentation"></iframe> Today's systems are complex and the most successful products are SaaS. When you need to ship a SaaS architecture to someone (private SaaS) there are a lot of moving parts to install and maintain. I'll talk about what we do at Circonus to provide our complex software stack on large clusters on-premise using Chef as the orchestration framework. Follow along with the slideshow <a href="6000090703-the-installshield-of-the-21st-century-theo-schlossnagle">here</a>.

6000210337

34 6000090387

2017-09-20T16:40:06-04:00

6003235491

The InstallShield of the 21st Century - Theo Schlossnagle

2015-11-24T12:42:25-05:00

6003235491

2015-12-03T10:58:37-05:00

Surge 2015 - Eric Sproul - SaaS for the Enterprise Circonus is a comprehensive monitoring and analytics platform, available as public SaaS to anyone or as private SaaS for enterprises with on-premise requirements. The platform is available on OmniOS or Linux, using a complex stack of hundreds of individual software packages. Managing and packaging Circonus for continuous delivery require extensive automation, rigid control over proprietary and open-source software components, and creative use of configuration management tools to consistently deliver software across multiple platforms.

Surge 2015 - Eric Sproul - SaaS for the Enterprise <iframe width="560" height="315" src="https://www.youtube.com/embed/yrGVltow1wA" frameborder="0" allowfullscreen=""></iframe> Circonus is a comprehensive monitoring and analytics platform, available as public SaaS to anyone or as private SaaS for enterprises with on-premise requirements. The platform is available on OmniOS or Linux, using a complex stack of hundreds of individual software packages. Managing and packaging Circonus for continuous delivery require extensive automation, rigid control over proprietary and open-source software components, and creative use of configuration management tools to consistently deliver software across multiple platforms.

6000210337

25 6000093922

2015-12-03T10:59:53-05:00

6003235491

Surge 2015 - Eric Sproul - SaaS for the Enterprise

2015-12-03T10:58:37-05:00

6003235491

2016-07-08T18:09:27-04:00

Monitorama PDX 2016 - Heinrich Hartmann - Statistics for Engineers from Monitorama on Vimeo. See the video above of Heinrich Hartmann's presentation on "Statistics for Engineers" at Monitorama PDX 2016. You can also follow along with the video with the slide show below: Statistics for Engineers from Heinrich Hartmann

<div dir="ltr"> <div> <div> <a href="https://vimeo.com/173610069" style="color: rgb(0, 64, 128); background-color: rgb(255, 255, 255);">Monitorama PDX 2016 - Heinrich Hartmann - Statistics for Engineers</a> from <a href="https://vimeo.com/monitorama" style="background-color: rgb(255, 255, 255);">Monitorama</a> on <a href="https://vimeo.com/" style="background-color: rgb(255, 255, 255);">Vimeo</a>. </div> <div> </div> <iframe src="https://player.vimeo.com/video/173610069?portrait=0" width="640" height="360" frameborder="0" allowfullscreen=""></iframe> See the video above of Heinrich Hartmann's presentation on "Statistics for Engineers" at Monitorama PDX 2016. You can also follow along with the video with the slide show below: <a href="https://www.slideshare.net/HeinrichHartmann/statistics-for-engineers-63589022" title="Statistics for Engineers" target="_blank" style="font-size: 13px;">Statistics for Engineers</a> from <a href="https://www.slideshare.net/HeinrichHartmann" target="_blank" style="font-size: 13px;">Heinrich Hartmann</a> </div> <iframe src="//www.slideshare.net/slideshow/embed_code/key/svnT3SBscPSFJP" width="595" height="485" frameborder="0" style="border:1px solid #CCC; border-width:1px; margin-bottom:5px; max-width: 100%;" allowfullscreen=""> </iframe> <div style="margin-bottom:5px"> </div> </div>

6000210337

209 6000138394

2016-07-20T11:01:29-04:00

6003235491

Monitorama PDX 2016 - Heinrich Hartmann - Statistics for Engineers

2016-07-08T18:09:27-04:00

6003235491

2017-06-09T18:18:00-04:00

Theo Schlossnagle takes us on a whirlwind tour through the world of web operations and tries to get a handle on both why it is a challenging occupation and how to be better

6000210337

16 24000009687

2017-10-13T12:37:43-04:00

6003235491

Velocity Europe, Theo Schlossnagle, "A Career in Web Operations"

2017-06-09T18:18:00-04:00

6003235491

2017-07-28T15:44:35-04:00

In this video podcast, Circonus Founder and CEO Theo Schlossnagle sits down with special guest, Mark Lavi, DevOps Specialist SE at Nutanix, to discuss challenges facing the industry and their own approaches to the solutions. How does a DevOps team build and support a system designed for scale?

6000210337

23 24000012448

2017-07-28T15:44:35-04:00

6003235491

Systems Designed for Scale with Theo and Mark

2017-07-28T15:44:35-04:00

6003235491

2017-08-16T16:08:12-04:00

In this video podcast, Circonus Founder and CEO Theo Schlossnagle sits down with special guest, Circonus Vice President of Engineering, Riley Berton, to discuss the design of IRONdb, the durable, scalable time-series database used by Circonus.

6000210337

43 24000013533

2017-08-17T15:54:31-04:00

6003235491

IRONdb: The Solution to Limited TSDB Scalability & Performance

2017-08-16T16:08:12-04:00

6003235491

2017-09-12T08:39:32-04:00

In this presentation we re-examine monitoring to understand how to formulate valuable goals and align monitoring design and implementation with those goals. With a focus on outcomes and behavior that leads to outcomes we'll focus on performance data and not security monitoring. Viewers will learn to ask the right questions when approaching the monitoring of systems and businesses. They will understand why and how monitoring should fit into the overall systems architecture to reduce risk and increase value. This presentation talks about three topics related to monitoring. The first is a brief history and future forecast of monitoring trends. The second is a second look at the inputs, outputs, and techniques for setting SLOs. The third sets some basic tenets one should always follow when monitoring systems. You can follow along with the slideshow here. It may help to play the video in a separate tab. Monitoring 101 from Theo Schlossnagle

<div style="margin-bottom:5px"><a href="//www.slideshare.net/postwait/monitoring-101-79494722" target="_blank" title="Monitoring 101"></a></div><iframe width="560" height="315" src="https://www.youtube.com/embed/qh4hLIWqw6Q" frameborder="0" allowfullscreen="" sandbox="allow-scripts allow-forms allow-same-origin allow-presentation"></iframe> In this presentation we re-examine monitoring to understand how to formulate valuable goals and align monitoring design and implementation with those goals. With a focus on outcomes and behavior that leads to outcomes we'll focus on performance data and not security monitoring. Viewers will learn to ask the right questions when approaching the monitoring of systems and businesses. They will understand why and how monitoring should fit into the overall systems architecture to reduce risk and increase value. This presentation talks about three topics related to monitoring. The first is a brief history and future forecast of monitoring trends. The second is a second look at the inputs, outputs, and techniques for setting SLOs. The third sets some basic tenets one should always follow when monitoring systems. You can follow along with the slideshow here. It may help to play the video in a separate tab. <div style="margin-bottom:5px"> <a href="//www.slideshare.net/postwait/monitoring-101-79494722" target="_blank" title="Monitoring 101">Monitoring 101</a> from <a href="https://www.slideshare.net/postwait" target="_blank">Theo Schlossnagle</a> </div><iframe src="//www.slideshare.net/slideshow/embed_code/key/w9YLvMSjaQMybx" width="595" height="485" frameborder="0" style="border:1px solid #CCC; border-width:1px; margin-bottom:5px; max-width: 100%;" allowfullscreen="" sandbox="allow-scripts allow-forms allow-same-origin allow-presentation"></iframe>

6000210337

23 24000014639

2017-09-22T11:27:55-04:00

6003235491

Monitoring 101

2017-09-22T11:30:10-04:00

6003235491

2017-09-12T08:41:05-04:00

A tour of challenges today's software engineers will face, and material they should familiarize themselves with to cope with the issues that arise due to the distributed nature of today's applications. Over the last twenty years, complex distributed systems have been deployed to solve the leading challenges in the systems resiliency and robustness realm. At this point in systems architecture design, distributed systems are everywhere in everything; even the most simple architectures incorporate distributed software and carry with that the failure scenarios they bring. SREs are put in an even more complicated situation, because of their wide net or responsibilities, to manage distributed systems of distributed systems. Things can and will go wrong and one of the fundamental skills for SREs going forward will be strong distributed systems reasoning skills. In this talk we discuss the types of failure scenarios that distributed systems bring with them (with anecdotes) and develop various reasoning skills that can be used to tackle these challenges with increased confidence. You can follow along with the slide show here. It may help to play the video in a separate tab. Distributed Systems - Like It Or Not from Theo Schlossnagle

6000210337

21 24000014640

2017-09-22T11:29:43-04:00

6003235491

Distributed Systems - Like It Or Not

2017-09-22T11:30:10-04:00

6003235491

2018-04-16T17:15:50-04:00

Fred Moyer discusses the Grafana Datasource Plugin for the IRONdb Time Series Database at GrafanaCon EU 2018.

6000210337

30 24000024033

2018-04-16T17:15:50-04:00

6003235491

IRONdb at GrafanaCon 2018

2018-04-16T17:15:50-04:00

6003235491