CRISP: Critical Path Analysis of Microservice Traces

This repo contains code to compute and present critical path summary from Jaeger microservice traces. To use first collect the microservice traces of a specific endpoint in a directory (say traces). Let the traces be for OP operation and SVC service (these are Jaeger termonologies). python3 process.py --operationName OP --serviceName SVC -t <path to trace> -o . --parallelism 8 will produce the critical path summary using 8 concurrent processes. The summary will be output in the current directory as an HTML file with a heatmap, flamegraph, and summary text in criticalPaths.html. It will also produce three flamegraphs flame-graph-*.svg for three different percentile values.

The script accepts the following options:

python3 process.py --help
usage: process.py [-h] -a OPERATIONNAME -s SERVICENAME [-t TRACEDIR] [--file FILE] -o OUTPUTDIR
                  [--parallelism PARALLELISM] [--topN TOPN] [--numTrace NUMTRACE] [--numOperation NUMOPERATION]

optional arguments:
  -h, --help            show this help message and exit
  -a OPERATIONNAME, --operationName OPERATIONNAME
                        operation name
  -s SERVICENAME, --serviceName SERVICENAME
                        name of the service
  -t TRACEDIR, --traceDir TRACEDIR
                        path of the trace directory (mutually exclusive with --file)
  --file FILE           input path of the trace file (mutually exclusivbe with --traceDir)
  -o OUTPUTDIR, --outputDir OUTPUTDIR
                        directory where output will be produced
  --parallelism PARALLELISM
                        number of concurrent python processes.
  --topN TOPN           number of services to show in the summary
  --numTrace NUMTRACE   number of traces to show in the heatmap
  --numOperation NUMOPERATION
                        number of operations to show in the heatmap

CRISP: Critical Path Analysis of Microservice Traces

Related tags

Overview

CRISP: Critical Path Analysis of Microservice Traces

Owner

Uber Research

Automated Exploration Data Analysis on a financial dataset

Hangar is version control for tensor data. Commit, branch, merge, revert, and collaborate in the data-defined software era.

Ejercicios Panda usando Pandas

Pipetools enables function composition similar to using Unix pipes.

A Python module for clustering creators of social media content into networks

A simplified prototype for an as-built tracking database with API

NumPy aware dynamic Python compiler using LLVM

Created covid data pipeline using PySpark and MySQL that collected data stream from API and do some processing and store it into MYSQL database.

PipeChain is a utility library for creating functional pipelines.

A set of tools to analyse the output from TraDIS analyses

ToeholdTools is a Python package and desktop app designed to facilitate analyzing and designing toehold switches, created as part of the 2021 iGEM competition.

The OHSDI OMOP Common Data Model allows for the systematic analysis of healthcare observational databases.

🌍 Create 3d-printable STLs from satellite elevation data 🌏

Orchest is a browser based IDE for Data Science.

An implementation of the largeVis algorithm for visualizing large, high-dimensional datasets, for R

ELFXtract is an automated analysis tool used for enumerating ELF binaries

This program analyzes a DNA sequence and outputs snippets of DNA that are likely to be protein-coding genes.

pandas: powerful Python data analysis toolkit

Building house price data pipelines with Apache Beam and Spark on GCP

Datashader is a data rasterization pipeline for automating the process of creating meaningful representations of large amounts of data.