Blog
Data Quality Power Moves: Scorecards & Data Checks for Organizational Impact
Webinar: Unlocking the Power of Data Observability and Quality Testing
From Cattle to Clarity: Visualizing Thousands of Data Pipelines with Violin Charts
What do you do when you have thousands of data pipelines in production? Is there a way that you can visualize what is happening in production quickly and easily?
What is a DataOps Engineer?
A DataOps Engineer owns the assembly line that's used to build a data and analytic product. Data operations (or data production) is a series of pipeline procedures that take raw data, progress through a series of processing and transformation steps, and output...
Start DataOps Today with ‘Lean DataOps’
Data organizations don’t always have the budget or schedule required for DataOps when conceived as a top-to-bottom, enterprise-wide transformational change. An essential part of the DataOps methodology is Agile Development, which breaks development into incremental...
DataOps is the Factory that Supports Your Data Mesh
Below is our final post (5 of 5) on combining data mesh with DataOps to foster innovation while addressing the challenges of a data mesh decentralized architecture. We see a DataOps process hub like the DataKitchen Platform playing a central supporting role in...
Implementing a Pharma Data Mesh using DataOps
Below is our fourth post (4 of 5) on combining data mesh with DataOps to foster innovation while addressing the challenges of a decentralized architecture. We’ve covered the basic ideas behind data mesh and some of the difficulties that must be managed. Below is a...
A Day in the Life of a DataOps Engineer
Accelerating Drug Discovery and Development with DataOps
A drug company tests 50,000 molecules and spends a billion dollars or more to find a single safe and effective medicine that addresses a substantial market. Figure 1 shows the 15-year cycle from screening to government agency approval and phase IV trials. Drug...
Addressing Data Mesh Technical Challenges with DataOps
Below is our third post (3 of 5) on combining data mesh with DataOps to foster greater innovation while addressing the challenges of a decentralized architecture. We’ve talked about data mesh in organizational terms (see our first post, “What is a Data Mesh?”) and how...
Use DataOps With Your Data Mesh to Prevent Data Mush
In our last post, we summarized the thinking behind the data mesh design pattern. In this post (2 of 5), we will review some of the ideas behind data mesh, take a functional look at data mesh and discuss some of the challenges of decentralized enterprise architectures...
What is a Data Mesh?
The data mesh design pattern breaks giant, monolithic enterprise data architectures into subsystems or domains, each managed by a dedicated team. With an architecture comprised of numerous domains, enterprises need to manage order-of-operations issues, inter-domain...
Using DataOps to Drive Agility & Business Value
In May 2021 at the CDO & Data Leaders Global Summit, DataKitchen sat down with the following data leaders to learn how to use DataOps to drive agility and business value. Kurt Zimmer, Head of Data Engineering for Data Enablement at AstraZeneca Ryan Chapin, Former...