In Gartner’s recent write up for technical professionals, “2020 Planning Guide for Data Management“, they highlight 10 critical trends for 2020. The most exciting one for us at DataKitchen is #10, DataOps.
We are most excited that Gartner is advocating the need for a DataOps Platform: “Select a DataOps platform to integrate functions that support rapid deployment and governance.” As a provider of a DataOps platform, we are biased, but could not agree more!
For the first time, Gartner describes the architectural components of a DataOps Platform. You can learn more by following this LinkedIn post and reading the the 2020 Planning Guide for Data Management.
The document expresses ideas similar to what we have written in about in our blog and white papers. I wanted to highlight a few key points and use them as jumping-off points to our writings and features that we have built-in our product.
- “…, test, monitor, … and alert for failure … Detect data drift automatically”:
- “Capture metrics and reports at the right granularity”:
- “Provide Version Control”:
- “Manage .. metadata … and activity logs”:
- “Automate deployment of the code, frameworks, libraries and tools”
- “Create and maintain the environment … “
- “DataOps can span the entire gamut from data ingestion all the way to data delivery. This is a complex chain of components.”
We do feel very proud that one of our articles on DataOps Architecture has had some influence on Gartner. Check out the similarities below (one small nit: Gartner mixed up the order of Dev and QA environments).
Finally, we do have a bone to pick with the authors at Gartner. They said: “And because this is a nascent process, there are no end-to-end tools or products that provide an all-encompassing solution for DataOps.”