DataOps insights, data quality best practices, and product updates from DataKitchenhttps://datakitchen.io/https://datakitchen.io/blog/who-needs-a-third-manifesto/https://datakitchen.io/blog/who-needs-a-third-manifesto/Introducing the DataOps Quality Manifesto: Nobody's testing enough. Everyone's confused about what quality means, and our customers keep rolling their eyes at our errors.Tue, 06 Oct 2026 00:00:00 GMTChris Berghhttps://datakitchen.io/blog/discount-is-already-in-the-price/https://datakitchen.io/blog/discount-is-already-in-the-price/I didn't open high with procurement. Here's why. TestGen costs $100 per user and $100 per database connection per month, with no row limits and no volume tiers.Wed, 30 Sep 2026 00:00:00 GMTGil Benghiathttps://datakitchen.io/blog/everyone-in-data-80-percent-talking-to-a-language-model/https://datakitchen.io/blog/everyone-in-data-80-percent-talking-to-a-language-model/Within a year or two, engineers, ops, analysts, and the business users who read the output will work with data through a large language model most of the day. What that world looks like, the platform war underneath it, and why productivity in it is still a DataOps problem.Wed, 30 Sep 2026 00:00:00 GMTChris Berghhttps://datakitchen.io/blog/tested-15-million-pharma-payments-against-the-rules/https://datakitchen.io/blog/tested-15-million-pharma-payments-against-the-rules/Drug and device companies are allowed to pay physicians to consult, speak, and advise on their products, and every payment is reported to CMS. We took the whole 2024 file, 15.5 million rows, and checked it against the rules that govern it. Here is how good the data is.Fri, 25 Sep 2026 00:00:00 GMTChris Berghhttps://datakitchen.io/books/the-dataops-way-to-commercial-pharma-data/https://datakitchen.io/books/the-dataops-way-to-commercial-pharma-data/Launch faster, spend less, and trust the numbers. 25 chapters on why commercial pharma data fails the way it does, what a launch data platform has to deliver and when, and who should run it.Thu, 24 Sep 2026 00:00:00 GMTChris Berghhttps://datakitchen.io/blog/put-your-ai-at-the-center-of-your-data-quality-decisions/https://datakitchen.io/blog/put-your-ai-at-the-center-of-your-data-quality-decisions/A data quality test fails at 6am, and the information you need to fix it is spread across your catalog, your orchestrator, your lineage tool, your git repo, your ticketing system, and two people's heads. The quality of the decision tracks the context behind it. Only a central LLM, wired to every tool through MCP, can hold all of that context at once.Mon, 21 Sep 2026 00:00:00 GMTChris Berghhttps://datakitchen.io/blog/you-built-the-thing-now-youre-stuck-running-it/https://datakitchen.io/blog/you-built-the-thing-now-youre-stuck-running-it/Six months ago you couldn't write a line of SQL. Now you have 14 scripts, three dashboards, and a Veeva scoring app, and you dread Monday mornings. Building the thing is about 20% of the work. The other 80% is keeping it alive, and that part never ends. Vibe to Prod takes it off your desk without taking your code.Thu, 17 Sep 2026 00:00:00 GMTChris Berghhttps://datakitchen.io/blog/age-of-outsourcing-commercial-pharma-data-team-to-india-is-over/https://datakitchen.io/blog/age-of-outsourcing-commercial-pharma-data-team-to-india-is-over/Somewhere in your budget is a line for 20, 40, maybe 80 offshore developers, and for ten years the only lever on it was the hourly rate. That lever is spent. AI agents plus DataOps automation cut commercial data engineering labor by 70% or more, with fewer errors than the offshore team ever produced.Wed, 16 Sep 2026 00:00:00 GMTChris Berghhttps://datakitchen.io/blog/where-to-actually-start-with-dataops-in-2026/https://datakitchen.io/blog/where-to-actually-start-with-dataops-in-2026/Your customers are yelling at you for being too slow, and your team loses half its week to errors nobody planned for. Here's what to read, in what order, and the one thing to do before you read any of it.Tue, 15 Sep 2026 00:00:00 GMTChris Berghhttps://datakitchen.io/blog/testgen-onelake-medallion-architecture-testing/https://datakitchen.io/blog/testgen-onelake-medallion-architecture-testing/DataOps TestGen 5.92.1 connects to Microsoft OneLake through the Fabric SQL analytics endpoint. Here is what Microsoft's current medallion guidance says, why shortcuts, mirroring, and Direct Lake change where the tests go, and the four places to put them.Thu, 03 Sep 2026 00:00:00 GMTChris Berghhttps://datakitchen.io/blog/how-do-i-get-my-data-team-more-efficient/https://datakitchen.io/blog/how-do-i-get-my-data-team-more-efficient/Your team isn't slow, it's interrupted. Three routes to fewer unplanned Mondays: stop the errors, take the principles, rebuild only if it needs rebuilding. One of them you can start this week without asking anyone.Mon, 31 Aug 2026 00:00:00 GMTChris Berghhttps://datakitchen.io/blog/npi-ndc-icd-validation-tests/https://datakitchen.io/blog/npi-ndc-icd-validation-tests/Commercial pharma runs on a dozen special-format identifiers that generic profiling counts characters in and never validates. The new Commercial Pharma pack in TestGen Enterprise auto-generates twelve tests that check them the way their specs define them.Wed, 26 Aug 2026 00:00:00 GMTChris Berghhttps://datakitchen.io/blog/webinar-the-seven-deadly-sins-of-ai-generated-data-pipelines/https://datakitchen.io/blog/webinar-the-seven-deadly-sins-of-ai-generated-data-pipelines/On-demand webinar: seven ways AI-generated data pipelines break, each with its mechanism and its fix. Producing code got cheap. Verifying is where pipelines go to die.Mon, 17 Aug 2026 00:00:00 GMTChris Berghhttps://datakitchen.io/blog/seven-deadly-sins-of-ai-generated-data-pipelines/https://datakitchen.io/blog/seven-deadly-sins-of-ai-generated-data-pipelines/Producing code got cheap. Verifying it did not. Seven ways AI-generated pipelines break, each with its mechanism and its fix, and one rule holding them together.Sun, 16 Aug 2026 00:00:00 GMTChris Berghhttps://datakitchen.io/blog/data-quality-tests-3-million-nyc-taxi-rides-five-minutes/https://datakitchen.io/blog/data-quality-tests-3-million-nyc-taxi-rides-five-minutes/The whole thing took under five minutes on a MacBook with an M1 chip. TestGen profiled 2,964,624 NYC taxi rows in 1 minute 48 seconds and generated 62 tests. All of them passed, which is the trap. Seven business rules an AI wrote then found 171,627 broken trips.Fri, 07 Aug 2026 00:00:00 GMTChris Berghhttps://datakitchen.io/blog/best-data-quality-rules-live-in-someone-elses-head/https://datakitchen.io/blog/best-data-quality-rules-live-in-someone-elses-head/Seven roles touch a data quality rule. The analyst who spots the bad number, the steward who owns the definition, the engineer who runs it, the CDO who counts them. Nobody holds the whole picture.Tue, 04 Aug 2026 00:00:00 GMTChris Berghhttps://datakitchen.io/blog/no-microsoft-data-quality-tool-there-are-nineteen/https://datakitchen.io/blog/no-microsoft-data-quality-tool-there-are-nineteen/You went looking for the Microsoft data quality tool. There isn't one. There are nineteen features across five products, twelve of them manual, and they don't talk to each other. Here's the map.Tue, 04 Aug 2026 00:00:00 GMTChris Berghhttps://datakitchen.io/blog/test-coverage-beats-data-lineage/https://datakitchen.io/blog/test-coverage-beats-data-lineage/Lineage describes. Tests detect. A lineage graph names five tables downstream of a bad number. Only test coverage tells you which one is wrong.Mon, 27 Jul 2026 00:00:00 GMTChris Berghhttps://datakitchen.io/blog/commercial-pharma-data-most-likely-to-be-wrong/https://datakitchen.io/blog/commercial-pharma-data-most-likely-to-be-wrong/Commercial pharma runs on data you didn't make. Here's how to catch what the vendors send you before it reaches the field.Wed, 15 Jul 2026 00:00:00 GMTChris Berghhttps://datakitchen.io/blog/webinar-stop-clicking-start-asking-the-ai-playbook-for-data-quality/https://datakitchen.io/blog/webinar-stop-clicking-start-asking-the-ai-playbook-for-data-quality/Data quality has always been a clicking job. MCP changes that. This webinar is the playbook for AI Dialogue and AI Delegation: where the dashboard still wins, what AI dialogue adds, and when it's safe to turn on agents.Wed, 15 Jul 2026 00:00:00 GMTChris Berghhttps://datakitchen.io/blog/why-testing-commercial-pharma-data-is-harder-than-anyone-tells-you/https://datakitchen.io/blog/why-testing-commercial-pharma-data-is-harder-than-anyone-tells-you/Nothing failed, but every chart is wrong. Six ways commercial pharma data breaks that generic data quality checks never see, and what DataOps TestGen does about them.Wed, 08 Jul 2026 00:00:00 GMTChris Berghhttps://datakitchen.io/blog/testgen-mcp-cheat-sheet/https://datakitchen.io/blog/testgen-mcp-cheat-sheet/TestGen 5.70.2 completes the Model Context Protocol server. That's 96 tools covering the whole data quality loop, callable from Claude, Cursor, Copilot, or the agent you're building. Grab the one-page cheat sheet.Mon, 06 Jul 2026 00:00:00 GMTChris Berghhttps://datakitchen.io/blog/shopping-for-tests-faceted-picker-testgen-test-catalog/https://datakitchen.io/blog/shopping-for-tests-faceted-picker-testgen-test-catalog/Find the right test faster. TestGen's Add Test screen is now a faceted picker. Filter 49 test types by what they protect, how they work, and where they point, just like shopping online.Tue, 30 Jun 2026 00:00:00 GMTChris Berghhttps://datakitchen.io/blog/stop-burning-tokens-data-quality-observability-ai-system-of-record/https://datakitchen.io/blog/stop-burning-tokens-data-quality-observability-ai-system-of-record/Embedding AI in every data tool creates token bloat, inconsistency, and siloed context. The better pattern: expose data quality and observability as a deterministic service via MCP and let your AI call it.Tue, 16 Jun 2026 00:00:00 GMTGil Benghiathttps://datakitchen.io/blog/agents-fix-data-quality-automatically-with-control/https://datakitchen.io/blog/agents-fix-data-quality-automatically-with-control/A design pattern for agents that fix bad source data with a human veto. TestGen and Claude find the problems and propose the exact SQL, you approve each fix in a Jira ticket, and a second program applies only what you approved, in one transaction, on a copy table.Tue, 09 Jun 2026 00:00:00 GMTChris Berghhttps://datakitchen.io/blog/medallion-architecture-four-points-data-testing/https://datakitchen.io/blog/medallion-architecture-four-points-data-testing/Four places to test data in a Medallion: source, ingestion, production tripwires, and CI/CD regressions. Same null check, different job in each place. Skip a point and your dashboard is wrong by 9 am.Wed, 03 Jun 2026 00:00:00 GMTChris Berghhttps://datakitchen.io/blog/first-move-inherit-data/https://datakitchen.io/blog/first-move-inherit-data/Before you take the keys to a data warehouse, document its condition. TestGen gives your team the objective baseline that separates the problems you inherited from the problems you created.Fri, 22 May 2026 00:00:00 GMTGil Benghiathttps://datakitchen.io/blog/webinar-10x-your-data-engineering-with-ai/https://datakitchen.io/blog/webinar-10x-your-data-engineering-with-ai/On-demand webinar: how to combine Claude Code with DataOps, FITT architecture, and data testing to get 10x data engineering productivity, safely and autonomously.Wed, 20 May 2026 00:00:00 GMTChris Berghhttps://datakitchen.io/blog/small-pharma-hoarding-cash-before-fda-gate-opens/https://datakitchen.io/blog/small-pharma-hoarding-cash-before-fda-gate-opens/The FDA is slow, MFN pricing is here, and your launch is 12 to 24 months out. Every $700,000 you don't spend on data consulting is runway.Mon, 18 May 2026 00:00:00 GMTChris Berghhttps://datakitchen.io/blog/while-you-slept-an-agent-fixed-14-data-quality-failures/https://datakitchen.io/blog/while-you-slept-an-agent-fixed-14-data-quality-failures/TestGen 5.32.2 ships an MCP server. Open source, runs behind your firewall, and lets LLMs fix data quality failures while you sleep.Fri, 08 May 2026 00:00:00 GMTDataKitchen Marketing Teamhttps://datakitchen.io/blog/when-the-cloud-goes-dark-a-note-to-great-expectations-customers/https://datakitchen.io/blog/when-the-cloud-goes-dark-a-note-to-great-expectations-customers/Great Expectations was acquired and GX Cloud shut down. Customers got about 30 days to migrate. Why category economics keep doing this, and how to move your tests to open-source TestGen.Thu, 07 May 2026 00:00:00 GMTChris Berghhttps://datakitchen.io/blog/a-data-usability-crisis-is-costing-your-company/https://datakitchen.io/blog/a-data-usability-crisis-is-costing-your-company/Data teams that lean on user 'workarounds' instead of fixing usability problems pay a hidden cost in trust, turnover, and AI readiness.Sat, 02 May 2026 00:00:00 GMTChip Blochehttps://datakitchen.io/blog/there-are-a-lot-of-freaking-data-quality-and-data-observability-vendors/https://datakitchen.io/blog/there-are-a-lot-of-freaking-data-quality-and-data-observability-vendors/55 vendors, mostly converged on capability, all over the map on price. Here's where TestGen lands and why fifteen minutes is enough to decide.Thu, 30 Apr 2026 00:00:00 GMTChris Berghhttps://datakitchen.io/blog/data-qualitys-most-wanted-the-2026-case-files/https://datakitchen.io/blog/data-qualitys-most-wanted-the-2026-case-files/Four data quality disasters reached the public record in 2026, and each followed the same pattern. Nobody reconciled two numbers that had to agree. A hospital closed, 22,000 students got repayment demands, and a city's books were off by $1.45 million.Fri, 24 Apr 2026 00:00:00 GMTChip Blochehttps://datakitchen.io/blog/the-data-contract-is-your-receipt/https://datakitchen.io/blog/the-data-contract-is-your-receipt/Everyone talks about data contracts. Nobody implements them. Stop treating them like legal documents and start treating them like receipts: lightweight, free proof that the data you ordered actually showed up the way you expected.Mon, 20 Apr 2026 00:00:00 GMTChris Berghhttps://datakitchen.io/blog/context-as-infrastructure-the-six-category-framework-for-ai-ready-data-analysis/https://datakitchen.io/blog/context-as-infrastructure-the-six-category-framework-for-ai-ready-data-analysis/The six categories of context in this post are infrastructure, not documentation. This layer sits between your data and your AI. It turns schemas into meaning, tables into business concepts, and raw query results into answers your analysts can trust.Thu, 16 Apr 2026 00:00:00 GMTChris Berghhttps://datakitchen.io/blog/impact-dimensions/https://datakitchen.io/blog/impact-dimensions/Your data quality tools are like that neighbor who won't stop describing his rash at parties: great at describing problems, terrible at telling you what to do about them. Impact Dimensions organize data quality issues into four categories that show which problems actually matter, where to fix them cheapest, and why the ones you're ignoring cost you the most.Thu, 16 Apr 2026 00:00:00 GMTChip Blochehttps://datakitchen.io/blog/webinar-10x-your-ai-data-analysis-the-context-engineering-formula-that-works/https://datakitchen.io/blog/webinar-10x-your-ai-data-analysis-the-context-engineering-formula-that-works/On-demand webinar: why AI data analysis deployments fail, and the Data Trust + Data Experience + Context formula that actually works on Snowflake and Databricks.Tue, 14 Apr 2026 00:00:00 GMTChris Berghhttps://datakitchen.io/blog/data-production-tripwires-in-databricks-stop-bad-data-before-it-reaches-production/https://datakitchen.io/blog/data-production-tripwires-in-databricks-stop-bad-data-before-it-reaches-production/Learn how to add data quality gates directly into your Databricks job DAG so that bad data stops at the layer where it fails — and never touches production.Mon, 06 Apr 2026 00:00:00 GMTChris Berghhttps://datakitchen.io/blog/introducing-buzzops-a-tool-to-translate-vendor-bs-youre-welcome/https://datakitchen.io/blog/introducing-buzzops-a-tool-to-translate-vendor-bs-youre-welcome/These days, every vendor claims to be agentic, AI-native, and context-aware. We made a tool that explains what they really do.Wed, 01 Apr 2026 00:00:00 GMTChris Berghhttps://datakitchen.io/blog/webinar-the-four-points-in-your-medallion-architecture-where-data-testing-really-matters/https://datakitchen.io/blog/webinar-the-four-points-in-your-medallion-architecture-where-data-testing-really-matters/On-demand webinar: the four points in a medallion architecture where data testing actually changes outcomes, with live TestGen demos against real bronze layer data.Tue, 31 Mar 2026 00:00:00 GMTChris Berghhttps://datakitchen.io/blog/datakitchen-enhances-its-support-for-data-stewards/https://datakitchen.io/blog/datakitchen-enhances-its-support-for-data-stewards/TestGen is becoming a platform for the people who are actually responsible for data quality in large organizations, not just a tool for engineers.Mon, 30 Mar 2026 00:00:00 GMTChris Berghhttps://datakitchen.io/blog/testgen-now-supports-oracle-and-sap-hana-with-a-new-setup-wizard-to-get-you-running-fast/https://datakitchen.io/blog/testgen-now-supports-oracle-and-sap-hana-with-a-new-setup-wizard-to-get-you-running-fast/Two of the most common databases in large enterprises are now supported by open source and enterprise TestGen.Mon, 30 Mar 2026 00:00:00 GMTChris Berghhttps://datakitchen.io/blog/why-do-i-need-a-star-schema/https://datakitchen.io/blog/why-do-i-need-a-star-schema/What a star schema is, why it beats a flat table for analytics, and why AI agents work better when your data is organized this way.Sat, 28 Mar 2026 00:00:00 GMTGil Benghiathttps://datakitchen.io/blog/1-billion-ivc-investment-this-is-not-going-to-end-well/https://datakitchen.io/blog/1-billion-ivc-investment-this-is-not-going-to-end-well/VC overinvestment causes predatory usage-based pricing and threatens vendor sustainability. How many data engineers will you need to lay off to cover your data observability costs this year?Tue, 24 Mar 2026 00:00:00 GMTChris Berghhttps://datakitchen.io/blog/dataops-fitt-data-testing-10x-data-engineering-productivity-with-ai/https://datakitchen.io/blog/dataops-fitt-data-testing-10x-data-engineering-productivity-with-ai/AI coding tools like Claude Code are generating significant excitement in software engineering. But for data engineers, getting 10 times the productivity isn't automatic. Just adding an AI agent to a messy pipeline and hoping it works usually leads to failure.Mon, 16 Mar 2026 00:00:00 GMTChris Berghhttps://datakitchen.io/blog/we-just-eyeball-row-counts-and-pray/https://datakitchen.io/blog/we-just-eyeball-row-counts-and-pray/We read 849 comments across 18 community threads on Reddit, Hacker News, Stack Overflow, and the dbt Community Forum. The #1 reason data engineers don't test: nobody gives them the time. The #2 reason: the data changes faster than the tests can keep up. Here's the full breakdown, in their own words.Mon, 16 Mar 2026 00:00:00 GMTChris Berghhttps://datakitchen.io/blog/the-equation-for-ai-success-dt-dx-ctx-10x/https://datakitchen.io/blog/the-equation-for-ai-success-dt-dx-ctx-10x/How to Make Data Analysis Ten Times Faster with AI and Large Language ModelsTue, 10 Mar 2026 00:00:00 GMTChris Berghhttps://datakitchen.io/blog/why-your-data-quality-dashboard-isnt-working-and-what-to-do-about-it/https://datakitchen.io/blog/why-your-data-quality-dashboard-isnt-working-and-what-to-do-about-it/This article pulls back the curtain on why standard data quality dashboards fall short. We'll reveal six powerful, and perhaps surprising, truths about data quality dashboard failure.Mon, 09 Mar 2026 00:00:00 GMTChris Berghhttps://datakitchen.io/books/the-dataops-way-to-data-quality-a-free-book-for-every-data-team/https://datakitchen.io/books/the-dataops-way-to-data-quality-a-free-book-for-every-data-team/Most data quality advice tells you what to measure. This book tells you why your team keeps failing and what to actually do about it.Mon, 09 Mar 2026 00:00:00 GMTChris Berghhttps://datakitchen.io/blog/we-got-roasted-on-reddit-for-asking-why-data-engineers-dont-test/https://datakitchen.io/blog/we-got-roasted-on-reddit-for-asking-why-data-engineers-dont-test/We asked the r/dataengineering community 'Why don't you test?' And we got roasted. Learn whyWed, 04 Mar 2026 00:00:00 GMTGil Benghiathttps://datakitchen.io/blog/webinar-youre-massively-overpaying-for-data-observability/https://datakitchen.io/blog/webinar-youre-massively-overpaying-for-data-observability/Watch this on demand webinar where we named names, broke down exactly what you’re paying for (spoiler: $300K a Year for a Z-Score?), and showed how TestGenThu, 26 Feb 2026 00:00:00 GMTChris Berghhttps://datakitchen.io/blog/be-the-first-to-know-smart-continuous-table-monitoring-has-arrived-in-testgen/https://datakitchen.io/blog/be-the-first-to-know-smart-continuous-table-monitoring-has-arrived-in-testgen/The days of learning about data problems from an angry business analyst should be over. With TestGen's table monitoring, you're watching everything automatically and continuously.Tue, 24 Feb 2026 00:00:00 GMTChris Berghhttps://datakitchen.io/blog/data-quality-testing-is-at-the-core-of-four-critical-data-team-processes/https://datakitchen.io/blog/data-quality-testing-is-at-the-core-of-four-critical-data-team-processes/What Is The Common Thread Running Through Four Critical Data Team Processes? Data Testing!Tue, 10 Feb 2026 00:00:00 GMTChris Berghhttps://datakitchen.io/blog/stop-paying-the-data-quality-tax/https://datakitchen.io/blog/stop-paying-the-data-quality-tax/Why Data Observability costs a fortune, why it shouldn’t, and why paying $100,000/year for commodity algorithms is insane!Thu, 05 Feb 2026 00:00:00 GMTChris Berghhttps://datakitchen.io/blog/data-quality-vs-data-observability-the-pets-and-cattle-of-your-data-estate/https://datakitchen.io/blog/data-quality-vs-data-observability-the-pets-and-cattle-of-your-data-estate/The same "pets vs cattle" philosophy that transformed Devops explains exactly when to invest in data quality dashboards versus when to rely on automated anomaly detection—and why you need both.Mon, 02 Feb 2026 00:00:00 GMTGil Benghiathttps://datakitchen.io/blog/how-testgen-complements-microsoft-purview-for-enterprise-data-quality/https://datakitchen.io/blog/how-testgen-complements-microsoft-purview-for-enterprise-data-quality/DataKitchen's TestGen and Microsoft's Purview complement each other: Purview serves as the governance and catalog "source of truth," while TestGen is the deep, automated data-quality and testing engine that writes thousands of data quality tests in seconds.Tue, 20 Jan 2026 00:00:00 GMTGil Benghiathttps://datakitchen.io/blog/on-demand-webinar-seven-sins-of-data-quality/https://datakitchen.io/blog/on-demand-webinar-seven-sins-of-data-quality/Confess your data sins. Find redemption. Maybe even laugh about it.Tue, 20 Jan 2026 00:00:00 GMTChris Berghhttps://datakitchen.io/blog/the-five-organizational-sins-of-data-teams/https://datakitchen.io/blog/the-five-organizational-sins-of-data-teams/The five organizational problems are systemic failures of culture and structure that lead to warring teams, a corrosive blame culture, "data blindness" regarding pipelines, a short-term project mindset, and the chaotic scattering of business logic. Learn how to identify and fix below.Mon, 19 Jan 2026 00:00:00 GMTChris Berghhttps://datakitchen.io/blog/the-consultants-growth-playbook-accelerating-client-acquisition-and-retention-with-datakitchen-open-source-testgen/https://datakitchen.io/blog/the-consultants-growth-playbook-accelerating-client-acquisition-and-retention-with-datakitchen-open-source-testgen/A Consultant’s Guide to Using DataKitchen’s Open Source Data Quality and Data Observability Tools: How to Find New Clients, Strengthen Relationships, and Deliver Better ResultsSun, 18 Jan 2026 00:00:00 GMTChris Berghhttps://datakitchen.io/blog/large-pharma-achieves-5x-productivity-gain-with-dataops-process-hub/https://datakitchen.io/blog/large-pharma-achieves-5x-productivity-gain-with-dataops-process-hub/How a large pharma business analytics team cut manual work and hit a 5X productivity gain by adopting a DataOps process hub to automate its analytics workflows.Sat, 17 Jan 2026 00:00:00 GMTDataKitchen Marketing Teamhttps://datakitchen.io/blog/the-seven-deadly-sins-of-data-quality/https://datakitchen.io/blog/the-seven-deadly-sins-of-data-quality/Confess your data sins. Find redemption. Maybe even laugh about it.Wed, 07 Jan 2026 00:00:00 GMTChris Berghhttps://datakitchen.io/blog/webinar-da-masterclass-in-the-six-types-of-data-quality-dashboards/https://datakitchen.io/blog/webinar-da-masterclass-in-the-six-types-of-data-quality-dashboards/In A Masterclass In The Six Types of Data Quality Dashboards, you’ll learn how to build all six powerful data quality dashboard types in under an hour using 100% open source tools.Mon, 05 Jan 2026 00:00:00 GMTChris Berghhttps://datakitchen.io/blog/the-data-errors-shame-game-why-data-engineers-avoid-harsh-truths/https://datakitchen.io/blog/the-data-errors-shame-game-why-data-engineers-avoid-harsh-truths/Many professionals would rather *not* know about data quality problems. Isn't finding and fixing issues the job? Yes ... but organizational dynamics around data errors punish the messenger. Here's how to fix that dynamic.Wed, 31 Dec 2025 00:00:00 GMTChris Berghhttps://datakitchen.io/blog/the-ostrich-problem-your-data-team-thinks-their-job-ends-at-deployment/https://datakitchen.io/blog/the-ostrich-problem-your-data-team-thinks-their-job-ends-at-deployment/What to do when your team doesn't care about data errors in production? The "deploy and forget" ostrich mindset is one of the most corrosive patterns in data engineering teams. Here's How to Change That.Fri, 19 Dec 2025 00:00:00 GMTChris Berghhttps://datakitchen.io/blog/peter-piper-on-the-four-ps-of-ai-data-quality-purge-patch-push-back-or-pass/https://datakitchen.io/blog/peter-piper-on-the-four-ps-of-ai-data-quality-purge-patch-push-back-or-pass/How does a data team prevent poor data from poisoning AI when they have piles of raw and imperfect data?Thu, 18 Dec 2025 00:00:00 GMTGil Benghiathttps://datakitchen.io/blog/the-2026-open-source-data-profiling-software-landscape/https://datakitchen.io/blog/the-2026-open-source-data-profiling-software-landscape/Data profiling has re-emerged as an essential first step in protecting AI-driven organizations from data-induced failures. Most open-source profiling tools stop at describing data; almost none automatically convert profiling insights into actionable data hygiene checks.Wed, 10 Dec 2025 00:00:00 GMTChris Berghhttps://datakitchen.io/blog/the-2026-data-quality-and-data-observability-commercial-software-landscape/https://datakitchen.io/blog/the-2026-data-quality-and-data-observability-commercial-software-landscape/More than 50 vendors sell data quality and data observability software. This map sorts them into four categories, notes who has been acquired or shut down, and says what to ask before you sign.Mon, 01 Dec 2025 00:00:00 GMTChris Berghhttps://datakitchen.io/blog/sure-go-ahead-and-feed-that-data-to-the-llm-what-could-possibly-go-wrong/https://datakitchen.io/blog/sure-go-ahead-and-feed-that-data-to-the-llm-what-could-possibly-go-wrong/Welcome to Analysis-A-Palooza: The Festival No Data Engineer Asked ForWed, 19 Nov 2025 00:00:00 GMTChris Berghhttps://datakitchen.io/blog/webinar-data-quality-dataops-and-large-language-models/https://datakitchen.io/blog/webinar-data-quality-dataops-and-large-language-models/AI is changing the world — in this webinar we show how Large Language Model drive the need for DataOps, Data Quality, and Data ObservabilityThu, 06 Nov 2025 00:00:00 GMTChris Berghhttps://datakitchen.io/blog/youre-thinking-about-data-products-all-wrong/https://datakitchen.io/blog/youre-thinking-about-data-products-all-wrong/When data team leaders hear "data products," they immediately think of the stuff their team creates. But focusing on the "what" completely misses the mark. Data products aren't about what you create, but “how” you build, maintain, and continually improve your data deliverables to your customers.Fri, 31 Oct 2025 00:00:00 GMTChris Berghhttps://datakitchen.io/blog/the-2026-open-source-data-quality-and-data-observability-landscape/https://datakitchen.io/blog/the-2026-open-source-data-quality-and-data-observability-landscape/A map of the open-source data quality and data observability tools in 2026, what changed when GX Cloud shut down, and how to tell a full open-source product from a trial.Tue, 28 Oct 2025 00:00:00 GMTChris Berghhttps://datakitchen.io/blog/webinar-the-fitt-way-to-data-products-a-new-data-architecture/https://datakitchen.io/blog/webinar-the-fitt-way-to-data-products-a-new-data-architecture/This webinar unveils the battle-tested FITT (Functional, Idempotent, Tested, Two-stage) data architecture that eliminates endemic burnout, constant firefighting, and hero-driven development that keeps engineers trapped in operational chaos.Tue, 14 Oct 2025 00:00:00 GMTChris Berghhttps://datakitchen.io/blog/dataops-data-quality-testgen-expands-now-supporting-bigquery-and-apache-iceberg/https://datakitchen.io/blog/dataops-data-quality-testgen-expands-now-supporting-bigquery-and-apache-iceberg/DataOps TestGen Enterprise is now compatible with Google BigQuery and can be used to profile and test file-based data accessible through Redshift Spectrum and Snowflake external tables using Apache Iceberg and other file formats.Mon, 13 Oct 2025 00:00:00 GMTChris Berghhttps://datakitchen.io/blog/process-guardianship-the-most-valuable-data-engineering-work-youre-probably-not-doing/https://datakitchen.io/blog/process-guardianship-the-most-valuable-data-engineering-work-youre-probably-not-doing/When people think of data engineers, the description usually stops at "building high-quality pipelines that deliver analyst-ready data." That is true, but incomplete. In modern organizations, data engineers hold a deeper responsibility. They are not just the builders of pipelines—they are the curators of the business logic itself.Wed, 08 Oct 2025 00:00:00 GMTChris Berghhttps://datakitchen.io/blog/flip-the-script-on-data-quality-shift-left-shift-down-and-take-control/https://datakitchen.io/blog/flip-the-script-on-data-quality-shift-left-shift-down-and-take-control/The manufacturing industry learned decades ago that catching defects early in the production process saves exponentially more money than fixing them after products ship. Today's data engineering teams face a strikingly similar challenge.Tue, 30 Sep 2025 00:00:00 GMTChris Berghhttps://datakitchen.io/blog/how-dataops-is-transforming-commercial-pharma-analytics/https://datakitchen.io/blog/how-dataops-is-transforming-commercial-pharma-analytics/DataOps has become an essential methodology in pharmaceutical enterprise data organizations, especially for commercial operations.Wed, 27 Aug 2025 00:00:00 GMTDataKitchen Marketing Teamhttps://datakitchen.io/blog/fitt-vs-fragile-sql-orchestration-techniques/https://datakitchen.io/blog/fitt-vs-fragile-sql-orchestration-techniques/Transform data engineering from a high-stress, "hero saves the day" kind of job into something systematic and predictable that actually scales as your team and business grow. Stop babysitting pipelines: SQL & ELT the FITT Way.Mon, 18 Aug 2025 00:00:00 GMTChris Berghhttps://datakitchen.io/blog/data-quality-test-coverage-in-a-medallion-data-architecture/https://datakitchen.io/blog/data-quality-test-coverage-in-a-medallion-data-architecture/For data engineering teams serious about delivering production-grade data products, implementing systematic test coverage across their Medallion architecture represents not only a technical improvement but a fundamental shift toward sustainable and trustworthy data operations.Mon, 11 Aug 2025 00:00:00 GMTChris Berghhttps://datakitchen.io/blog/critical-data-elements-your-shortcut-to-data-governance-that-actually-works/https://datakitchen.io/blog/critical-data-elements-your-shortcut-to-data-governance-that-actually-works/💥 80% of data governance initiatives fail. Not because of tools. Not because of frameworks. But because the business isn't involved, and no one agrees on what data truly matters. That's where Critical Data Elements (CDEs) change everything.Thu, 31 Jul 2025 00:00:00 GMTChris Berghhttps://datakitchen.io/blog/fitt-data-architecture/https://datakitchen.io/blog/fitt-data-architecture/Most data architectures are designed to maximize data vendor revenues, not data team productivity. Let us show you how a Functional, Idempotent, Tested, Two-Stage (FITT) data architecture can deliver better productivity, reliability, and happiness.Tue, 22 Jul 2025 00:00:00 GMTEric Estabrookshttps://datakitchen.io/blog/webinar-test-coverage-supercharges-data-quality-data-engineering/https://datakitchen.io/blog/webinar-test-coverage-supercharges-data-quality-data-engineering/In an exciting webinar, we talk about the importance of having test coverage across all your tables and toolsThu, 17 Jul 2025 00:00:00 GMTChris Berghhttps://datakitchen.io/blog/scaling-data-reliability-the-definitive-guide-to-test-coverage/https://datakitchen.io/blog/scaling-data-reliability-the-definitive-guide-to-test-coverage/Let us show you how to implement full-coverage automatic data checks on every table, column, tool, and step in your delivery process. And how you can create 1000s of tests in a minute using open source tools.Tue, 08 Jul 2025 00:00:00 GMTChris Berghhttps://datakitchen.io/blog/the-data-quality-revolution-starts-with-you/https://datakitchen.io/blog/the-data-quality-revolution-starts-with-you/Your organization's data quality transformation is waiting for someone to take the first step. The open source tools are available, the methodologies are proven, and the need is obvious. The revolution starts with you. What are you waiting for?Fri, 20 Jun 2025 00:00:00 GMTChris Berghhttps://datakitchen.io/blog/webinar-a-guide-to-the-six-types-of-data-quality-dashboards/https://datakitchen.io/blog/webinar-a-guide-to-the-six-types-of-data-quality-dashboards/In an exciting webinar, we discuss the six major types of Data Quality DashboardsWed, 18 Jun 2025 00:00:00 GMTChris Berghhttps://datakitchen.io/blog/when-timing-goes-wrong-how-latency-issues-cascade/https://datakitchen.io/blog/when-timing-goes-wrong-how-latency-issues-cascade/Timing is EVERYTHING. How Latency Issues Spawn Data Quality ProblemsWed, 18 Jun 2025 00:00:00 GMTChip Blochehttps://datakitchen.io/blog/data-quality-testing-a-shared-resource-for-modern-data-teams/https://datakitchen.io/blog/data-quality-testing-a-shared-resource-for-modern-data-teams/Data quality is not a problem any single role can solve in isolation. The complexity and scale of modern data ecosystems necessitate a collaborative approach, where quality testing serves as a shared infrastructure across all data and analytics roles.Fri, 06 Jun 2025 00:00:00 GMTChris Berghhttps://datakitchen.io/blog/the-100-billion-secret/https://datakitchen.io/blog/the-100-billion-secret/Because the real differentiator in today's market isn't just having data. It's about having it simplified, integrated, trusted, and continually improving. It's having a data team you can trust. And control.Fri, 30 May 2025 00:00:00 GMTChris Berghhttps://datakitchen.io/blog/how-i-broke-our-sla-and-delighted-our-customer/https://datakitchen.io/blog/how-i-broke-our-sla-and-delighted-our-customer/Failing the SLA was the price we paid for trust. And it was worth every second.Sat, 17 May 2025 00:00:00 GMTChip Blochehttps://datakitchen.io/blog/is-your-team-in-denial-of-data-quality/https://datakitchen.io/blog/is-your-team-in-denial-of-data-quality/Data quality problems are ignored, rationalized, or swept aside. How do you tell if your team is in denial about data quality? Uncle Chip has provided a bingo card ... play with your data team!Fri, 02 May 2025 00:00:00 GMTChip Blochehttps://datakitchen.io/blog/datakitchen-is-one-of-the-coolest-dataops-data-observability-companies-of-2025/https://datakitchen.io/blog/datakitchen-is-one-of-the-coolest-dataops-data-observability-companies-of-2025/We’re thrilled to share that DataKitchen has once again been named one of the Coolest DataOps & Data Observability Companies for 2025 by CRN!Thu, 24 Apr 2025 00:00:00 GMTChris Berghhttps://datakitchen.io/blog/read-white-paper-a-new-more-effective-approach-to-data-quality-assessments/https://datakitchen.io/blog/read-white-paper-a-new-more-effective-approach-to-data-quality-assessments/Embracing a fundamentally different approach that prioritizes influence over enforcement, iteration over perfection, and advocacy over bureaucracy, that empowers you to take control of data quality assessments.Thu, 24 Apr 2025 00:00:00 GMTChris Berghhttps://datakitchen.io/blog/data-quality-when-you-dont-understand-the-data-data-quality-coffee-with-uncle-chip-3/https://datakitchen.io/blog/data-quality-when-you-dont-understand-the-data-data-quality-coffee-with-uncle-chip-3/You can’t test for what you don’t understand. And so, we don’t. We skip it. We assume. Or worse, we wait until something breaks. What is the solution? Uncle Chip tells!Fri, 18 Apr 2025 00:00:00 GMTChip Blochehttps://datakitchen.io/blog/uncle-chip/https://datakitchen.io/blog/uncle-chip/Pull up a chair, pour yourself a fresh cup, and get ready to talk shop—because it's time for Data Quality Coffee Series with Uncle Chip.Fri, 18 Apr 2025 00:00:00 GMTChip Blochehttps://datakitchen.io/blog/webinar-a-new-more-effective-approach-to-data-quality-assessments/https://datakitchen.io/blog/webinar-a-new-more-effective-approach-to-data-quality-assessments/We introduce a new, more effective approach to data quality assessments, enabled by DataKitchen's free open-source softwareWed, 16 Apr 2025 00:00:00 GMTChris Berghhttps://datakitchen.io/blog/why-data-quality-dimensions-fall-flat-data-quality-coffee-with-uncle-chip/https://datakitchen.io/blog/why-data-quality-dimensions-fall-flat-data-quality-coffee-with-uncle-chip/In this playful yet pointed talk, Uncle Chip kicks things off by poking fun at the overcomplicated world of data quality dimensions that are rooted in an outdated era of static data, keeping teams locked in abstraction and inaction.Mon, 14 Apr 2025 00:00:00 GMTChip Blochehttps://datakitchen.io/blog/why-data-quality-isnt-worth-the-effort/https://datakitchen.io/blog/why-data-quality-isnt-worth-the-effort/Data quality work is largely invisible. When everything is running smoothly, no one notices the effort behind it. But everyone notices the moment something breaks!Wed, 09 Apr 2025 00:00:00 GMTChip Blochehttps://datakitchen.io/blog/what-does-flossing-one-tooth-have-to-do-with-data-quality/https://datakitchen.io/blog/what-does-flossing-one-tooth-have-to-do-with-data-quality/Surprisingly, the answer may comes from an unusual place.Thu, 03 Apr 2025 00:00:00 GMTGil Benghiathttps://datakitchen.io/blog/trusting-your-gut-78-45-more-effective-than-data-driven-decisions/https://datakitchen.io/blog/trusting-your-gut-78-45-more-effective-than-data-driven-decisions/Gartner/Harvard study: “Fire your data team tomorrow” and replace data and analytic teams with “affirmative decision AI agents”Tue, 01 Apr 2025 00:00:00 GMTChris Berghhttps://datakitchen.io/blog/webinar-announcing-actionable-automated-agile-data-quality-scorecards/https://datakitchen.io/blog/webinar-announcing-actionable-automated-agile-data-quality-scorecards/Announcing Actionable, Automated, & Agile Data Quality ScorecardsWed, 26 Mar 2025 00:00:00 GMTChris Berghhttps://datakitchen.io/blog/unlocking-data-team-success-are-you-process-centric-or-data-centric/https://datakitchen.io/blog/unlocking-data-team-success-are-you-process-centric-or-data-centric/We want to share our observations about data teams, how they work and think, and their challenges. We've identified two distinct types of data teams: process-centric and data-centric. Understanding this framework offers valuable insights into team efficiency, operational excellence, and data quality.Thu, 20 Mar 2025 00:00:00 GMTChris Berghhttps://datakitchen.io/blog/how-data-quality-leaders-can-gain-influence-and-avoid-the-tragedy-of-the-commons/https://datakitchen.io/blog/how-data-quality-leaders-can-gain-influence-and-avoid-the-tragedy-of-the-commons/Using the ecological idea of the ‘Tragedy Of The Commons’ as a metaphor for the eternal issue of data quality, we talk about how data quality leaders can leverage Dale Carnegie's 100-year-old ideas on influencing people and wrapping this improvement process with DataOps iterative improvement.Thu, 13 Mar 2025 00:00:00 GMTChris Berghhttps://datakitchen.io/blog/announcing-dataops-data-quality-testgen-3-0/https://datakitchen.io/blog/announcing-dataops-data-quality-testgen-3-0/Now With Actionable, Automatic, Data Quality Dashboards. Learn about DataOps Data Quality TestGen 3.0.Thu, 20 Feb 2025 00:00:00 GMTChris Berghhttps://datakitchen.io/blog/no-python-no-sql-templates-no-yaml/https://datakitchen.io/blog/no-python-no-sql-templates-no-yaml/The reality is that 80% of data quality tests can be generated automatically, eliminating the need for tedious manual coding. Learn how to do it today.Mon, 17 Feb 2025 00:00:00 GMTChris Berghhttps://datakitchen.io/blog/how-can-you-leverage-technologies-to-solve-data-quality-challenges/https://datakitchen.io/blog/how-can-you-leverage-technologies-to-solve-data-quality-challenges/Summary of the Melody Chien from Gartner Presentation: “How Can You Leverage Technologies to Solve Data Quality Challenges?”Tue, 17 Dec 2024 00:00:00 GMTChris Berghhttps://datakitchen.io/blog/drug-launch-case-study-amazing-efficiency-dataops/https://datakitchen.io/blog/drug-launch-case-study-amazing-efficiency-dataops/When launching a groundbreaking pharmaceutical product, the stakes and the rewards couldn’t be higher. This blog dives into the remarkable journey of a data team that achieved unparalleled efficiency using DataOps principles and software that transformed their analytics and data teams into a hyper-efficient powerhouse.Mon, 09 Dec 2024 00:00:00 GMTGil Benghiathttps://datakitchen.io/blog/webinar-data-quality-in-a-medallion-architecture-2024/https://datakitchen.io/blog/webinar-data-quality-in-a-medallion-architecture-2024/Would you like help maintaining high-quality data across every layer of your Medallion Architecture?Fri, 06 Dec 2024 00:00:00 GMTChris Berghhttps://datakitchen.io/blog/the-six-types-of-data-quality-dashboards/https://datakitchen.io/blog/the-six-types-of-data-quality-dashboards/Not all data quality dashboards are created equal. Their design and focus vary significantly depending on an organization’s unique goals, challenges, and data landscape. This blog delves into the six distinct types of data quality dashboards, examining how each fulfills a specific role in improving Data Quality.Wed, 27 Nov 2024 00:00:00 GMTChris Berghhttps://datakitchen.io/blog/the-race-for-data-quality-in-a-medallion-architecture/https://datakitchen.io/blog/the-race-for-data-quality-in-a-medallion-architecture/The Medallion Data Lakehouse Architecture has a unique set of data quality challenges. Find out how to take the gold in this tough data quality race!Tue, 05 Nov 2024 00:00:00 GMTChris Berghhttps://datakitchen.io/blog/webinar-dataops-for-beginners-2024/https://datakitchen.io/blog/webinar-dataops-for-beginners-2024/If you’ve ever heard (or had) these complaints about speed-to-insight or data reliability, you should watch our webinar, DataOps for Beginners, on demand.Wed, 30 Oct 2024 00:00:00 GMTGil Benghiathttps://datakitchen.io/blog/read-white-paper-data-quality-the-dataops-way/https://datakitchen.io/blog/read-white-paper-data-quality-the-dataops-way/Traditional methods fall short, but the DataOps approach to data quality offers a transformative path forward.Thu, 10 Oct 2024 00:00:00 GMTChris Berghhttps://datakitchen.io/blog/data-quality-power-moves-scorecards-data-checks-for-organizational-impact/https://datakitchen.io/blog/data-quality-power-moves-scorecards-data-checks-for-organizational-impact/Webinar: Unlocking the Power of Data Observability and Quality TestingWed, 18 Sep 2024 00:00:00 GMTChris Berghhttps://datakitchen.io/blog/visualizing-thousands-of-data-pipelines-with-violin-charts/https://datakitchen.io/blog/visualizing-thousands-of-data-pipelines-with-violin-charts/What do you do when you have thousands of data pipelines in production? Is there a way that you can visualize what is happening in production quickly and easily?Mon, 09 Sep 2024 00:00:00 GMTGil Benghiathttps://datakitchen.io/blog/data-quality-circles-the-key-to-elevating-data-and-analytics-team-performance/https://datakitchen.io/blog/data-quality-circles-the-key-to-elevating-data-and-analytics-team-performance/DataOps Quality Circles are focused teams within data and analytics organizations that meet weekly or monthly to drive continuous improvement, quality automation, and operational efficiency. By leveraging the principles of DataOps, these circles ensure that data processes are error free, consistent, and aligned with business goals.Thu, 22 Aug 2024 00:00:00 GMTGil Benghiathttps://datakitchen.io/blog/2024-gartner-market-guide-to-dataops/https://datakitchen.io/blog/2024-gartner-market-guide-to-dataops/We celebrate Datakitchen's leadership in the 2024 Gartner Market Guide to DataOps. DataKitchen has the most complete, feature-rich, open, and modular DataOps product suite in the industry and the expertise to help you succeed.Fri, 16 Aug 2024 00:00:00 GMTDataKitchen Marketing Teamhttps://datakitchen.io/blog/datakitchens-data-quality-testgen-found-18-quality-issues-in-a-few-minutes-including-install-time-on-data-boston-gov-building-permit-data/https://datakitchen.io/blog/datakitchens-data-quality-testgen-found-18-quality-issues-in-a-few-minutes-including-install-time-on-data-boston-gov-building-permit-data/Imagine a free tool that you can point at any dataset and find actionable data quality issues immediately! I took DataKitchen's Data Quality TestGen for a test drive on ~600k rows of Boston City data and found 18 data quality hygiene issues in a few minutes.Tue, 06 Aug 2024 00:00:00 GMTGil Benghiathttps://datakitchen.io/blog/navigating-the-storm-how-data-engineering-teams-can-overcome-a-data-quality-crisis/https://datakitchen.io/blog/navigating-the-storm-how-data-engineering-teams-can-overcome-a-data-quality-crisis/A data quality crisis in data engineering is more than a mere technical hiccup; it often signals deeper systemic issues within the team and organizational processes. Let’s delve into the root causes, symptoms, and strategies for rapid intervention and long-term improvement.Fri, 21 Jun 2024 00:00:00 GMTChip Blochehttps://datakitchen.io/blog/how-three-small-pharma-companies-used-datakitchen-to-achieve-commercial-launch-success-and-skyrocket-to-100-billion-in-acquisition-value/https://datakitchen.io/blog/how-three-small-pharma-companies-used-datakitchen-to-achieve-commercial-launch-success-and-skyrocket-to-100-billion-in-acquisition-value/Three pharma companies recently made headlines by securing successful exits totaling $100 billion. What’s their common denominator? They all chose DataKitchen to power their pre-launch data operations. Here’s why DataKitchen stood out as their partner of choice.Tue, 11 Jun 2024 00:00:00 GMTChris Berghhttps://datakitchen.io/blog/data-observability-and-data-quality-testing-certification-series/https://datakitchen.io/blog/data-observability-and-data-quality-testing-certification-series/Join Our Free Webinar Series: Unlocking the Power of Data Observability and Quality TestingTue, 14 May 2024 00:00:00 GMTChris Berghhttps://datakitchen.io/blog/the-five-use-cases-in-data-observability-overview/https://datakitchen.io/blog/the-five-use-cases-in-data-observability-overview/Data observability extends beyond simple anomaly checking, offering deep insights into data health, dependencies, and the performance of data-intensive applications. This blog post introduces five critical use cases for data observability, each pivotal in maintaining the integrity and usability of data throughout its journey in any enterprise.Fri, 10 May 2024 00:00:00 GMTChris Berghhttps://datakitchen.io/blog/the-five-use-cases-in-data-observability-part-1/https://datakitchen.io/blog/the-five-use-cases-in-data-observability-part-1/The first of five data observability use cases: evaluating and cleansing new data sources for quality, schema, and anomalies before they reach production.Fri, 10 May 2024 00:00:00 GMTChris Berghhttps://datakitchen.io/blog/the-five-use-cases-in-data-observability-part-2/https://datakitchen.io/blog/the-five-use-cases-in-data-observability-part-2/The second data observability use case: monitoring data ingestion to catch anomalies, delays, and volume shifts as CRM and other sources load continuously.Fri, 10 May 2024 00:00:00 GMTChris Berghhttps://datakitchen.io/blog/the-five-use-cases-in-data-observability-part-3/https://datakitchen.io/blog/the-five-use-cases-in-data-observability-part-3/The third data observability use case: mastering data production across multi-tool, multi-dataset pipelines so dashboards and warehouses ship error-free.Fri, 10 May 2024 00:00:00 GMTChris Berghhttps://datakitchen.io/blog/the-five-use-cases-in-data-observability-part-4/https://datakitchen.io/blog/the-five-use-cases-in-data-observability-part-4/The fourth data observability use case: fast, safe development and deployment using regression tests and impact reviews to catch errors before production.Fri, 10 May 2024 00:00:00 GMTChris Berghhttps://datakitchen.io/blog/the-five-use-cases-in-data-observability-part-5/https://datakitchen.io/blog/the-five-use-cases-in-data-observability-part-5/The fifth data observability use case: verifying accuracy during data migration so cloud-bound data matches the legacy source row for row and report for report.Fri, 10 May 2024 00:00:00 GMTChris Berghhttps://datakitchen.io/books/datakitchen-training-and-certification-offerings/https://datakitchen.io/books/datakitchen-training-and-certification-offerings/Every free DataKitchen course, certification, and book, in one list: DataOps fundamentals, data observability, and data quality testing.Tue, 07 May 2024 00:00:00 GMTChris Berghhttps://datakitchen.io/blog/webinar-summary-introducing-ope-source-data-observability/https://datakitchen.io/blog/webinar-summary-introducing-ope-source-data-observability/Christopher Bergh detailed the company's release of new open-source tools to enhance DataOps practices by addressing common inefficiencies and errors within data teams. During the webinar, he demonstrated how these tools provide robust data observability and automated testing to improve productivity and reliability across data operations.Mon, 06 May 2024 00:00:00 GMTChris Berghhttps://datakitchen.io/blog/why-we-open-sourced-our-data-observability-products/https://datakitchen.io/blog/why-we-open-sourced-our-data-observability-products/Why open source DataOps Observability and DataOps TestGen? Our decision to share full-featured versions of these products stems from DataKitchen's long-standing commitment to enhancing productivity for data teams and promoting the use of automated, observed, and trusted tools. It aligns with our company's philosophy of sharing knowledge and now software to inspire teams to implement DataOps effectively.Thu, 18 Apr 2024 00:00:00 GMTChris Berghhttps://datakitchen.io/blog/webinar-agile-dataops-and-data-team-excellence/https://datakitchen.io/blog/webinar-agile-dataops-and-data-team-excellence/Gil Benghiat, co-founder of Data Kitchen, began by explaining the overarching goal of achieving data team excellence, which involves delivering business value quickly and with high quality. He detailed data teams' everyday challenges, such as balancing speed and quality, and the impact of Agile methodologies borrowed from software development practices.Thu, 11 Apr 2024 00:00:00 GMTChris Berghhttps://datakitchen.io/blog/congratulations-to-the-karuna-team-on-thier-acquisiton/https://datakitchen.io/blog/congratulations-to-the-karuna-team-on-thier-acquisiton/Today, Bristol Myers Squib (BMS) has fully acquired Karuna Therapeutics. We congratulate our customer on an amazing success.Mon, 18 Mar 2024 00:00:00 GMTChris Berghhttps://datakitchen.io/books/embracing-agility-and-excellence-in-data-operations-the-datakitchen-dataops-way/https://datakitchen.io/books/embracing-agility-and-excellence-in-data-operations-the-datakitchen-dataops-way/How DataKitchen's DataOps consulting works: assessments against the maturity model, training built on the Cookbook, then technical implementation.Fri, 15 Mar 2024 00:00:00 GMTChris Berghhttps://datakitchen.io/blog/key-success-metrics-benefits-and-results-for-data-observability-using-datakitchen-software/https://datakitchen.io/blog/key-success-metrics-benefits-and-results-for-data-observability-using-datakitchen-software/At DataKitchen, we would like to share some key success metrics of Data Observability Using DataKitchen DataOps Observability and DataOps TestGen.Tue, 12 Mar 2024 00:00:00 GMTChris Berghhttps://datakitchen.io/blog/ngx-toolkit-a-new-open-source-project-from-datakitchen/https://datakitchen.io/blog/ngx-toolkit-a-new-open-source-project-from-datakitchen/At DataKitchen, we use Angular and strive for well-tested and maintainable code. We’ve created three libraries that have helped accelerate Angular development in our software projects. We are proud today to present these to the open source community.Tue, 05 Mar 2024 00:00:00 GMTChris Berghhttps://datakitchen.io/blog/why-not-hearing-about-data-errors-should-worry-your-data-team/https://datakitchen.io/blog/why-not-hearing-about-data-errors-should-worry-your-data-team/Just because you're not hearing about data errors doesn't mean they don't exist. This silence could be a ticking time bomb for underlying issues yet to surface. Here are seven compelling reasons why you should care and be proactive, even when all seems well.Tue, 05 Mar 2024 00:00:00 GMTChris Berghhttps://datakitchen.io/blog/your-generative-ai-llm-needs-a-data-journey-a-comprehensive-guide-for-data-engineers/https://datakitchen.io/blog/your-generative-ai-llm-needs-a-data-journey-a-comprehensive-guide-for-data-engineers/Large Language Models (LLMs) and Generative AI are all the rage right now but will only work for organizations that have a solid grasp on the quality of their data and the series of operations acting upon that data to augment the base LLM.Tue, 27 Feb 2024 00:00:00 GMTChris Berghhttps://datakitchen.io/blog/datakitchen-resource-guide-to-data-journeys-data-observability-dataops/https://datakitchen.io/blog/datakitchen-resource-guide-to-data-journeys-data-observability-dataops/A list of the best Data (and Analytic) Observability & Data Journey – Ideas and Background LinksFri, 23 Feb 2024 00:00:00 GMTChris Berghhttps://datakitchen.io/blog/the-art-of-data-buck-passing-101/https://datakitchen.io/blog/the-art-of-data-buck-passing-101/In data and analytics, one skill stands timeless and universal: the art of blaming someone else when things go sideways. In this humorous blog, learn from the best!Thu, 22 Feb 2024 00:00:00 GMTChris Berghhttps://datakitchen.io/blog/navigating-the-chaos-of-unruly-data-solutions-for-data-teams/https://datakitchen.io/blog/navigating-the-chaos-of-unruly-data-solutions-for-data-teams/Data teams have out-of-control databases/data lakes, with many users and tools constantly changing data, many users and tools out of their control, and an unknown/uncontrolled ETL/ELT process with no data quality tests. As a result, they are left with the blame for bad data and have limited ways to affect the actions of others who are changing the data. They need help to quickly identify anomalies and problems in the data before someone finds it.Fri, 10 Nov 2023 00:00:00 GMTChris Berghhttps://datakitchen.io/blog/the-need-for-personalized-data-journeys-for-your-data-consumers/https://datakitchen.io/blog/the-need-for-personalized-data-journeys-for-your-data-consumers/Demanding Data Consumers require a personalized level of Data Observability. As opposed to receiving one-size-fits-all status updates, these key stakeholders desire real-time, granular insights into the status of their specific data as it traverses the complicated data production pipeline. Learn why this is essential to your success.Fri, 20 Oct 2023 00:00:00 GMTChris Berghhttps://datakitchen.io/blog/war-roooms-suck/https://datakitchen.io/blog/war-roooms-suck/Data analytic team war rooms, often convened for emergency problem-solving, epitomize inefficiency and detract from proactive, value-driven tasks. By leveraging data observability and rigorous testing, issues can be detected and resolved early, negating the need for such reactive measures in the modern era of DataOps.Thu, 12 Oct 2023 00:00:00 GMTDataKitchen Marketing Teamhttps://datakitchen.io/blog/data-teams-and-their-types-of-data-journeys/https://datakitchen.io/blog/data-teams-and-their-types-of-data-journeys/The article illuminates how Data Journeys can enhance data governance, improve operational efficiency, and ultimately lead to organizational success by thoroughly examining different Data Journey types— 'Watcher,' 'Traveler,’ ‘Hub & Spoke,’ and 'Payload.'Mon, 02 Oct 2023 00:00:00 GMTChris Berghhttps://datakitchen.io/blog/bridging-the-gap-how-data-in-place-and-data-in-use-define-complete-data-observability/https://datakitchen.io/blog/bridging-the-gap-how-data-in-place-and-data-in-use-define-complete-data-observability/The uncertainty of not knowing where data issues will crop up next and the tiresome game of 'who's to blame' when pinpointing the failure. This is where the true power of complete data observability comes into play, and it's time to get acquainted with its two critical parts: 'Data in Place' and 'Data in Use.'Thu, 21 Sep 2023 00:00:00 GMTChris Berghhttps://datakitchen.io/books/announcing-the-dataops-cookbook-third-edition/https://datakitchen.io/books/announcing-the-dataops-cookbook-third-edition/The third edition of The DataOps Cookbook leads with the journey data takes through production: what changed, and the chapters that are new.Thu, 24 Aug 2023 00:00:00 GMTChris Berghhttps://datakitchen.io/the-dataops-cookbook/https://datakitchen.io/the-dataops-cookbook/The DataOps Cookbook, 3rd Edition: how DataOps applies software and manufacturing practice to turn data chaos into fast, error-free insight. Free download.Thu, 24 Aug 2023 00:00:00 GMTChris Berghhttps://datakitchen.io/blog/a-summary-of-gartners-recent-innovation-insight-into-data-observability/https://datakitchen.io/blog/a-summary-of-gartners-recent-innovation-insight-into-data-observability/On 20 July 2023, Gartner released the article “Innovation Insight: Data Observability Enables Proactive Data Quality” by Melody Chien. DataKitchen Summarizes and commentsTue, 08 Aug 2023 00:00:00 GMTChris Berghhttps://datakitchen.io/blog/the-ten-standard-tools-to-develop-data-pipelines-in-microsoft-azure/https://datakitchen.io/blog/the-ten-standard-tools-to-develop-data-pipelines-in-microsoft-azure/The Ten Standard Tools To Develop Data Pipelines In Microsoft Azure. Is it overkill? Paradox of choice? Or the right tool for the right job? We discuss.Thu, 27 Jul 2023 00:00:00 GMTChris Berghhttps://datakitchen.io/blog/the-syntax-semantics-and-pragmatics-gap-in-data-quality-validate-testing/https://datakitchen.io/blog/the-syntax-semantics-and-pragmatics-gap-in-data-quality-validate-testing/What is the full range of data quality validation tests for data at rest and data in use? Linguistics provides an organizing principle: syntax, semantics, and pragmaticsWed, 12 Jul 2023 00:00:00 GMTChris Berghhttps://datakitchen.io/blog/data-journey-first-dataops/https://datakitchen.io/blog/data-journey-first-dataops/'Data Journey First DataOps': it's a revolution in which every data, tool, server, and step becomes part of a meaningful story, enhancing our data initiatives' overall value, impact, and trust.Mon, 03 Jul 2023 00:00:00 GMTDataKitchen Marketing Teamhttps://datakitchen.io/blog/introducing-the-five-pillars-of-data-journeys/https://datakitchen.io/blog/introducing-the-five-pillars-of-data-journeys/The "Five Pillars of Data Journeys" outline a comprehensive approach to tracking and monitoring data across its lifecycle.Mon, 19 Jun 2023 00:00:00 GMTChris Berghhttps://datakitchen.io/blog/why-the-data-journey-manifesto/https://datakitchen.io/blog/why-the-data-journey-manifesto/Why the Data Journey Manifesto? So why another manifesto in the world? Really? Why should I care?Mon, 12 Jun 2023 00:00:00 GMTChris Berghhttps://datakitchen.io/blog/data-mesh-and-data-products/https://datakitchen.io/blog/data-mesh-and-data-products/Chris Bergh, CEO of DataKitchen, delivered a webinar on two themes - Data Products and Data Mesh. Bergh started by discussing the complexity within data and analytics teams, stating that complexity makes everything more complicated and, in the long run, it kills productivity.Thu, 04 May 2023 00:00:00 GMTChris Berghhttps://datakitchen.io/blog/webinar-summary-driving-data-analytic-team-excellence-through-agility-efficiency-and-aphorisms/https://datakitchen.io/blog/webinar-summary-driving-data-analytic-team-excellence-through-agility-efficiency-and-aphorisms/In the webinar "Driving Data Analytic Team Excellence Through Agility, Efficiency, and Aphorisms," James Royster, Vice President of Commercial Operations, Insights, and Analytics at Karuna Therapeutics, shared his insights on leading efficient and effective data analytics teams.Tue, 11 Apr 2023 00:00:00 GMTChris Berghhttps://datakitchen.io/blog/two-downs-make-two-ups-the-only-success-metrics-that-matter-for-your-data-analytics-team/https://datakitchen.io/blog/two-downs-make-two-ups-the-only-success-metrics-that-matter-for-your-data-analytics-team/You spend all day helping your customers leverage analytics for improved business performance, so why are you so un-analytic about how you run your data analytics teams? Where is your data and analytic team metrics report?Thu, 16 Mar 2023 00:00:00 GMTChris Berghhttps://datakitchen.io/blog/only-one-problem-to-solve-for-successful-data-and-analytics/https://datakitchen.io/blog/only-one-problem-to-solve-for-successful-data-and-analytics/The real problem in data analytics is that teams need to deliver insight to their customers without error put new ideas into production rapidly minimize their ‘insight manufacturing’ expenses ... all at the same timeWed, 08 Mar 2023 00:00:00 GMTChris Berghhttps://datakitchen.io/blog/gartner-5-ways-to-enhance-your-data-engineering-practices/https://datakitchen.io/blog/gartner-5-ways-to-enhance-your-data-engineering-practices/Gartner released the article “5 Ways to Enhance Your Data Engineering Practices.” By Robert Thanaraj, Ehtisham Zaidi, and 2 more. DataKitchen gives its perspective.Tue, 21 Feb 2023 00:00:00 GMTChris Berghhttps://datakitchen.io/blog/why-i-chose-datakitchen/https://datakitchen.io/blog/why-i-chose-datakitchen/A first-person account from an analytics leader who spent nearly seven years running a data and analytics function at Celgene: why the team chose DataKitchen, and the three DataOps practices that carried it.Fri, 17 Feb 2023 00:00:00 GMTJames Roysterhttps://datakitchen.io/blog/a-data-prediction-for-2025/https://datakitchen.io/blog/a-data-prediction-for-2025/What will the world of data tools be like at the end of 2025? The crazy idea is that data teams are beyond the boom decade of “spending extravagance” and need to focus on doing more with less.Thu, 02 Feb 2023 00:00:00 GMTChris Berghhttps://datakitchen.io/blog/you-complete-me-said-data-lineage-to-dataops-observability/https://datakitchen.io/blog/you-complete-me-said-data-lineage-to-dataops-observability/The benefits of a long-lasting relationship between Data Journeys and data lineage can help give a complete view of your data operations. Both tools help deliver more trusted insight to your customer.Mon, 23 Jan 2023 00:00:00 GMTChris Berghhttps://datakitchen.io/blog/plumbing-wisdom-for-data-pipelines/https://datakitchen.io/blog/plumbing-wisdom-for-data-pipelines/While admiring the latest cloud tech, don't forget that humans have been debugging pipelines since the Romans built the aqueducts. Any good plumber can give you some hard-won tips on managing data pipelines effectively, insights that might save your career from going down the drain.Wed, 18 Jan 2023 00:00:00 GMTChip Blochehttps://datakitchen.io/blog/the-terms-and-conditions-of-a-data-contract-are-data-tests/https://datakitchen.io/blog/the-terms-and-conditions-of-a-data-contract-are-data-tests/Data contracts are a new idea for data and analytic team development to ensure that data is transmitted accurately and consistently between different systems or teams. The Terms and Conditions of a Data Contract are Automated Production Data Tests.Thu, 29 Dec 2022 00:00:00 GMTChris Berghhttps://datakitchen.io/blog/an-ai-chat-bot-wrote-this-blog-post/https://datakitchen.io/blog/an-ai-chat-bot-wrote-this-blog-post/We asked an AI Chat Bot (https://chat.openai.com/chat) a few questions about DataOps. It got a bit silly at the end.Fri, 09 Dec 2022 00:00:00 GMTChris Berghhttps://datakitchen.io/blog/datakitchen-super-cool/https://datakitchen.io/blog/datakitchen-super-cool/DataKitchen, the leading provider of DataOps solutions, has been named a Representative and “super cool, way out there, OP, world best” DataOps vendor in the December 2022 Gartner® Market Guide for DataOps Tools.Fri, 09 Dec 2022 00:00:00 GMTDataKitchen Marketing Teamhttps://datakitchen.io/blog/gartner-market-guide-to-dataops-software/https://datakitchen.io/blog/gartner-market-guide-to-dataops-software/Gartner released its 'Market Guide to DataOps Tools' The document they wrote is exceptionally close to what DataKitchen sees in the market and what our products do! Here is our take on the guide.Tue, 06 Dec 2022 00:00:00 GMTChris Berghhttps://datakitchen.io/blog/dataops-observability-and-automation-to-the-rescue/https://datakitchen.io/blog/dataops-observability-and-automation-to-the-rescue/Feeling overwhelmed by your data job? Don't worry, DataOps is here to help! This post discusses how DataOps Observability and Automation can relieve team stress and show you how to get started.Thu, 01 Dec 2022 00:00:00 GMTChris Berghhttps://datakitchen.io/blog/dataops-observability-taming-the-chaos-part-4/https://datakitchen.io/blog/dataops-observability-taming-the-chaos-part-4/This is the fourth post in DataKitchen's four-part series on DataOps Observability. Observability is a methodology for providing visibility of every journey that data takes from source to customer value across every tool, environment, data store, team, and customer so that problems are detected and addressed immediately.Mon, 28 Nov 2022 00:00:00 GMTDataKitchen Marketing Teamhttps://datakitchen.io/blog/dataops-observability-taming-the-chaos-part-3/https://datakitchen.io/blog/dataops-observability-taming-the-chaos-part-3/This is the third post in DataKitchen's four-part series on DataOps Observability. Observability is a methodology for providing visibility of every journey that data takes from source to customer value across every tool, environment, data store, team, and customer so that problems are detected and addressed immediately.Fri, 18 Nov 2022 00:00:00 GMTDataKitchen Marketing Teamhttps://datakitchen.io/blog/difference-between-data-quality-and-dataops-observability/https://datakitchen.io/blog/difference-between-data-quality-and-dataops-observability/Data Quality and Data/Ops Observability … what is the difference? Here we share a financial analogy.Fri, 18 Nov 2022 00:00:00 GMTDataKitchen Marketing Teamhttps://datakitchen.io/blog/stick-thermometers-in-data-journeys/https://datakitchen.io/blog/stick-thermometers-in-data-journeys/The first step in solving your data team's pain is to observe what's happening with your data and analytics 'estate' and stick little thermometers at various points in the process.Thu, 27 Oct 2022 00:00:00 GMTDataKitchen Marketing Teamhttps://datakitchen.io/blog/dataops-observability-taming-the-chaos-part-2/https://datakitchen.io/blog/dataops-observability-taming-the-chaos-part-2/This is the second post in DataKitchen's four-part series on DataOps Observability. Observability is a methodology for providing visibility of every journey that data takes from source to customer value across every tool, environment, data store, team, and customer so that problems are detected and addressed immediately.Tue, 25 Oct 2022 00:00:00 GMTDataKitchen Marketing Teamhttps://datakitchen.io/blog/the-perils-of-heroic-data-work-just-say-eww/https://datakitchen.io/blog/the-perils-of-heroic-data-work-just-say-eww/We've all been there. You're up against a deadline, working tirelessly to get the job done. I know how tempting it can be to take shortcuts when you're under pressure. But trust me when I say that it's not worth it.Tue, 18 Oct 2022 00:00:00 GMTDataKitchen Marketing Teamhttps://datakitchen.io/blog/dataops-observability-chaos-part-1/https://datakitchen.io/blog/dataops-observability-chaos-part-1/This is the first post in DataKitchen's four-part series on DataOps Observability. Observability is a methodology for providing visibility of every journey that data takes from source to customer value across every tool, environment, data store, team, and customer so that problems are detected and addressed immediately. DataKitchen has released the first version of its Observability product, which implements the concepts described in this series.Thu, 06 Oct 2022 00:00:00 GMTDataKitchen Marketing Teamhttps://datakitchen.io/blog/dataops-mission-control-and-managing-your-data-infrastructure-risk/https://datakitchen.io/blog/dataops-mission-control-and-managing-your-data-infrastructure-risk/The Head of data got a call from the CEO of the entire company about a compliance report that was empty, with no data. So, he had to rally 26 different people across his team all-day And what was the problem? A field passed through the pipeline that was blank. Can you imagine how embarrassed he is at the error? How frustrated all those 26 people -- most likely the best he has on his team -- at having to chase a crappy error? And he has 1000 other pipelines in the same 'hope it works' position, just waiting for some customer to find a problem. High risk, indeed.Wed, 01 Jun 2022 00:00:00 GMTDataKitchen Marketing Teamhttps://datakitchen.io/blog/datakitchen-named-a-representative-vendor-in-the-2022-gartner-data-and-analytics-essentials-dataops-report/https://datakitchen.io/blog/datakitchen-named-a-representative-vendor-in-the-2022-gartner-data-and-analytics-essentials-dataops-report/"The goal of DataOps is to enable predictable delivery and change management of data and all data-related artifacts such as data pipelines, data models and semantics"Mon, 23 May 2022 00:00:00 GMTDataKitchen Marketing Teamhttps://datakitchen.io/blog/fire-your-super-smart-data-consultants-with-dataops/https://datakitchen.io/blog/fire-your-super-smart-data-consultants-with-dataops/Outsourcing data engineering relocates complexity, it doesn't remove it. See how DataOps automation cuts consulting fees and restores control of your data.Tue, 25 Jan 2022 00:00:00 GMTDataKitchen Marketing Teamhttps://datakitchen.io/blog/dataops-with-matillion-and-datakitchen/https://datakitchen.io/blog/dataops-with-matillion-and-datakitchen/Matillion moves and transforms your data; DataOps adds the orchestration, testing, and environments around it. How the two fit together on a cross-cloud stack like Snowflake.Wed, 19 Jan 2022 00:00:00 GMTGil Benghiathttps://datakitchen.io/blog/dataops-for-business-analytics-teams/https://datakitchen.io/blog/dataops-for-business-analytics-teams/Business analysts drown in manual data prep and firefighting. A DataOps process hub automates their analytics workflows without adding staff or losing quality.Mon, 03 Jan 2022 00:00:00 GMTDataKitchen Marketing Teamhttps://datakitchen.io/blog/datakitchens-best-of-2021-dataops-resources/https://datakitchen.io/blog/datakitchens-best-of-2021-dataops-resources/DataKitchen's most popular DataOps content of 2021: the top ten blog posts, five white papers, and five webinars on data mesh, XOps, observability, and more.Mon, 13 Dec 2021 00:00:00 GMTDataKitchen Marketing Teamhttps://datakitchen.io/blog/2021-gift-giving-guide-for-data-nerds/https://datakitchen.io/blog/2021-gift-giving-guide-for-data-nerds/Eight books to gift the data nerd in your life, from Randy Bean's Fail Fast, Learn Faster to Zhamak Dehghani's Data Mesh and Jesse Anderson's Data Teams.Tue, 07 Dec 2021 00:00:00 GMTDataKitchen Marketing Teamhttps://datakitchen.io/blog/eight-top-dataops-trends-for-2022/https://datakitchen.io/blog/eight-top-dataops-trends-for-2022/Eight DataOps trends shaping 2022, from AI accountability and data mesh to the rise of the DataOps engineer, observability, and the great resignation in data.Mon, 29 Nov 2021 00:00:00 GMTDataKitchen Marketing Teamhttps://datakitchen.io/blog/how-to-succeed-as-a-dataops-engineer/https://datakitchen.io/blog/how-to-succeed-as-a-dataops-engineer/What makes an effective DataOps engineer? Curating repeatable processes, shepherding data across the org, and running toward errors instead of avoiding them.Sat, 20 Nov 2021 00:00:00 GMTChip Blochehttps://datakitchen.io/blog/10-dataops-principles-for-overcoming-data-engineer-burnout/https://datakitchen.io/blog/10-dataops-principles-for-overcoming-data-engineer-burnout/97% of data engineers report burnout. These 10 DataOps principles help teams stop firefighting, automate manual work, and build systems that scale.Thu, 18 Nov 2021 00:00:00 GMTDataKitchen Marketing Teamhttps://datakitchen.io/blog/centralize-your-data-processes-with-a-dataops-process-hub/https://datakitchen.io/blog/centralize-your-data-processes-with-a-dataops-process-hub/A DataOps process hub centralizes and automates the workflows that act on your data, solving the analytics last-mile problem without armies of consultants.Thu, 04 Nov 2021 00:00:00 GMTDataKitchen Marketing Teamhttps://datakitchen.io/blog/what-is-equity-as-code-and-how-can-it-eliminate-ai-bias-2/https://datakitchen.io/blog/what-is-equity-as-code-and-how-can-it-eliminate-ai-bias-2/AI models can absorb and scale human bias. 'Equity as code' builds bias controls into data analytics workflows instead of relying on individual vigilance.Thu, 28 Oct 2021 00:00:00 GMTChris Berghhttps://datakitchen.io/blog/infographic-data-engineers-are-burned-out-and-calling-for-dataops/https://datakitchen.io/blog/infographic-data-engineers-are-burned-out-and-calling-for-dataops/A data.world and DataKitchen survey of 600 data engineers finds most are burned out and calling for DataOps. See the results in this infographic.Mon, 25 Oct 2021 00:00:00 GMTDataKitchen Marketing Teamhttps://datakitchen.io/blog/a-day-in-the-life-of-a-dataops-engineer-2/https://datakitchen.io/blog/a-day-in-the-life-of-a-dataops-engineer-2/Inside a DataOps implementation project: understanding the team's challenges, defining 'done,' and replacing broken manual pipelines with automation.Mon, 11 Oct 2021 00:00:00 GMTGil Benghiathttps://datakitchen.io/blog/what-is-a-dataops-engineer/https://datakitchen.io/blog/what-is-a-dataops-engineer/A DataOps engineer owns the assembly line that turns raw data into dashboards and models. What the role does and why the data factory needs it.Tue, 05 Oct 2021 00:00:00 GMTDataKitchen Marketing Teamhttps://datakitchen.io/blog/start-dataops-today-with-lean-dataops/https://datakitchen.io/blog/start-dataops-today-with-lean-dataops/You don't need a full enterprise overhaul to start DataOps. Lean DataOps applies Agile in small steps for the most benefit per dollar invested.Mon, 20 Sep 2021 00:00:00 GMTDataKitchen Marketing Teamhttps://datakitchen.io/blog/dataops-is-the-factory-that-supports-your-data-mesh/https://datakitchen.io/blog/dataops-is-the-factory-that-supports-your-data-mesh/Data mesh sets the architecture; DataOps runs the factory. How a DataOps process hub automates the workflows that make a data mesh actually work.Fri, 17 Sep 2021 00:00:00 GMTDataKitchen Marketing Teamhttps://datakitchen.io/blog/implementing-a-pharma-data-mesh-using-dataops/https://datakitchen.io/blog/implementing-a-pharma-data-mesh-using-dataops/A real-world pharma data mesh: how domains map to a drug's lifecycle phases and the lessons learned from an actual DataOps implementation.Thu, 19 Aug 2021 00:00:00 GMTDataKitchen Marketing Teamhttps://datakitchen.io/blog/accelerating-drug-discovery-and-development-with-dataops/https://datakitchen.io/blog/accelerating-drug-discovery-and-development-with-dataops/Drug development runs 15 years and a billion dollars. How DataOps automation helps pharma R&D master heterogeneous tools and compress that timeline.Fri, 13 Aug 2021 00:00:00 GMTDataKitchen Marketing Teamhttps://datakitchen.io/blog/addressing-data-mesh-technical-challenges-with-dataops/https://datakitchen.io/blog/addressing-data-mesh-technical-challenges-with-dataops/The technical side of data mesh: how DataOps handles inter-domain dependencies, order-of-operations, and shared services without a rebuild.Mon, 09 Aug 2021 00:00:00 GMTDataKitchen Marketing Teamhttps://datakitchen.io/blog/use-dataops-with-your-data-mesh-to-prevent-data-mush/https://datakitchen.io/blog/use-dataops-with-your-data-mesh-to-prevent-data-mush/A decentralized data mesh can descend into 'data mush' without coordination. How DataOps pairs with data mesh to keep domains working in concert.Thu, 05 Aug 2021 00:00:00 GMTDataKitchen Marketing Teamhttps://datakitchen.io/blog/what-is-a-data-mesh/https://datakitchen.io/blog/what-is-a-data-mesh/A data mesh breaks monolithic data architectures into domain-owned subsystems. What the design pattern is, why it emerged, and where it helps.Tue, 03 Aug 2021 00:00:00 GMTDataKitchen Marketing Teamhttps://datakitchen.io/blog/using-dataops-to-drive-agility-and-business-value/https://datakitchen.io/blog/using-dataops-to-drive-agility-and-business-value/"How do you make it so that your data and analytics team can get the ideas from their heads into production quicker? How do you create a process like a factory that produces Toyotas and not AMC Pacers? How can you get these teams who work all over the company to collaborate better? Those are the problems that DataOps solves."Thu, 24 Jun 2021 00:00:00 GMTDataKitchen Marketing Teamhttps://datakitchen.io/blog/datakitchen-releases-pivotal-book-on-dataops-transformation/https://datakitchen.io/blog/datakitchen-releases-pivotal-book-on-dataops-transformation/First-of-its-Kind DataOps Guide Facilitates Enterprise-Wide Organizational ChangeWed, 16 Jun 2021 00:00:00 GMTDataKitchen Marketing Teamhttps://datakitchen.io/books/recipes-for-dataops-success-guide-to-dataops-transformation/https://datakitchen.io/books/recipes-for-dataops-success-guide-to-dataops-transformation/Recipes for DataOps Success: a complete guide to enterprise DataOps transformation — how to build support, pick a first project, and scale beyond one team.Wed, 16 Jun 2021 00:00:00 GMTChris Berghhttps://datakitchen.io/blog/data-observability-and-monitoring-with-dataops/https://datakitchen.io/blog/data-observability-and-monitoring-with-dataops/How DataOps drives data observability to cut data errors to near zero, using testing and monitoring you already have rather than shiny new tools.Mon, 10 May 2021 00:00:00 GMTDataKitchen Marketing Teamhttps://datakitchen.io/blog/forrester-chart-your-course-to-insights-driven-business-maturity/https://datakitchen.io/blog/forrester-chart-your-course-to-insights-driven-business-maturity/Forrester's five actions to advance your insights-driven business maturity, with DataOps and ModelOps guidance for beginners through advanced firms.Mon, 10 May 2021 00:00:00 GMTDataKitchen Marketing Teamhttps://datakitchen.io/blog/dataops-enables-your-data-fabric/https://datakitchen.io/blog/dataops-enables-your-data-fabric/Data fabric is an architecture, not a toolset, and buying one won't fix slow, error-prone pipelines. Why a DataOps process fabric comes first.Wed, 28 Apr 2021 00:00:00 GMTDataKitchen Marketing Teamhttps://datakitchen.io/blog/the-journey-to-dataops-success-key-takeaways-from-transformation-trailblazers/https://datakitchen.io/blog/the-journey-to-dataops-success-key-takeaways-from-transformation-trailblazers/Leaders from Workiva and GSK share what worked in their DataOps transformation: finding your biggest pain point, mindset shifts, and proving value.Mon, 26 Apr 2021 00:00:00 GMTDataKitchen Marketing Teamhttps://datakitchen.io/blog/the-dataops-vendor-landscape-2021/https://datakitchen.io/blog/the-dataops-vendor-landscape-2021/A guide to the 2021 DataOps vendor landscape: 100+ companies mapped across the six capabilities that define DataOps, from orchestration to observability.Tue, 13 Apr 2021 00:00:00 GMTDataKitchen Marketing Teamhttps://datakitchen.io/blog/improving-collaboration-with-a-dataops-platform/https://datakitchen.io/blog/improving-collaboration-with-a-dataops-platform/A Fortune 500 healthcare company ran one team on an on-prem warehouse in New Jersey and another on Azure in California. Every schema change broke something downstream.Mon, 29 Mar 2021 00:00:00 GMTDataKitchen Marketing Teamhttps://datakitchen.io/blog/gartner-top-trends-in-data-and-analytics-for-2021-xops/https://datakitchen.io/blog/gartner-top-trends-in-data-and-analytics-for-2021-xops/Gartner named XOps (DataOps, ModelOps, DevOps) a top 2021 data and analytics trend. What XOps means, with further reading on each discipline.Thu, 11 Mar 2021 00:00:00 GMTDataKitchen Marketing Teamhttps://datakitchen.io/blog/how-dataops-kitchens-enable-version-control/https://datakitchen.io/blog/how-dataops-kitchens-enable-version-control/How DataOps Kitchens bring version control to analytics, supporting continuous integration, delivery, and deployment across data development workflows.Thu, 04 Feb 2021 00:00:00 GMTDataKitchen Marketing Teamhttps://datakitchen.io/blog/pitching-a-dataops-project-that-matters/https://datakitchen.io/blog/pitching-a-dataops-project-that-matters/How to choose a DataOps pilot project that resonates: tie it to business objectives, find unhappy analytics users, and target high-visibility wins.Mon, 01 Feb 2021 00:00:00 GMTDataKitchen Marketing Teamhttps://datakitchen.io/blog/dataops-reports-that-keep-your-finger-on-the-pulse/https://datakitchen.io/blog/dataops-reports-that-keep-your-finger-on-the-pulse/How the DataOps Pulse Report gives teams up-to-the-minute build status, tracking data source arrivals and daily builds to catch pipeline problems early.Mon, 25 Jan 2021 00:00:00 GMTChip Blochehttps://datakitchen.io/blog/do-you-need-a-dataops-dojo/https://datakitchen.io/blog/do-you-need-a-dataops-dojo/Should DataOps be centralized or decentralized? A look at DataOps technical services, centers of excellence, and dojos for building expertise at scale.Wed, 20 Jan 2021 00:00:00 GMTDataKitchen Marketing Teamhttps://datakitchen.io/blog/the-business-case-for-dataops/https://datakitchen.io/blog/the-business-case-for-dataops/Three approaches to quantifying the ROI of DataOps, starting with resource redeployment, to help you build a business case executives will support.Wed, 06 Jan 2021 00:00:00 GMTDataKitchen Marketing Teamhttps://datakitchen.io/blog/dataops-facilitates-remote-work/https://datakitchen.io/blog/dataops-facilitates-remote-work/Remote work exposes the fragility of siloed data workflows. See how DataOps automation unifies toolchains and improves coordination across data teams.Tue, 05 Jan 2021 00:00:00 GMTDataKitchen Marketing Teamhttps://datakitchen.io/blog/gartner-operational-ai-requires-data-engineering-dataops-and-data-ai-role-alignment/https://datakitchen.io/blog/gartner-operational-ai-requires-data-engineering-dataops-and-data-ai-role-alignment/Recommendations for Further ReadingSat, 02 Jan 2021 00:00:00 GMTDataKitchen Marketing Teamhttps://datakitchen.io/blog/datakitchen-2020-dataops-honors-awards/https://datakitchen.io/blog/datakitchen-2020-dataops-honors-awards/A recap of the industry awards and honors DataKitchen earned in 2020, from DBTA's 100 Companies That Matter to CRN's hottest data science startups.Wed, 30 Dec 2020 00:00:00 GMTDataKitchen Marketing Teamhttps://datakitchen.io/blog/best-of-2020-dataops-resources/https://datakitchen.io/blog/best-of-2020-dataops-resources/A roundup of DataKitchen's best DataOps content from 2020: the top five white papers, top five webinars, and top ten blog posts to guide your journey.Mon, 21 Dec 2020 00:00:00 GMTDataKitchen Marketing Teamhttps://datakitchen.io/blog/improve-business-agility-by-hiring-a-dataops-engineer/https://datakitchen.io/blog/improve-business-agility-by-hiring-a-dataops-engineer/A DataOps engineer automates data workflows and clears bottlenecks, making analytics faster and more responsive. Why this role should be your first hire.Sun, 20 Dec 2020 00:00:00 GMTDataKitchen Marketing Teamhttps://datakitchen.io/blog/infographic-6-dimensions-of-dataops-maturity/https://datakitchen.io/blog/infographic-6-dimensions-of-dataops-maturity/An infographic mapping the six dimensions of DataOps maturity, so you can benchmark your organization's proficiency and see how your team stacks up.Wed, 16 Dec 2020 00:00:00 GMTDataKitchen Marketing Teamhttps://datakitchen.io/blog/infographic-7-steps-to-implement-dataops/https://datakitchen.io/blog/infographic-7-steps-to-implement-dataops/An infographic outlining the seven steps to implement DataOps, drawn from DataKitchen's white paper, so you can share the roadmap with your colleagues.Mon, 14 Dec 2020 00:00:00 GMTDataKitchen Marketing Teamhttps://datakitchen.io/blog/forrester-dataops-for-the-intelligent-edge-of-business-recommendations-for-further-reading/https://datakitchen.io/blog/forrester-dataops-for-the-intelligent-edge-of-business-recommendations-for-further-reading/Further reading paired with Forrester's DataOps for the Intelligent Edge of Business, covering data quality, faster delivery, reuse, and governance.Sun, 13 Dec 2020 00:00:00 GMTDataKitchen Marketing Teamhttps://datakitchen.io/blog/infographic-6-steps-to-an-enterprise-dataops-transformation/https://datakitchen.io/blog/infographic-6-steps-to-an-enterprise-dataops-transformation/An infographic breaking down the six steps to an enterprise DataOps transformation, from educating your team to scaling DataOps across the organization.Thu, 10 Dec 2020 00:00:00 GMTDataKitchen Marketing Teamhttps://datakitchen.io/blog/finding-an-executive-sponsor-for-your-dataops-initiative/https://datakitchen.io/blog/finding-an-executive-sponsor-for-your-dataops-initiative/Executive sponsorship gives a DataOps initiative air cover and budget. Here's how to connect DataOps to business outcomes and win C-level backing.Tue, 08 Dec 2020 00:00:00 GMTDataKitchen Marketing Teamhttps://datakitchen.io/blog/eckerson-group-dataops-deep-dive/https://datakitchen.io/blog/eckerson-group-dataops-deep-dive/Joe Hilleary's December 2020 Eckerson Group report on four DataOps platforms, reproduced from the abridged DataKitchen reprint, with our commentary on what has changed since.Mon, 07 Dec 2020 00:00:00 GMTJoe Hillearyhttps://datakitchen.io/blog/datakitchen-awarded-best-dataops-solution-provider-by-the-data-management-insight-awards-2020/https://datakitchen.io/blog/datakitchen-awarded-best-dataops-solution-provider-by-the-data-management-insight-awards-2020/DataKitchen has been named Best DataOps Solution Provider at the 2020 Data Management Insight Awards, voted by readers and shortlisted by the DMI board.Thu, 03 Dec 2020 00:00:00 GMTDataKitchen Marketing Teamhttps://datakitchen.io/blog/6-top-dataops-trends-for-2021/https://datakitchen.io/blog/6-top-dataops-trends-for-2021/Our six DataOps predictions for 2021: enterprise transformation, data observability, DataGovOps, the rise of the DataOps engineer, and self-service sandboxes.Tue, 01 Dec 2020 00:00:00 GMTDataKitchen Marketing Teamhttps://datakitchen.io/blog/6-highly-recommendable-gift-ideas-for-your-data-nerd/https://datakitchen.io/blog/6-highly-recommendable-gift-ideas-for-your-data-nerd/Shopping for the data lover in your life? Here are six standout books on DataOps, data teams, and data governance to gift your favorite data nerd.Sun, 29 Nov 2020 00:00:00 GMTDataKitchen Marketing Teamhttps://datakitchen.io/blog/accelerating-analytic-cycle-time-with-dataops/https://datakitchen.io/blog/accelerating-analytic-cycle-time-with-dataops/A large telecom company needed more than four months to release new analytics. Four manual deployment stages, no automated testing, and business users finding the errors first.Fri, 06 Nov 2020 00:00:00 GMTDataKitchenhttps://datakitchen.io/blog/what-is-dataops-most-commonly-asked-questions/https://datakitchen.io/blog/what-is-dataops-most-commonly-asked-questions/The practical questions data teams ask before starting DataOps: where to begin, who owns it, how long it takes, what to measure, and what usually goes wrong.Thu, 29 Oct 2020 00:00:00 GMTDataKitchenhttps://datakitchen.io/blog/the-what-why-and-how-of-dataops/https://datakitchen.io/blog/the-what-why-and-how-of-dataops/Max Kurton of EM360 interviewed DataKitchen CEO Chris Bergh on the what, why, and how of DataOps. Where to hear it, and what we were arguing at the time.Wed, 28 Oct 2020 00:00:00 GMTDataKitchenhttps://datakitchen.io/blog/datakitchen-introduces-dataops-transformation-advisory-service/https://datakitchen.io/blog/datakitchen-introduces-dataops-transformation-advisory-service/DataKitchen launches a DataOps Transformation Advisory Service offering strategy, technical assessment, maturity modeling, and training for enterprise teams.Mon, 26 Oct 2020 00:00:00 GMTDataKitchenhttps://datakitchen.io/blog/why-devops-tools-fail-at-dataops/https://datakitchen.io/blog/why-devops-tools-fail-at-dataops/DevOps and workflow tools like Airflow leave gaps in data analytics. Why DataOps needs meta-orchestration, integrated testing, and end-to-end pipelines.Mon, 26 Oct 2020 00:00:00 GMTChris Berghhttps://datakitchen.io/blog/podcast-the-data-engineering-podcast-taming-organizational-complexity-in-your-data-driven-organization-with-dataops/https://datakitchen.io/blog/podcast-the-data-engineering-podcast-taming-organizational-complexity-in-your-data-driven-organization-with-dataops/Our summary of DataKitchen CEO Chris Bergh on The Data Engineering Podcast with Tobias Macey: why the hardest problem in analytics is the org chart, and what to build instead of scheduling another meeting.Mon, 19 Oct 2020 00:00:00 GMTDataKitchenhttps://datakitchen.io/blog/improving-teamwork-in-data-analytics-with-dataops/https://datakitchen.io/blog/improving-teamwork-in-data-analytics-with-dataops/When a bad system overwhelms good people, it looks like a teamwork problem. How DataOps fixes the broken workflows behind data team conflict and delays.Sun, 18 Oct 2020 00:00:00 GMTDataKitchen Marketing Teamhttps://datakitchen.io/blog/prove-your-teams-awesomeness-with-dataops-process-analytics/https://datakitchen.io/blog/prove-your-teams-awesomeness-with-dataops-process-analytics/One of the main goals of analytics is to improve decision-making. The CDO DataOps Dashboard puts information at the fingertips of executives, so they have a complete picture of what is happening in the data analytics domain.Thu, 15 Oct 2020 00:00:00 GMTDataKitchen Marketing Teamhttps://datakitchen.io/blog/gartner-3-ways-to-deliver-customer-value-faster-with-dataops/https://datakitchen.io/blog/gartner-3-ways-to-deliver-customer-value-faster-with-dataops/A summary and recommendations for further readingMon, 05 Oct 2020 00:00:00 GMTDataKitchen Marketing Teamhttps://datakitchen.io/blog/deliver-ml-and-ai-models-at-scale-with-modelops/https://datakitchen.io/blog/deliver-ml-and-ai-models-at-scale-with-modelops/Data scientists work tirelessly to build and train a model then face the daunting challenge of deploying it into production. The model itself is only a fraction of the overall ML system.Tue, 15 Sep 2020 00:00:00 GMTDataKitchen Marketing Teamhttps://datakitchen.io/blog/continuous-governance-with-datagovops/https://datakitchen.io/blog/continuous-governance-with-datagovops/DataGovOps turns manual, error-prone governance into automated, repeatable orchestrations that run continuously as part of DataOps development workflows.Thu, 03 Sep 2020 00:00:00 GMTDataKitchen Marketing Teamhttps://datakitchen.io/blog/meeting-the-product-launch-challenge-with-dataops/https://datakitchen.io/blog/meeting-the-product-launch-challenge-with-dataops/Celgene had one shot at the Otezla launch. More than 1,000 dashboards, hundreds of data sets, 100 schema changes a week, and 20,000 automated tests holding it together.Fri, 14 Aug 2020 00:00:00 GMTDataKitchenhttps://datakitchen.io/blog/evaluating-machine-learning-models-with-mlops-and-the-datakitchen-platform/https://datakitchen.io/blog/evaluating-machine-learning-models-with-mlops-and-the-datakitchen-platform/Most projects naively assume that most of the time and resources will be spent in the “black box,” building the machine learning (ML) model, whereas a majority of the project time is actually needed in the green boxes – the ML system.Tue, 11 Aug 2020 00:00:00 GMTGil Benghiathttps://datakitchen.io/blog/govern-self-service-analytics-without-stifling-innovation/https://datakitchen.io/blog/govern-self-service-analytics-without-stifling-innovation/Self-service analytics spur innovation but create governance chaos. How to balance centralization and freedom so CDOs control data without slowing users.Tue, 04 Aug 2020 00:00:00 GMTDataKitchen Marketing Teamhttps://datakitchen.io/blog/how-dataops-facilitates-your-cloud-migration/https://datakitchen.io/blog/how-dataops-facilitates-your-cloud-migration/Cloud migration alone won't make data teams agile. How DataOps and parallel pipelines cut errors and risk when moving analytics from on-prem to the cloud.Thu, 23 Jul 2020 00:00:00 GMTDataKitchen Marketing Teamhttps://datakitchen.io/blog/believe-it-or-not-your-tools-are-dataops-compatible/https://datakitchen.io/blog/believe-it-or-not-your-tools-are-dataops-compatible/Gil Benghiat is one of three founders of DataKitchen, a company on a mission to enable analytic teams to deliver value quickly and with high quality.Thu, 09 Jul 2020 00:00:00 GMTGil Benghiathttps://datakitchen.io/blog/what-is-a-dataops-kitchen/https://datakitchen.io/blog/what-is-a-dataops-kitchen/Kitchens are DataKitchen workspaces that decouple analytics code from technical environments, so releases move from development to production seamlessly.Fri, 26 Jun 2020 00:00:00 GMTDataKitchen Marketing Teamhttps://datakitchen.io/blog/run-analytics-seamlessly-across-multi-cloud-environments-with-dataops/https://datakitchen.io/blog/run-analytics-seamlessly-across-multi-cloud-environments-with-dataops/Integrating analytics across AWS, Google Cloud, and on-prem is hard. How DataOps coordinates tests, alerts, and pipelines across multi-cloud environments.Fri, 19 Jun 2020 00:00:00 GMTDataKitchen Marketing Teamhttps://datakitchen.io/blog/environments-power-dataops-innovation/https://datakitchen.io/blog/environments-power-dataops-innovation/Separating development and production environments lets data teams test on real data and innovate without fear of breaking live analytics pipelines.Thu, 18 Jun 2020 00:00:00 GMTDataKitchen Marketing Teamhttps://datakitchen.io/blog/gartner-dataops-enables-remote-work/https://datakitchen.io/blog/gartner-dataops-enables-remote-work/Gartner urges distributed data teams to adopt DataOps for speed and adaptability. How the practice keeps remote analytics teams productive and aligned.Wed, 03 Jun 2020 00:00:00 GMTDataKitchen Marketing Teamhttps://datakitchen.io/blog/a-tool-agnostic-approach-to-dataops-using-the-datakitchen-platform/https://datakitchen.io/blog/a-tool-agnostic-approach-to-dataops-using-the-datakitchen-platform/How DataKitchen DataOps Automation orchestrates any tool with an API through containerization, shown with a real Qubole-to-Snowflake data transfer and tests.Tue, 26 May 2020 00:00:00 GMTDataKitchen Marketing Teamhttps://datakitchen.io/blog/predicting-the-failure-of-quantum-computing/https://datakitchen.io/blog/predicting-the-failure-of-quantum-computing/Every breakthrough technology stumbles on deployment, not the science. Why quantum computing will follow the same path, and how DataOps can shorten it.Fri, 22 May 2020 00:00:00 GMTDataKitchen Marketing Teamhttps://datakitchen.io/blog/for-data-team-success-what-you-do-is-less-important-than-how-you-do-it/https://datakitchen.io/blog/for-data-team-success-what-you-do-is-less-important-than-how-you-do-it/Most data teams spend their time fixing errors instead of innovating. DataOps shifts the focus to process, so teams deliver trusted analytics faster.Tue, 19 May 2020 00:00:00 GMTDataKitchen Marketing Teamhttps://datakitchen.io/blog/4-easy-ways-to-start-dataops-today/https://datakitchen.io/blog/4-easy-ways-to-start-dataops-today/You can begin DataOps without buying software. Four practical projects any data engineer or analyst can start today using open-source tools like Git.Wed, 13 May 2020 00:00:00 GMTDataKitchen Marketing Teamhttps://datakitchen.io/blog/why-are-there-so-many-ops-terms/https://datakitchen.io/blog/why-are-there-so-many-ops-terms/A field guide to the AIOps, MLOps, DevOps, and DataOps acronyms: what each Ops term means, where they came from, and which ones actually earn their name.Tue, 05 May 2020 00:00:00 GMTChris Berghhttps://datakitchen.io/blog/add-dataops-tests-to-deploy-with-confidence/https://datakitchen.io/blog/add-dataops-tests-to-deploy-with-confidence/Integrate automated tests into your analytics pipeline so DataOps teams catch errors at every stage and deploy new code to production with confidence.Thu, 23 Apr 2020 00:00:00 GMTDataKitchen Marketing Teamhttps://datakitchen.io/blog/writing-dataops-tests-with-the-datakitchen-platform/https://datakitchen.io/blog/writing-dataops-tests-with-the-datakitchen-platform/A hands-on guide to writing DataOps tests in DataKitchen DataOps Automation, covering nodes, recipes, and orders through a record-count verification example.Fri, 17 Apr 2020 00:00:00 GMTDataKitchen Marketing Teamhttps://datakitchen.io/blog/streaming-analytics-with-dataops/https://datakitchen.io/blog/streaming-analytics-with-dataops/Streaming analytics moves terabytes in real time. DataOps tackles four challenges, dirty data, event processing, manual work, and long cycle times.Mon, 13 Apr 2020 00:00:00 GMTDataKitchen Marketing Teamhttps://datakitchen.io/blog/add-dataops-tests-for-error-free-analytics/https://datakitchen.io/blog/add-dataops-tests-for-error-free-analytics/Data teams lose most of their time to errors and operations. Adding DataOps tests across the pipeline cuts errors and frees people for real innovation.Thu, 09 Apr 2020 00:00:00 GMTDataKitchen Marketing Teamhttps://datakitchen.io/blog/navigating-a-recession-with-dataops/https://datakitchen.io/blog/navigating-a-recession-with-dataops/Recession research shows agile, efficient companies pull ahead. See how DataOps helps data teams automate operations, cut errors, and do more with less.Tue, 31 Mar 2020 00:00:00 GMTDataKitchen Marketing Teamhttps://datakitchen.io/blog/promoting-reuse-with-containers-and-the-datakitchen-dataops-platform/https://datakitchen.io/blog/promoting-reuse-with-containers-and-the-datakitchen-dataops-platform/How containers let data teams package and reuse analytics components, with a Docker-based source-sink example built in DataKitchen DataOps Automation.Mon, 30 Mar 2020 00:00:00 GMTDataKitchen Marketing Teamhttps://datakitchen.io/blog/a-note-to-our-customers-on-covid-19/https://datakitchen.io/blog/a-note-to-our-customers-on-covid-19/DataKitchen's message to customers on COVID-19: work-from-home and travel measures are in place, with no disruption to the service and support you rely on.Mon, 23 Mar 2020 00:00:00 GMTChris Berghhttps://datakitchen.io/blog/where-can-i-learn-more-about-dataops/https://datakitchen.io/blog/where-can-i-learn-more-about-dataops/A short roundup of places to learn DataOps: the DataOps Manifesto, the DataOps Cookbook, plus curated videos, news, blog posts, and slide decks.Thu, 19 Mar 2020 00:00:00 GMTDataKitchen Marketing Teamhttps://datakitchen.io/blog/orchestrating-streamsets-with-the-datakitchen-dataops-platform/https://datakitchen.io/blog/orchestrating-streamsets-with-the-datakitchen-dataops-platform/A step-by-step look at orchestrating StreamSets ETL pipelines with DataKitchen DataOps Automation to add deployment, testing, versioning, and collaboration.Mon, 09 Mar 2020 00:00:00 GMTGil Benghiathttps://datakitchen.io/blog/do-you-need-dataops-take-our-1-minute-survey/https://datakitchen.io/blog/do-you-need-dataops-take-our-1-minute-survey/Take a one-minute survey to gauge whether your data organization needs DataOps, then see how your cycle times and error rates stack up against peers.Thu, 05 Mar 2020 00:00:00 GMTDataKitchen Marketing Teamhttps://datakitchen.io/blog/gartner-select-a-dataops-platform-for-2020/https://datakitchen.io/blog/gartner-select-a-dataops-platform-for-2020/Gartner's 2020 Planning Guide names DataOps a top trend and urges teams to select a DataOps platform. We map its recommendations to real capabilities.Tue, 03 Mar 2020 00:00:00 GMTChris Berghhttps://datakitchen.io/blog/dataops-is-not-just-a-dag-for-data/https://datakitchen.io/blog/dataops-is-not-just-a-dag-for-data/Automated orchestration matters, but DataOps is more than a DAG. It coordinates both the Value and Innovation pipelines across your whole toolchain.Tue, 25 Feb 2020 00:00:00 GMTDataKitchen Marketing Teamhttps://datakitchen.io/blog/dataops-aphorisms/https://datakitchen.io/blog/dataops-aphorisms/A collection of pithy DataOps aphorisms from DataKitchen, capturing the practice's core ideas about errors, tools, heroism, and delivering value faster.Fri, 14 Feb 2020 00:00:00 GMTChris Berghhttps://datakitchen.io/blog/iowa-caucuses-do-your-dataops/https://datakitchen.io/blog/iowa-caucuses-do-your-dataops/The Iowa caucus reporting meltdown traces back to an ETL bug, a familiar data failure pattern. DataOps testing keeps errors like it out of production.Tue, 04 Feb 2020 00:00:00 GMTChris Berghhttps://datakitchen.io/blog/reducing-organizational-complexity-with-dataops/https://datakitchen.io/blog/reducing-organizational-complexity-with-dataops/Data teams carry more individual complexity than any group. See how DataOps uses automation, testing, and clear workflows to make it easier to get work done.Tue, 28 Jan 2020 00:00:00 GMTDataKitchen Marketing Teamhttps://datakitchen.io/blog/failing-your-way-to-success-with-dataops/https://datakitchen.io/blog/failing-your-way-to-success-with-dataops/Borrowing 'fail faster' from lean manufacturing and design, DataOps lowers the cost of data errors so teams can take risks and innovate with confidence.Tue, 21 Jan 2020 00:00:00 GMTDataKitchen Marketing Teamhttps://datakitchen.io/blog/a-guide-to-understanding-dataops-solutions/https://datakitchen.io/blog/a-guide-to-understanding-dataops-solutions/With 70-plus vendors rebranding tools as DataOps, this guide helps you cut through the marketing and judge which solutions truly deliver on the practice.Sat, 11 Jan 2020 00:00:00 GMTDataKitchen Marketing Teamhttps://datakitchen.io/blog/what-a-dataops-platform-can-do-for-you/https://datakitchen.io/blog/what-a-dataops-platform-can-do-for-you/A DataOps Platform unifies analytics planning, development, and operations into one framework so data teams ship faster and cut errors to near zero.Fri, 10 Jan 2020 00:00:00 GMTDataKitchen Marketing Teamhttps://datakitchen.io/blog/datakitchen-strengthens-management-team-with-key-executive-appointments/https://datakitchen.io/blog/datakitchen-strengthens-management-team-with-key-executive-appointments/David Kershaw Joins as VP, Engineering and Beth Pfefferle as VP, MarketingTue, 07 Jan 2020 00:00:00 GMTDataKitchenhttps://datakitchen.io/blog/dataops-soars-in-2019/https://datakitchen.io/blog/dataops-soars-in-2019/A year-end look at how DataOps took off in 2019: analyst coverage surged, the ecosystem grew past 70 vendors, and the Manifesto topped 7,000 signatures.Mon, 30 Dec 2019 00:00:00 GMTDataKitchen Marketing Teamhttps://datakitchen.io/blog/how-to-get-started-with-dataops/https://datakitchen.io/blog/how-to-get-started-with-dataops/Starting DataOps means finding the right first project. DataKitchen explains how to spot and clear the bottlenecks that slow analytics from months to days.Tue, 17 Dec 2019 00:00:00 GMTChris Berghhttps://datakitchen.io/blog/2019-dataops-survey-errors-and-slow-innovation-abound/https://datakitchen.io/blog/2019-dataops-survey-errors-and-slow-innovation-abound/DataKitchen's 2019 survey of 300+ data professionals found analytics taking months to deploy and 30% of teams hitting more than 11 data errors every month.Sun, 10 Nov 2019 00:00:00 GMTDataKitchen Marketing Teamhttps://datakitchen.io/blog/a-summary-of-gartners-recent-dataops-report-and-recommendations/https://datakitchen.io/blog/a-summary-of-gartners-recent-dataops-report-and-recommendations/A summary of Gartner's 2019 report on introducing DataOps, breaking down its key challenges and recommendations for faster, more reliable data pipelines.Fri, 01 Nov 2019 00:00:00 GMTChris Berghhttps://datakitchen.io/blog/unicorn-project-dataops-book-excerpt/https://datakitchen.io/blog/unicorn-project-dataops-book-excerpt/Chris Bergh on contributing the DataOps subplot to Gene Kim's novel The Unicorn Project, and where to read Chapter 14.Wed, 30 Oct 2019 00:00:00 GMTChris Berghhttps://datakitchen.io/blog/behind-a-great-company-there-is-dataops/https://datakitchen.io/blog/behind-a-great-company-there-is-dataops/Celgene's Otezla team, acquired by Amgen for $13.4 billion, is a DataOps pioneer. DataKitchen shares how the partnership drove speed and quality since 2014.Mon, 16 Sep 2019 00:00:00 GMTDataKitchen Marketing Teamhttps://datakitchen.io/blog/why-do-dataops-2/https://datakitchen.io/blog/why-do-dataops-2/Why do DataOps? With 87% of data science projects never reaching production, DataKitchen makes the case for applying manufacturing methods to analytics.Tue, 10 Sep 2019 00:00:00 GMTDataKitchen Marketing Teamhttps://datakitchen.io/blog/automated-efficiency-and-quality-with-datakitchen/https://datakitchen.io/blog/automated-efficiency-and-quality-with-datakitchen/Follow-up on a pharmaceutical company's DataOps rollout: DataKitchen automated its data pipelines and quality controls, delivering value ten times faster.Tue, 09 Jul 2019 00:00:00 GMTDataKitchen Marketing Teamhttps://datakitchen.io/blog/dataops-data-architecture/https://datakitchen.io/blog/dataops-data-architecture/Most data architectures optimize for performance but not change. DataKitchen makes the case for a 'right to repair' architecture built for rapid change.Wed, 03 Jul 2019 00:00:00 GMTDataKitchen Marketing Teamhttps://datakitchen.io/blog/eckerson-group-ultimate-guide-to-dataops/https://datakitchen.io/blog/eckerson-group-ultimate-guide-to-dataops/Wayne W. Eckerson's guide to evaluating DataOps products, sponsored by DataKitchen. What the report covers, why testing is its spine, and where to read the whole thing free.Wed, 03 Jul 2019 00:00:00 GMTDataKitchen Marketing Teamhttps://datakitchen.io/blog/eckerson-group-best-practices-report-in-dataops/https://datakitchen.io/blog/eckerson-group-best-practices-report-in-dataops/Wayne Eckerson's June 2019 report, reproduced in full with Eckerson Group's permission, plus DataKitchen's commentary on which of its ten steps held up.Mon, 01 Jul 2019 00:00:00 GMTWayne Eckersonhttps://datakitchen.io/blog/gartner-research-names-datakitchen-cool-vendor/https://datakitchen.io/blog/gartner-research-names-datakitchen-cool-vendor/Gartner named DataKitchen a Cool Vendor in Data Management for 2019, citing its DataOps workflow that speeds analytics development and deployment.Sun, 30 Jun 2019 00:00:00 GMTChris Berghhttps://datakitchen.io/blog/the-best-dataops-articles-q2-2019/https://datakitchen.io/blog/the-best-dataops-articles-q2-2019/DataKitchen's roundup of the best DataOps articles from Q2 2019, covering media and analyst coverage as the practice becomes a top data analytics initiative.Sat, 29 Jun 2019 00:00:00 GMTDataKitchen Marketing Teamhttps://datakitchen.io/blog/451-group-on-datakitchen/https://datakitchen.io/blog/451-group-on-datakitchen/Analyst firm 451 Group weighs in on DataKitchen, praising its take on becoming data-driven and noting the company is profitable and growing without funding.Mon, 24 Jun 2019 00:00:00 GMTChris Berghhttps://datakitchen.io/blog/eckerson-trends-in-dataops/https://datakitchen.io/blog/eckerson-trends-in-dataops/Eckerson Group surveyed 175 data and analytics professionals about DataOps in April 2019. 77% used a code repository, 18% used continuous testing tools, and 48% saw more than six data errors a month. DataKitchen’s summary of a report we sponsored.Tue, 28 May 2019 00:00:00 GMTDataKitchen Marketing Teamhttps://datakitchen.io/blog/rearranging-deck-chairs-on-the-titanic/https://datakitchen.io/blog/rearranging-deck-chairs-on-the-titanic/Buying better tools won't fix broken analytics. DataKitchen argues teams must first find the real operational bottleneck that slows innovation.Wed, 15 May 2019 00:00:00 GMTDataKitchen Marketing Teamhttps://datakitchen.io/blog/the-dataops-manifesto-reaches-5000-signatories-and-now-translated-to-14-languages/https://datakitchen.io/blog/the-dataops-manifesto-reaches-5000-signatories-and-now-translated-to-14-languages/The DataOps Manifesto passes 5,000 signatories and adds new translations, now available in 14 languages just two years after its publication.Sun, 21 Apr 2019 00:00:00 GMTDataKitchen Marketing Teamhttps://datakitchen.io/blog/dataops-resolves-the-struggle-between-centralization-and-freedom-in-analytics/https://datakitchen.io/blog/dataops-resolves-the-struggle-between-centralization-and-freedom-in-analytics/Centralize analytics and you stifle innovation. Leave analysts free and you get five versions of the sales number. The analytics supply chain is how you get both.Tue, 02 Oct 2018 00:00:00 GMTDataKitchenhttps://datakitchen.io/blog/disband-your-impact-review-board-automate-analytics-testing/https://datakitchen.io/blog/disband-your-impact-review-board-automate-analytics-testing/Some companies take six months to write 20 lines of SQL and move it into production. The impact analysis meeting is the bottleneck, and a test suite is what replaces it.Tue, 18 Sep 2018 00:00:00 GMTDataKitchenhttps://datakitchen.io/blog/build-trust-through-test-automation-and-monitoring/https://datakitchen.io/blog/build-trust-through-test-automation-and-monitoring/A financial services data team lost its users to shadow reporting because bad data leaked through. Location balance, historical balance, and statistical process control are how you stop that.Thu, 06 Sep 2018 00:00:00 GMTDataKitchenhttps://datakitchen.io/blog/gartner-puts-dataops-on-the-rise-in-2018/https://datakitchen.io/blog/gartner-puts-dataops-on-the-rise-in-2018/Gartner added DataOps to its 2018 Hype Cycle for Data Management, recognizing the practice and DataKitchen as an emerging force in predictable data delivery.Tue, 24 Jul 2018 00:00:00 GMTChris Berghhttps://datakitchen.io/blog/reinvent-marketing-automation-with-the-datakitchen-dataops-platform/https://datakitchen.io/blog/reinvent-marketing-automation-with-the-datakitchen-dataops-platform/How DataKitchen DataOps Automation helped a global pharmaceutical company modernize marketing automation, cutting an 18-month Salesforce migration to weeks.Mon, 02 Jul 2018 00:00:00 GMTDataKitchen Marketing Teamhttps://datakitchen.io/blog/welcome-to-the-datakitchen-company-blog/https://datakitchen.io/blog/welcome-to-the-datakitchen-company-blog/DataKitchen introduces its company blog and its core view: analytics leaders can escape constant requests and production errors by iterating with DataOps.Mon, 18 Jun 2018 00:00:00 GMTChris Berghhttps://datakitchen.io/blog/lean-manufacturing-secrets-that-you-can-apply-to-data-analytics/https://datakitchen.io/blog/lean-manufacturing-secrets-that-you-can-apply-to-data-analytics/Data analytics and lean manufacturing have more in common than they look. Statistical process control is the tool that transfers, and a row-count test is where it starts.Tue, 07 Mar 2017 00:00:00 GMTDataKitchenhttps://datakitchen.io/blog/how-software-teams-accelerated-average-release-frequency-from-three-weeks-to-three-minutes/https://datakitchen.io/blog/how-software-teams-accelerated-average-release-frequency-from-three-weeks-to-three-minutes/A quick guide to DevOps for non-engineers: how on-demand infrastructure ended the it-works-on-my-machine argument, and how a release process that took weeks came down to minutes.Wed, 01 Mar 2017 00:00:00 GMTDataKitchenhttps://datakitchen.io/blog/how-software-teams-accelerated-average-release-frequency-from-12-months-to-three-weeks/https://datakitchen.io/blog/how-software-teams-accelerated-average-release-frequency-from-12-months-to-three-weeks/A quick guide to Agile development for non-engineers: why the waterfall model could not keep up, what changed when teams started shipping every few weeks, and what data analytics can take from it.Tue, 21 Feb 2017 00:00:00 GMTDataKitchenhttps://datakitchen.io/blog/three-behaviors-that-will-shorten-your-career-in-data-analytics/https://datakitchen.io/blog/three-behaviors-that-will-shorten-your-career-in-data-analytics/Heroism, hope, and caution are the three ways data teams respond to the gap between what they can deliver and what users expect. All three end the same way.Fri, 10 Feb 2017 00:00:00 GMTDataKitchen