{"product_id":"data-engineering-design-patterns-recipes-for-solving-the-most-common-data-engineering-problems-9781098165819","title":"Data Engineering Design Patterns: Recipes for Solving the Most Common Data Engineering Problems","description":"\u003cp\u003eData projects are an intrinsic part of an organization's technical ecosystem, but data engineers in many companies are still trying to solve problems that others have already solved. This hands-on guide shows you how to provide valuable data by focusing on various aspects of data engineering, including data ingestion, data quality, idempotency, and more. \u003c\/p\u003e\u003cp\u003e Author Bartosz Konieczny guides you through the process of building reliable end-to-end data engineering projects, from data ingestion to data observability, focusing on data engineering design patterns that solve common business problems in a secure and storage-optimized manner. Each pattern includes a user-facing description of the problem, solutions, and consequences that place the pattern into the context of real-life scenarios. \u003c\/p\u003e\u003cp\u003e Throughout this journey, you'll use open source data tools and public cloud services to see how to put each pattern into practice. You'll learn: \u003c\/p\u003e\u003cul\u003e \u003cli\u003eChallenges data engineers face and their impact on data systems \u003c\/li\u003e\n\u003cli\u003eHow these challenges relate to data system components \u003c\/li\u003e\n\u003cli\u003eWhat data engineering patterns are for \u003c\/li\u003e\n\u003cli\u003eHow to identify and fix issues with your current data components \u003c\/li\u003e\n\u003cli\u003eTechnology-agnostic solutions to new and existing data projects \u003c\/li\u003e\n\u003cli\u003eHow to implement patterns with Apache Airflow, Apache Spark, Apache Flink, and Delta Lake \u003c\/li\u003e\n\u003c\/ul\u003e \u003cp\u003eBartosz Konieczny is a freelance data engineer who's been coding for more than 15 years. He's held various senior hands-on positions that helped him work on many data engineering problems in batch and stream processing.\u003cbr\u003e\u003cbr\u003e\u003cb\u003eBinding Type:\u003c\/b\u003e Paperback\u003cbr\u003e\u003cb\u003ePublisher:\u003c\/b\u003e O'Reilly Media\u003cbr\u003e\u003cb\u003ePublished:\u003c\/b\u003e 05\/20\/2025\u003cbr\u003e\u003cb\u003eISBN:\u003c\/b\u003e 9781098165819\u003cbr\u003e\u003cb\u003ePages:\u003c\/b\u003e 350\u003c\/p\u003e","brand":"Bartosz Konieczny","offers":[{"title":"Default Title","offer_id":45234821300405,"sku":"9781098165819","price":67.99,"currency_code":"USD","in_stock":true}],"thumbnail_url":"\/\/cdn.shopify.com\/s\/files\/1\/0473\/0804\/6492\/files\/img_cdb5ba9b-6566-4c71-9511-b555f7014dbb.jpg?v=1743518938","url":"https:\/\/pastforward.org\/products\/data-engineering-design-patterns-recipes-for-solving-the-most-common-data-engineering-problems-9781098165819","provider":"Past Forward","version":"1.0","type":"link"}