{"product_id":"9781484274514","title":"Modern Data Engineering with Apache Spark: A Hands-On Guide for Building Mission-Critical Streaming Applications","description":"\u003ch1\u003eModern Data Engineering with Apache Spark: A Hands-On Guide for Building Mission-Critical Streaming Applications\u003c\/h1\u003e \u003ch2\u003eHaines, Scott\u003c\/h2\u003e \u003cp\u003e\u003c\/p\u003e\u003cdiv\u003e\u003cdiv\u003eLeverage Apache Spark within a modern data engineering ecosystem. This hands-on guide will teach you how to write fully functional applications, follow industry best practices, and learn the rationale behind these decisions. With Apache Spark as the foundation, you will follow a step-by-step journey beginning with the basics of data ingestion, processing, and transformation, and ending up with an entire local data platform running Apache Spark, Apache Zeppelin, Apache Kafka, Redis, MySQL, Minio (S3), and Apache Airflow.\u003cbr\u003e\n\u003c\/div\u003e\u003c\/div\u003e\u003cdiv\u003e\u003cbr\u003e\u003c\/div\u003e\u003cdiv\u003eApache Spark applications solve a wide range of data problems from traditional data loading and processing to rich SQL-based analysis as well as complex machine learning workloads and even near real-time processing of streaming data. Spark fits well as a central foundation for any data engineering workload. This book will teach you to write interactive Spark applications using Apache Zeppelin notebooks, write and compilereusable applications and modules, and fully test both batch and streaming. You will also learn to containerize your applications using Docker and run and deploy your Spark applications using a variety of tools such as Apache Airflow, Docker and Kubernetes.\u003c\/div\u003e\u003cp\u003e​Reading this book will empower you to take advantage of Apache Spark to optimize your data pipelines and teach you to craft modular and testable Spark applications. You will create and deploy mission-critical streaming spark applications in a low-stress environment that paves the way for your own path to production.\u003cbr\u003e\u003c\/p\u003e ​\u003cdiv\u003e\n\u003cbr\u003e\u003cdiv\u003e\u003cb\u003eWhat You Will Learn\u003c\/b\u003e\u003c\/div\u003e\n\u003cdiv\u003e\n\u003cul\u003e\n\u003cli\u003e\u003cdiv\u003eSimplify data transformation with Spark Pipelines and Spark SQL\u003cbr\u003e\n\u003c\/div\u003e\u003c\/li\u003e\n\u003cli\u003eBridge data engineering with machine learning\u003c\/li\u003e\n\u003cli\u003eArchitect modular data pipeline applications\u003cbr\u003e\n\u003c\/li\u003e  \u003cli\u003eBuild reusable application components and libraries\u003c\/li\u003e  \u003cli\u003eContainerize your Spark applications for consistency      and reliability\u003c\/li\u003e\n\u003cli\u003eUse Docker and Kubernetes to deploy your Spark      applications\u003cbr\u003e\n\u003c\/li\u003e\n\u003cli\u003eSpeed up application experimentation using Apache      Zeppelin and Docker\u003c\/li\u003e  \u003cli\u003eUnderstand serializable structured data and data contracts \u003c\/li\u003e  \u003cli\u003eHarness effective strategies for optimizing data in      your data lakes\u003c\/li\u003e  \u003cli\u003eBuild end-to-end Spark structured streaming      applications using Redis and Apache Kafka\u003c\/li\u003e  \u003cli\u003eEmbrace testing for your batch and streaming applications\u003c\/li\u003e  \u003cli\u003eDeploy and monitor your Spark applications \u003c\/li\u003e \u003c\/ul\u003e\n\u003cdiv\u003e \u003c\/div\u003e\n\u003c\/div\u003e\n\u003cdiv\u003e\u003cbr\u003e\u003c\/div\u003e\n\u003cdiv\u003e\u003cb\u003eWho This Book Is For\u003c\/b\u003e\u003c\/div\u003e\n\u003cdiv\u003e\u003cbr\u003e\u003c\/div\u003eProfessional software engineers who want to take their current skills and apply them to new and exciting opportunities within the data ecosystem, practicing data engineers who are looking for a guiding light while traversing the many challenges of moving from batch to streaming modes, data architects who wish to provide clear and concise direction for how best to harness anduse Apache Spark within their organization, and those interested in the ins and outs of becoming a modern data engineer in today's fast-paced and data-hungry world\u003cbr\u003e\n\u003c\/div\u003e \u003ch3\u003eDetails\u003c\/h3\u003e \u003cp\u003ePublished by: Apress\u003c\/p\u003e \u003cp\u003ePublication Date: 2022-03-23\u003c\/p\u003e \u003cp\u003eFormat: Paperback\u003c\/p\u003e \u003cp\u003eISBN-13: 9781484274514\u003c\/p\u003e \u003cp\u003eDOI: 10.1007\/978-1-4842-7452-1\u003c\/p\u003e \u003cp\u003eDimensions: 254cm x178cm\u003c\/p\u003e \u003cp\u003ePages: 585\u003c\/p\u003e ","brand":"Apress","offers":[{"title":"Default Title","offer_id":47531691475084,"sku":"9781484274514","price":58.49,"currency_code":"USD","in_stock":true}],"thumbnail_url":"\/\/cdn.shopify.com\/s\/files\/1\/0710\/9545\/1788\/files\/9781484274514.jpg?v=1776054016","url":"https:\/\/fh90cf-fv.myshopify.com\/products\/9781484274514","provider":"Late Knight Books and Services, LLC","version":"1.0","type":"link"}