{"id":28329,"date":"2022-11-25T12:44:27","date_gmt":"2022-11-25T07:14:27","guid":{"rendered":"https:\/\/blazeclan.com\/studies\/data-lake-solution-with-400-metrics-helped-customer-make-incisive-decisions-in-real-time-2\/"},"modified":"2023-03-02T11:37:00","modified_gmt":"2023-03-02T06:07:00","slug":"data-lake-solution-with-400-metrics-helped-customer-make-incisive-decisions-in-real-time","status":"publish","type":"case_study","link":"https:\/\/blazeclan.com\/anz\/studies\/data-lake-solution-with-400-metrics-helped-customer-make-incisive-decisions-in-real-time\/","title":{"rendered":"Data Lake Solution with 400+ Metrics Helped Customer Make Incisive  Decisions in Real-Time"},"content":{"rendered":"<p>The customer is a travel and lifestyle company. It gives the members with access to the widest network of travel and lifestyle partners. This means the members will earn rewards across everything, ranging from airlines and hotel bookings to shopping, dining and more globally.<\/p>\n<h3>The Need for a Data Lake with Extended Metrics<\/h3>\n<p>There are 10+ categories based on which a loyalty member can accrue\/redeem miles. The data for all these categories are stored in their on-premise database without being utilized. Also, there were intricate challenges in gathering data from third-party vendors. The data is needed to be stored in a common repository, as a data lake, and then connected at a member level. This common repository is necessary to get a holistic view of all loyal customer interactions and drive business insights out of the structured or semi-structured data. The customer wants to utilize that data by leveraging their artificial intelligence platform to perform advanced analytics on that data for making informed decisions.<\/p>\n<h3>The Solution<\/h3>\n<p>To achieve the roadmap of the customer, Blazeclan helped them create, gather and operationalize their scattered data into a single Cloud-based Data Lake Solution. This will enable their business users and data scientists in deriving descriptive and prescriptive insights. Blazeclan set up a data extraction, loading &amp; transformation pipeline for the data ingested from multiple sources. The solution approach also involved creating 400+ metrics (key performance indicators) giving a complete persona of the journey of their 10 million+ loyalty members.<\/p>\n<h3>Ingested Data Sources<\/h3>\n<ol>\n<li>Real-time analytics and detailed segmentation across all of the customer\u2019s marketing channels.<\/li>\n<li>Captured all activities and transactions being done by customer\u2019s member across all 10+ categories.<\/li>\n<li>Online and offline data from a unified view of audiences were captured.<\/li>\n<li>Captured the data for the accrual and redemption flight bookings.<\/li>\n<li>Captured flight search data of the members from their flight platform.<\/li>\n<li>Stitching (mapping) of the online and offline data.<\/li>\n<\/ol>\n<p>The data of the members\u2019 financial transactions on the wallet. Given below is the Data Flow Diagram, which shows how we generated metrics and enabled the customer\u2019s team to drive actionable insights.<\/p>\n<p><img fetchpriority=\"high\" decoding=\"async\" class=\"aligncenter wp-image-30872 size-full\" src=\"https:\/\/blazeclan.com\/wp-content\/uploads\/2022\/11\/1-1.png\" alt=\"\" width=\"1676\" height=\"1384\" srcset=\"https:\/\/blazeclan.com\/wp-content\/uploads\/2022\/11\/1-1.png 1676w, https:\/\/blazeclan.com\/wp-content\/uploads\/2022\/11\/1-1-300x248.png 300w, https:\/\/blazeclan.com\/wp-content\/uploads\/2022\/11\/1-1-1024x846.png 1024w, https:\/\/blazeclan.com\/wp-content\/uploads\/2022\/11\/1-1-768x634.png 768w, https:\/\/blazeclan.com\/wp-content\/uploads\/2022\/11\/1-1-1536x1268.png 1536w, https:\/\/blazeclan.com\/wp-content\/uploads\/2022\/11\/1-1-1568x1295.png 1568w\" sizes=\"(max-width: 1676px) 100vw, 1676px\" \/><\/p>\n<h3>Architecture Diagram &#8211; Optimized Solution<\/h3>\n<p><img decoding=\"async\" class=\"aligncenter wp-image-30882 size-full\" src=\"https:\/\/blazeclan.com\/wp-content\/uploads\/2022\/11\/2-2048x805-1.png\" alt=\"\" width=\"2048\" height=\"805\" srcset=\"https:\/\/blazeclan.com\/wp-content\/uploads\/2022\/11\/2-2048x805-1.png 2048w, https:\/\/blazeclan.com\/wp-content\/uploads\/2022\/11\/2-2048x805-1-300x118.png 300w, https:\/\/blazeclan.com\/wp-content\/uploads\/2022\/11\/2-2048x805-1-1024x403.png 1024w, https:\/\/blazeclan.com\/wp-content\/uploads\/2022\/11\/2-2048x805-1-768x302.png 768w, https:\/\/blazeclan.com\/wp-content\/uploads\/2022\/11\/2-2048x805-1-1536x604.png 1536w, https:\/\/blazeclan.com\/wp-content\/uploads\/2022\/11\/2-2048x805-1-1568x616.png 1568w\" sizes=\"(max-width: 2048px) 100vw, 2048px\" \/><\/p>\n<h3>Key Benefits Achieved by the Customer<\/h3>\n<p><strong>Repository for Everything:<\/strong>&nbsp;All types of raw, structured\/unstructured, cleaned, processed, snapshot, extended metrics are all stored at the same place. This meets the purpose of enriched data being stored at a common pool for the leverage of advanced analytics and insights.<\/p>\n<p><strong>Cost-Effective:<\/strong>&nbsp;Serverless and managed services helped the customer eliminate the extra cost spent on on-premise hardware infrastructure and its maintenance.<\/p>\n<p><strong>Serves all types of Users:<\/strong> All types of business users like business stakeholders, data scientists, technical users can now access the enriched data stored at a common pool using AWS services.<\/p>\n<p><strong>Robust Ecosystem for Next-Generation Solutions:<\/strong> For all the advanced next-generation technology, this ecosystem will serve as an input to drive business solutions and accelerate growth.<\/p>\n<p><img decoding=\"async\" class=\"alignnone wp-image-12265 size-full\" src=\"https:\/\/blazeclan.com\/wp-content\/uploads\/2020\/09\/3-1.png\" alt=\"\" width=\"960\" height=\"540\" srcset=\"https:\/\/blazeclan.com\/wp-content\/uploads\/2020\/09\/3-1.png 960w, https:\/\/blazeclan.com\/wp-content\/uploads\/2020\/09\/3-1-300x169.png 300w, https:\/\/blazeclan.com\/wp-content\/uploads\/2020\/09\/3-1-768x432.png 768w\" sizes=\"(max-width: 960px) 100vw, 960px\" \/><\/p>\n<h3>Tech Stack<\/h3>\n<table class=\"table table-hover\">\n<tbody>\n<tr>\n<td>Amazon S3<\/td>\n<td>AWS Lambda<\/td>\n<td>AWS EMR<\/td>\n<\/tr>\n<tr>\n<td>AWS KMS<\/td>\n<td>AWS Glue<\/td>\n<td>AWS CloudWatch<\/td>\n<\/tr>\n<tr>\n<td>API Gateway<\/td>\n<td>RDS Aurora<\/td>\n<td>AWS Step Function<\/td>\n<\/tr>\n<tr>\n<td>Amazon SQS<\/td>\n<td>Amazon SNS<\/td>\n<td>AWS Secret Manager<\/td>\n<\/tr>\n<tr>\n<td>AWS DynamoDB<\/td>\n<td>AWS Athena<\/td>\n<td>AWS IAM<\/td>\n<\/tr>\n<\/tbody>\n<\/table>\n","protected":false},"excerpt":{"rendered":"<p>The customer is a travel and lifestyle company. It gives the members with access to the widest network of travel and lifestyle partners. This means the members will earn rewards across everything, ranging from airlines and hotel bookings to shopping, dining and more globally. The Need for a Data Lake with Extended Metrics There are [&hellip;]<\/p>\n","protected":false},"featured_media":12283,"parent":0,"menu_order":0,"template":"","case_category":[3876,3921],"case_tags":[4226,4151,4106,4161,4146],"class_list":["post-28329","case_study","type-case_study","status-publish","has-post-thumbnail","hentry","case_category-big-data-analytics-anz","case_category-datalake-anz","case_tags-automation-anz","case_tags-big-data-anz","case_tags-cloud-anz","case_tags-data-analytics-anz","case_tags-data-lake-anz"],"acf":[],"yoast_head":"<!-- This site is optimized with the Yoast SEO plugin v25.5 - https:\/\/yoast.com\/wordpress\/plugins\/seo\/ -->\n<title>Data Lake Solution Helps Make Incisive Decisions in Real-Time<\/title>\n<meta name=\"description\" content=\"Data Lake Solution with 400+ Metrics Helped Customer Make Incisive Decisions in Real-Time\" \/>\n<meta name=\"robots\" content=\"index, follow, max-snippet:-1, max-image-preview:large, max-video-preview:-1\" \/>\n<link rel=\"canonical\" href=\"https:\/\/blazeclan.com\/anz\/studies\/data-lake-solution-with-400-metrics-helped-customer-make-incisive-decisions-in-real-time\/\" \/>\n<meta property=\"og:locale\" content=\"en_US\" \/>\n<meta property=\"og:type\" content=\"article\" \/>\n<meta property=\"og:title\" content=\"Data Lake Solution Helps Make Incisive Decisions in Real-Time\" \/>\n<meta property=\"og:description\" content=\"Data Lake Solution with 400+ Metrics Helped Customer Make Incisive Decisions in Real-Time\" \/>\n<meta property=\"og:url\" content=\"https:\/\/blazeclan.com\/studies\/data-lake-solution-with-400-metrics-helped-customer-make-incisive-decisions-in-real-time\" \/>\n<meta property=\"og:site_name\" content=\"Blazeclan\" \/>\n<meta property=\"article:publisher\" content=\"https:\/\/www.facebook.com\/blazeclan.hq\/\" \/>\n<meta property=\"article:modified_time\" content=\"2023-03-02T06:07:00+00:00\" \/>\n<meta property=\"og:image\" content=\"https:\/\/blazeclan.com\/wp-content\/uploads\/2020\/09\/Data-Lake-no-noise-3.jpg\" \/>\n\t<meta property=\"og:image:width\" content=\"2000\" \/>\n\t<meta property=\"og:image:height\" content=\"900\" \/>\n\t<meta property=\"og:image:type\" content=\"image\/jpeg\" \/>\n<meta name=\"twitter:card\" content=\"summary_large_image\" \/>\n<meta name=\"twitter:site\" content=\"@blazeclan_hq\" \/>\n<meta name=\"twitter:label1\" content=\"Est. reading time\" \/>\n\t<meta name=\"twitter:data1\" content=\"3 minutes\" \/>\n<script type=\"application\/ld+json\" class=\"yoast-schema-graph\">{\"@context\":\"https:\/\/schema.org\",\"@graph\":[{\"@type\":\"WebPage\",\"@id\":\"https:\/\/blazeclan.com\/anz\/studies\/data-lake-solution-with-400-metrics-helped-customer-make-incisive-decisions-in-real-time\/\",\"url\":\"https:\/\/blazeclan.com\/studies\/data-lake-solution-with-400-metrics-helped-customer-make-incisive-decisions-in-real-time\",\"name\":\"Data Lake Solution Helps Make Incisive Decisions in Real-Time\",\"isPartOf\":{\"@id\":\"https:\/\/blazeclan.com\/anz\/#website\"},\"primaryImageOfPage\":{\"@id\":\"https:\/\/blazeclan.com\/studies\/data-lake-solution-with-400-metrics-helped-customer-make-incisive-decisions-in-real-time#primaryimage\"},\"image\":{\"@id\":\"https:\/\/blazeclan.com\/studies\/data-lake-solution-with-400-metrics-helped-customer-make-incisive-decisions-in-real-time#primaryimage\"},\"thumbnailUrl\":\"https:\/\/blazeclan.com\/wp-content\/uploads\/2020\/09\/Data-Lake-no-noise-3.jpg\",\"datePublished\":\"2022-11-25T07:14:27+00:00\",\"dateModified\":\"2023-03-02T06:07:00+00:00\",\"description\":\"Data Lake Solution with 400+ Metrics Helped Customer Make Incisive Decisions in Real-Time\",\"breadcrumb\":{\"@id\":\"https:\/\/blazeclan.com\/studies\/data-lake-solution-with-400-metrics-helped-customer-make-incisive-decisions-in-real-time#breadcrumb\"},\"inLanguage\":\"en\",\"potentialAction\":[{\"@type\":\"ReadAction\",\"target\":[\"https:\/\/blazeclan.com\/studies\/data-lake-solution-with-400-metrics-helped-customer-make-incisive-decisions-in-real-time\"]}]},{\"@type\":\"ImageObject\",\"inLanguage\":\"en\",\"@id\":\"https:\/\/blazeclan.com\/studies\/data-lake-solution-with-400-metrics-helped-customer-make-incisive-decisions-in-real-time#primaryimage\",\"url\":\"https:\/\/blazeclan.com\/wp-content\/uploads\/2020\/09\/Data-Lake-no-noise-3.jpg\",\"contentUrl\":\"https:\/\/blazeclan.com\/wp-content\/uploads\/2020\/09\/Data-Lake-no-noise-3.jpg\",\"width\":2000,\"height\":900},{\"@type\":\"BreadcrumbList\",\"@id\":\"https:\/\/blazeclan.com\/studies\/data-lake-solution-with-400-metrics-helped-customer-make-incisive-decisions-in-real-time#breadcrumb\",\"itemListElement\":[{\"@type\":\"ListItem\",\"position\":1,\"name\":\"Home\",\"item\":\"https:\/\/blazeclan.com\/anz\/\"},{\"@type\":\"ListItem\",\"position\":2,\"name\":\"Case Study\",\"item\":\"https:\/\/blazeclan.com\/anz\/case-studies\/\"},{\"@type\":\"ListItem\",\"position\":3,\"name\":\"Data Lake Solution with 400+ Metrics Helped Customer Make Incisive Decisions in Real-Time\"}]},{\"@type\":\"WebSite\",\"@id\":\"https:\/\/blazeclan.com\/anz\/#website\",\"url\":\"https:\/\/blazeclan.com\/anz\/\",\"name\":\"Blazeclan\",\"description\":\"\",\"publisher\":{\"@id\":\"https:\/\/blazeclan.com\/anz\/#organization\"},\"potentialAction\":[{\"@type\":\"SearchAction\",\"target\":{\"@type\":\"EntryPoint\",\"urlTemplate\":\"https:\/\/blazeclan.com\/anz\/?s={search_term_string}\"},\"query-input\":{\"@type\":\"PropertyValueSpecification\",\"valueRequired\":true,\"valueName\":\"search_term_string\"}}],\"inLanguage\":\"en\"},{\"@type\":\"Organization\",\"@id\":\"https:\/\/blazeclan.com\/anz\/#organization\",\"name\":\"Blazeclan\",\"url\":\"https:\/\/blazeclan.com\/anz\/\",\"logo\":{\"@type\":\"ImageObject\",\"inLanguage\":\"en\",\"@id\":\"https:\/\/blazeclan.com\/anz\/#\/schema\/logo\/image\/\",\"url\":\"https:\/\/blazeclan.com\/wp-content\/uploads\/2024\/10\/ITCI-Blazeclan_logo.svg\",\"contentUrl\":\"https:\/\/blazeclan.com\/wp-content\/uploads\/2024\/10\/ITCI-Blazeclan_logo.svg\",\"caption\":\"Blazeclan\"},\"image\":{\"@id\":\"https:\/\/blazeclan.com\/anz\/#\/schema\/logo\/image\/\"},\"sameAs\":[\"https:\/\/www.facebook.com\/blazeclan.hq\/\",\"https:\/\/x.com\/blazeclan_hq\",\"https:\/\/www.instagram.com\/blazeclantechnologies\/\",\"https:\/\/www.linkedin.com\/company\/blazeclan-technologies\/\",\"https:\/\/www.youtube.com\/channel\/UCCKF4Lcbtus-pUoZr7Lxrow\"]}]}<\/script>\n<!-- \/ Yoast SEO plugin. -->","yoast_head_json":{"title":"Data Lake Solution Helps Make Incisive Decisions in Real-Time","description":"Data Lake Solution with 400+ Metrics Helped Customer Make Incisive Decisions in Real-Time","robots":{"index":"index","follow":"follow","max-snippet":"max-snippet:-1","max-image-preview":"max-image-preview:large","max-video-preview":"max-video-preview:-1"},"canonical":"https:\/\/blazeclan.com\/anz\/studies\/data-lake-solution-with-400-metrics-helped-customer-make-incisive-decisions-in-real-time\/","og_locale":"en_US","og_type":"article","og_title":"Data Lake Solution Helps Make Incisive Decisions in Real-Time","og_description":"Data Lake Solution with 400+ Metrics Helped Customer Make Incisive Decisions in Real-Time","og_url":"https:\/\/blazeclan.com\/studies\/data-lake-solution-with-400-metrics-helped-customer-make-incisive-decisions-in-real-time","og_site_name":"Blazeclan","article_publisher":"https:\/\/www.facebook.com\/blazeclan.hq\/","article_modified_time":"2023-03-02T06:07:00+00:00","og_image":[{"width":2000,"height":900,"url":"https:\/\/blazeclan.com\/wp-content\/uploads\/2020\/09\/Data-Lake-no-noise-3.jpg","type":"image\/jpeg"}],"twitter_card":"summary_large_image","twitter_site":"@blazeclan_hq","twitter_misc":{"Est. reading time":"3 minutes"},"schema":{"@context":"https:\/\/schema.org","@graph":[{"@type":"WebPage","@id":"https:\/\/blazeclan.com\/anz\/studies\/data-lake-solution-with-400-metrics-helped-customer-make-incisive-decisions-in-real-time\/","url":"https:\/\/blazeclan.com\/studies\/data-lake-solution-with-400-metrics-helped-customer-make-incisive-decisions-in-real-time","name":"Data Lake Solution Helps Make Incisive Decisions in Real-Time","isPartOf":{"@id":"https:\/\/blazeclan.com\/anz\/#website"},"primaryImageOfPage":{"@id":"https:\/\/blazeclan.com\/studies\/data-lake-solution-with-400-metrics-helped-customer-make-incisive-decisions-in-real-time#primaryimage"},"image":{"@id":"https:\/\/blazeclan.com\/studies\/data-lake-solution-with-400-metrics-helped-customer-make-incisive-decisions-in-real-time#primaryimage"},"thumbnailUrl":"https:\/\/blazeclan.com\/wp-content\/uploads\/2020\/09\/Data-Lake-no-noise-3.jpg","datePublished":"2022-11-25T07:14:27+00:00","dateModified":"2023-03-02T06:07:00+00:00","description":"Data Lake Solution with 400+ Metrics Helped Customer Make Incisive Decisions in Real-Time","breadcrumb":{"@id":"https:\/\/blazeclan.com\/studies\/data-lake-solution-with-400-metrics-helped-customer-make-incisive-decisions-in-real-time#breadcrumb"},"inLanguage":"en","potentialAction":[{"@type":"ReadAction","target":["https:\/\/blazeclan.com\/studies\/data-lake-solution-with-400-metrics-helped-customer-make-incisive-decisions-in-real-time"]}]},{"@type":"ImageObject","inLanguage":"en","@id":"https:\/\/blazeclan.com\/studies\/data-lake-solution-with-400-metrics-helped-customer-make-incisive-decisions-in-real-time#primaryimage","url":"https:\/\/blazeclan.com\/wp-content\/uploads\/2020\/09\/Data-Lake-no-noise-3.jpg","contentUrl":"https:\/\/blazeclan.com\/wp-content\/uploads\/2020\/09\/Data-Lake-no-noise-3.jpg","width":2000,"height":900},{"@type":"BreadcrumbList","@id":"https:\/\/blazeclan.com\/studies\/data-lake-solution-with-400-metrics-helped-customer-make-incisive-decisions-in-real-time#breadcrumb","itemListElement":[{"@type":"ListItem","position":1,"name":"Home","item":"https:\/\/blazeclan.com\/anz\/"},{"@type":"ListItem","position":2,"name":"Case Study","item":"https:\/\/blazeclan.com\/anz\/case-studies\/"},{"@type":"ListItem","position":3,"name":"Data Lake Solution with 400+ Metrics Helped Customer Make Incisive Decisions in Real-Time"}]},{"@type":"WebSite","@id":"https:\/\/blazeclan.com\/anz\/#website","url":"https:\/\/blazeclan.com\/anz\/","name":"Blazeclan","description":"","publisher":{"@id":"https:\/\/blazeclan.com\/anz\/#organization"},"potentialAction":[{"@type":"SearchAction","target":{"@type":"EntryPoint","urlTemplate":"https:\/\/blazeclan.com\/anz\/?s={search_term_string}"},"query-input":{"@type":"PropertyValueSpecification","valueRequired":true,"valueName":"search_term_string"}}],"inLanguage":"en"},{"@type":"Organization","@id":"https:\/\/blazeclan.com\/anz\/#organization","name":"Blazeclan","url":"https:\/\/blazeclan.com\/anz\/","logo":{"@type":"ImageObject","inLanguage":"en","@id":"https:\/\/blazeclan.com\/anz\/#\/schema\/logo\/image\/","url":"https:\/\/blazeclan.com\/wp-content\/uploads\/2024\/10\/ITCI-Blazeclan_logo.svg","contentUrl":"https:\/\/blazeclan.com\/wp-content\/uploads\/2024\/10\/ITCI-Blazeclan_logo.svg","caption":"Blazeclan"},"image":{"@id":"https:\/\/blazeclan.com\/anz\/#\/schema\/logo\/image\/"},"sameAs":["https:\/\/www.facebook.com\/blazeclan.hq\/","https:\/\/x.com\/blazeclan_hq","https:\/\/www.instagram.com\/blazeclantechnologies\/","https:\/\/www.linkedin.com\/company\/blazeclan-technologies\/","https:\/\/www.youtube.com\/channel\/UCCKF4Lcbtus-pUoZr7Lxrow"]}]}},"_links":{"self":[{"href":"https:\/\/blazeclan.com\/anz\/wp-json\/wp\/v2\/case_study\/28329","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/blazeclan.com\/anz\/wp-json\/wp\/v2\/case_study"}],"about":[{"href":"https:\/\/blazeclan.com\/anz\/wp-json\/wp\/v2\/types\/case_study"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/blazeclan.com\/anz\/wp-json\/wp\/v2\/media\/12283"}],"wp:attachment":[{"href":"https:\/\/blazeclan.com\/anz\/wp-json\/wp\/v2\/media?parent=28329"}],"wp:term":[{"taxonomy":"case_category","embeddable":true,"href":"https:\/\/blazeclan.com\/anz\/wp-json\/wp\/v2\/case_category?post=28329"},{"taxonomy":"case_tags","embeddable":true,"href":"https:\/\/blazeclan.com\/anz\/wp-json\/wp\/v2\/case_tags?post=28329"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}