{"id":28556,"date":"2022-11-25T12:44:12","date_gmt":"2022-11-25T07:14:12","guid":{"rendered":"https:\/\/blazeclan.com\/?post_type=case_study&p=28556"},"modified":"2024-03-18T18:37:17","modified_gmt":"2024-03-18T13:07:17","slug":"a-leading-housing-finance-company-leveraged-aws-cloud-for-serverless-data-warehousing-and-analytics","status":"publish","type":"case_study","link":"https:\/\/blazeclan.com\/india\/studies\/a-leading-housing-finance-company-leveraged-aws-cloud-for-serverless-data-warehousing-and-analytics\/","title":{"rendered":"A Leading Housing Finance Company Leveraged AWS Cloud for Serverless Data Warehousing and Analytics"},"content":{"rendered":"

The customer is a leading housing finance company, one of the most diversified NBFCs in the country with 19 product lines across consumer, commercial and SME finance, which makes it one of the most profitable companies in the category.\u00a0<\/span>The main objective of the company is to provide long-term finance to individuals as well as corporate entities for purchase, construction, and renovation of homes, plots or commercial spaces. Mainly, it provides finance to builders and developers engaged in the construction of homes. The customer wanted to build a serverless data warehouse on the AWS cloud.<\/span><\/span><\/p>\n

The Need for A Scalable, Cost-Effective Data Warehouse System<\/span><\/h2>\n

The customer needed to build their separate Data Warehouse and <\/span>Analytical system<\/span><\/a> from scratch. Their analytical department had the challenge of building such a system that will meet the existing analytical reporting requirements as well as to have a flexible and scalable system for\u00a0<\/span>future requirements. They needed the system to be cost-effective, scalable, fail-over capable and co-operative with a sudden spike in workload. The project expected to go live within 7 to 8 months, hence, they did not want to spend time and resources for managing on-premise hardware infrastructure.<\/span><\/p>\n

Blazeclan’s Proposed a AWS Cloud-based Solution<\/span><\/h2>\n

Keeping the key objectives like cost-effectiveness, scalability and fastest delivery in mind, the Blazeclan team proposed AWS cloud-based solution for the requirement. Blazeclan\u2019s solution architect team designed the below phases\/components of the project.<\/span><\/p>\n

    \n
  1. \n

    Source Data Capture:<\/span>\u00a0Being a financial company, the customer had a variety of pennant-based data sources like LMS (Loan management system), LOS (Loan Origination system), VAS (Value Added Services), and Campaigning Data and CIBIL Data. The team created an Oracle-based staging database (AWS RDS) that would have only incremental data extraction from above OLTP sources. Later, this incremental data is migrated to AWS S3 using the AWS DMS (Data migration system). Another source for data was API and CSV which were processed via AWS lambda and API and later put into S3.<\/span><\/p>\n<\/li>\n

  2. \n

    Data Storage and Security:<\/span>\u00a0Data captured via DMS, Lambda and API were later put on S3 file storage. For the customer, being a financial organization, the top priority was the security of the data. The Blazeclan team leveraged IAM policies and KMS encryption to meet security expectations.<\/span><\/p>\n<\/li>\n

  3. \n

    Data processing:<\/span>\u00a0As soon as files are put on S3, wrapper Lambda\u2019s for each module (LMS, LOS, VAS, and campaign, etc) get triggers that invoke respective glue jobs. These glue jobs perform configurable data validations processing, like referential integrity checks, NULL checks, and Data type checks and later, classify them in fact and dimension tables.<\/span><\/p>\n<\/li>\n

  4. \n

    Data Warehousing\/Publishing:<\/span>\u00a0These glue jobs process the data and populate them in respective fact and dimension tables in a data mart, created in the AURORA Postgres database. The monitoring, logging, and troubleshooting are performed in AWS Cloudwatch.<\/span><\/p>\n<\/li>\n

  5. \n

    Visualization\/Notification:<\/span>\u00a0Visualization of reports and business insights were designed in tableau installed on a reserved EC2 instance. The data mart was used as a source for these visualizations. Most of the scheduled reports were automated using AWS Cloudwatch daily and delivered to the management via mail. Some part of the data was also published using APIs. The team effectively used Lambda functions for generating these reports, as per the requirement of the business.<\/span><\/p>\n<\/li>\n<\/ol>\n

    Benefits to the Customer<\/span><\/h2>\n
      \n
    1. \n

      Data Archival:<\/span>\u00a0After processing of data residing at S3 storage, it was automated to be transferred to AWS Glacier for cost optimization.<\/span><\/p>\n<\/li>\n

    2. \n

      Fastest Delivery:<\/span>\u00a0Due to the cloud-based solution with serverless and managed services, the customer got the solution delivered within 7 months.<\/span><\/p>\n<\/li>\n

    3. \n

      Cost Reduction:<\/span>\u00a0Serverless and managed services eliminated the extra cost to be spent on on-premise hardware infrastructure and its maintenance.<\/span><\/p>\n<\/li>\n

    4. \n

      Automation:<\/span>\u00a0Variety of the reports to be sent to the customer\u2019s management team was automated using CloudWatch and Lambda’s time and event-based invocation reduced a lot of manual work.<\/span><\/p>\n<\/li>\n

    5. \n

      Enriched Visualizations:<\/span>\u00a0With Tableau, the customer got interactive and enriched visualizations.<\/span><\/p>\n<\/li>\n<\/ol>\n

      Tech Stack<\/span><\/h2>\n
      \n\n\n\n\n\n\n
      \n

      AWS Lambda<\/span><\/p>\n<\/td>\n

      		\n

      Amazon S3<\/span><\/p>\n<\/td>\n

      		\n

      AWS Glue<\/span><\/p>\n<\/td>\n<\/tr>\n

      \n

      ARORA Postgres<\/span><\/p>\n<\/td>\n

      		\n

      Amazon API Gateway<\/span><\/p>\n<\/td>\n

      		\n

      Amazon CloudWatch<\/span><\/p>\n<\/td>\n<\/tr>\n

      \n

      AWS Glacier<\/span><\/p>\n<\/td>\n

      		\n

      Amazon KMS<\/span><\/p>\n<\/td>\n

      		\n

      AWS RDS<\/span><\/p>\n<\/td>\n<\/tr>\n

      \n

      AWS DMS<\/span><\/p>\n<\/td>\n

      		\n

      Code Summit<\/span><\/p>\n<\/td>\n

      		<\/td>\n<\/tr>\n<\/tbody>\n<\/table>\n<\/div>\n","protected":false},"excerpt":{"rendered":"

      The customer is a leading housing finance company, one of the most diversified NBFCs in the country with 19 product lines across consumer, commercial and SME finance, which makes it one of the most profitable companies in the category.\u00a0The main objective of the company is to provide long-term finance to individuals as well as corporate […]<\/p>\n","protected":false},"featured_media":11826,"parent":0,"menu_order":0,"template":"","case_category":[3925],"case_tags":[4160,4120,4155,4110,4115,4150],"class_list":["post-28556","case_study","type-case_study","status-publish","has-post-thumbnail","hentry","case_category-datalake-india","case_tags-analytics-india","case_tags-aws-cloud-india","case_tags-big-data-india","case_tags-cloud-india","case_tags-cloud-computing-india","case_tags-data-lake-india"],"acf":[],"yoast_head":"\nA Leading Housing Finance Company Leveraged AWS Cloud for Serverless Data Warehousing and Analytics<\/title>\n<meta name=\"description\" content=\"AWS-based Serverless and managed service eliminated the extra cost of the company that was spent on on-premise hardware infrastructure and its maintenance.\" \/>\n<meta name=\"robots\" content=\"index, follow, max-snippet:-1, max-image-preview:large, max-video-preview:-1\" \/>\n<link rel=\"canonical\" href=\"https:\/\/blazeclan.com\/india\/studies\/a-leading-housing-finance-company-leveraged-aws-cloud-for-serverless-data-warehousing-and-analytics\/\" \/>\n<meta property=\"og:locale\" content=\"en_US\" \/>\n<meta property=\"og:type\" content=\"article\" \/>\n<meta property=\"og:title\" content=\"A Leading Housing Finance Company Leveraged AWS Cloud for Serverless Data Warehousing and Analytics\" \/>\n<meta property=\"og:description\" content=\"AWS-based Serverless and managed service eliminated the extra cost of the company that was spent on on-premise hardware infrastructure and its maintenance.\" \/>\n<meta property=\"og:url\" content=\"https:\/\/blazeclan.com\/studies\/a-leading-housing-finance-company-leveraged-aws-cloud-for-serverless-data-warehousing-and-analytics\/\" \/>\n<meta property=\"og:site_name\" content=\"Blazeclan\" \/>\n<meta property=\"article:publisher\" content=\"https:\/\/www.facebook.com\/blazeclan.hq\/\" \/>\n<meta property=\"article:modified_time\" content=\"2024-03-18T13:07:17+00:00\" \/>\n<meta property=\"og:image\" content=\"https:\/\/blazeclan.com\/wp-content\/uploads\/2020\/01\/A-Leading-Housing-Finance-Company-Leveraged-AWS-Cloud-for-Serverless-Data-Warehousing-and-Analytics-1-1.png\" \/>\n\t<meta property=\"og:image:width\" content=\"2000\" \/>\n\t<meta property=\"og:image:height\" content=\"900\" \/>\n\t<meta property=\"og:image:type\" content=\"image\/png\" \/>\n<meta name=\"twitter:card\" content=\"summary_large_image\" \/>\n<meta name=\"twitter:site\" content=\"@blazeclan_hq\" \/>\n<meta name=\"twitter:label1\" content=\"Est. reading time\" \/>\n\t<meta name=\"twitter:data1\" content=\"4 minutes\" \/>\n<script type=\"application\/ld+json\" class=\"yoast-schema-graph\">{\"@context\":\"https:\/\/schema.org\",\"@graph\":[{\"@type\":\"WebPage\",\"@id\":\"https:\/\/blazeclan.com\/india\/studies\/a-leading-housing-finance-company-leveraged-aws-cloud-for-serverless-data-warehousing-and-analytics\/\",\"url\":\"https:\/\/blazeclan.com\/studies\/a-leading-housing-finance-company-leveraged-aws-cloud-for-serverless-data-warehousing-and-analytics\/\",\"name\":\"A Leading Housing Finance Company Leveraged AWS Cloud for Serverless Data Warehousing and Analytics\",\"isPartOf\":{\"@id\":\"https:\/\/blazeclan.com\/india\/#website\"},\"primaryImageOfPage\":{\"@id\":\"https:\/\/blazeclan.com\/studies\/a-leading-housing-finance-company-leveraged-aws-cloud-for-serverless-data-warehousing-and-analytics\/#primaryimage\"},\"image\":{\"@id\":\"https:\/\/blazeclan.com\/studies\/a-leading-housing-finance-company-leveraged-aws-cloud-for-serverless-data-warehousing-and-analytics\/#primaryimage\"},\"thumbnailUrl\":\"https:\/\/blazeclan.com\/wp-content\/uploads\/2020\/01\/A-Leading-Housing-Finance-Company-Leveraged-AWS-Cloud-for-Serverless-Data-Warehousing-and-Analytics-1-1.png\",\"datePublished\":\"2022-11-25T07:14:12+00:00\",\"dateModified\":\"2024-03-18T13:07:17+00:00\",\"description\":\"AWS-based Serverless and managed service eliminated the extra cost of the company that was spent on on-premise hardware infrastructure and its maintenance.\",\"breadcrumb\":{\"@id\":\"https:\/\/blazeclan.com\/studies\/a-leading-housing-finance-company-leveraged-aws-cloud-for-serverless-data-warehousing-and-analytics\/#breadcrumb\"},\"inLanguage\":\"en-IN\",\"potentialAction\":[{\"@type\":\"ReadAction\",\"target\":[\"https:\/\/blazeclan.com\/studies\/a-leading-housing-finance-company-leveraged-aws-cloud-for-serverless-data-warehousing-and-analytics\/\"]}]},{\"@type\":\"ImageObject\",\"inLanguage\":\"en-IN\",\"@id\":\"https:\/\/blazeclan.com\/studies\/a-leading-housing-finance-company-leveraged-aws-cloud-for-serverless-data-warehousing-and-analytics\/#primaryimage\",\"url\":\"https:\/\/blazeclan.com\/wp-content\/uploads\/2020\/01\/A-Leading-Housing-Finance-Company-Leveraged-AWS-Cloud-for-Serverless-Data-Warehousing-and-Analytics-1-1.png\",\"contentUrl\":\"https:\/\/blazeclan.com\/wp-content\/uploads\/2020\/01\/A-Leading-Housing-Finance-Company-Leveraged-AWS-Cloud-for-Serverless-Data-Warehousing-and-Analytics-1-1.png\",\"width\":2000,\"height\":900},{\"@type\":\"BreadcrumbList\",\"@id\":\"https:\/\/blazeclan.com\/studies\/a-leading-housing-finance-company-leveraged-aws-cloud-for-serverless-data-warehousing-and-analytics\/#breadcrumb\",\"itemListElement\":[{\"@type\":\"ListItem\",\"position\":1,\"name\":\"Home\",\"item\":\"https:\/\/blazeclan.com\/india\/\"},{\"@type\":\"ListItem\",\"position\":2,\"name\":\"Case Study\",\"item\":\"https:\/\/blazeclan.com\/india\/case-studies\/\"},{\"@type\":\"ListItem\",\"position\":3,\"name\":\"A Leading Housing Finance Company Leveraged AWS Cloud for Serverless Data Warehousing and Analytics\"}]},{\"@type\":\"WebSite\",\"@id\":\"https:\/\/blazeclan.com\/india\/#website\",\"url\":\"https:\/\/blazeclan.com\/india\/\",\"name\":\"Blazeclan\",\"description\":\"\",\"publisher\":{\"@id\":\"https:\/\/blazeclan.com\/india\/#organization\"},\"potentialAction\":[{\"@type\":\"SearchAction\",\"target\":{\"@type\":\"EntryPoint\",\"urlTemplate\":\"https:\/\/blazeclan.com\/india\/?s={search_term_string}\"},\"query-input\":{\"@type\":\"PropertyValueSpecification\",\"valueRequired\":true,\"valueName\":\"search_term_string\"}}],\"inLanguage\":\"en-IN\"},{\"@type\":\"Organization\",\"@id\":\"https:\/\/blazeclan.com\/india\/#organization\",\"name\":\"Blazeclan\",\"url\":\"https:\/\/blazeclan.com\/india\/\",\"logo\":{\"@type\":\"ImageObject\",\"inLanguage\":\"en-IN\",\"@id\":\"https:\/\/blazeclan.com\/india\/#\/schema\/logo\/image\/\",\"url\":\"https:\/\/blazeclan.com\/wp-content\/uploads\/2024\/10\/ITCI-Blazeclan_logo.svg\",\"contentUrl\":\"https:\/\/blazeclan.com\/wp-content\/uploads\/2024\/10\/ITCI-Blazeclan_logo.svg\",\"caption\":\"Blazeclan\"},\"image\":{\"@id\":\"https:\/\/blazeclan.com\/india\/#\/schema\/logo\/image\/\"},\"sameAs\":[\"https:\/\/www.facebook.com\/blazeclan.hq\/\",\"https:\/\/x.com\/blazeclan_hq\",\"https:\/\/www.instagram.com\/blazeclantechnologies\/\",\"https:\/\/www.linkedin.com\/company\/blazeclan-technologies\/\",\"https:\/\/www.youtube.com\/channel\/UCCKF4Lcbtus-pUoZr7Lxrow\"]}]}<\/script>\n<!-- \/ Yoast SEO plugin. -->","yoast_head_json":{"title":"A Leading Housing Finance Company Leveraged AWS Cloud for Serverless Data Warehousing and Analytics","description":"AWS-based Serverless and managed service eliminated the extra cost of the company that was spent on on-premise hardware infrastructure and its maintenance.","robots":{"index":"index","follow":"follow","max-snippet":"max-snippet:-1","max-image-preview":"max-image-preview:large","max-video-preview":"max-video-preview:-1"},"canonical":"https:\/\/blazeclan.com\/india\/studies\/a-leading-housing-finance-company-leveraged-aws-cloud-for-serverless-data-warehousing-and-analytics\/","og_locale":"en_US","og_type":"article","og_title":"A Leading Housing Finance Company Leveraged AWS Cloud for Serverless Data Warehousing and Analytics","og_description":"AWS-based Serverless and managed service eliminated the extra cost of the company that was spent on on-premise hardware infrastructure and its maintenance.","og_url":"https:\/\/blazeclan.com\/studies\/a-leading-housing-finance-company-leveraged-aws-cloud-for-serverless-data-warehousing-and-analytics\/","og_site_name":"Blazeclan","article_publisher":"https:\/\/www.facebook.com\/blazeclan.hq\/","article_modified_time":"2024-03-18T13:07:17+00:00","og_image":[{"width":2000,"height":900,"url":"https:\/\/blazeclan.com\/wp-content\/uploads\/2020\/01\/A-Leading-Housing-Finance-Company-Leveraged-AWS-Cloud-for-Serverless-Data-Warehousing-and-Analytics-1-1.png","type":"image\/png"}],"twitter_card":"summary_large_image","twitter_site":"@blazeclan_hq","twitter_misc":{"Est. reading time":"4 minutes"},"schema":{"@context":"https:\/\/schema.org","@graph":[{"@type":"WebPage","@id":"https:\/\/blazeclan.com\/india\/studies\/a-leading-housing-finance-company-leveraged-aws-cloud-for-serverless-data-warehousing-and-analytics\/","url":"https:\/\/blazeclan.com\/studies\/a-leading-housing-finance-company-leveraged-aws-cloud-for-serverless-data-warehousing-and-analytics\/","name":"A Leading Housing Finance Company Leveraged AWS Cloud for Serverless Data Warehousing and Analytics","isPartOf":{"@id":"https:\/\/blazeclan.com\/india\/#website"},"primaryImageOfPage":{"@id":"https:\/\/blazeclan.com\/studies\/a-leading-housing-finance-company-leveraged-aws-cloud-for-serverless-data-warehousing-and-analytics\/#primaryimage"},"image":{"@id":"https:\/\/blazeclan.com\/studies\/a-leading-housing-finance-company-leveraged-aws-cloud-for-serverless-data-warehousing-and-analytics\/#primaryimage"},"thumbnailUrl":"https:\/\/blazeclan.com\/wp-content\/uploads\/2020\/01\/A-Leading-Housing-Finance-Company-Leveraged-AWS-Cloud-for-Serverless-Data-Warehousing-and-Analytics-1-1.png","datePublished":"2022-11-25T07:14:12+00:00","dateModified":"2024-03-18T13:07:17+00:00","description":"AWS-based Serverless and managed service eliminated the extra cost of the company that was spent on on-premise hardware infrastructure and its maintenance.","breadcrumb":{"@id":"https:\/\/blazeclan.com\/studies\/a-leading-housing-finance-company-leveraged-aws-cloud-for-serverless-data-warehousing-and-analytics\/#breadcrumb"},"inLanguage":"en-IN","potentialAction":[{"@type":"ReadAction","target":["https:\/\/blazeclan.com\/studies\/a-leading-housing-finance-company-leveraged-aws-cloud-for-serverless-data-warehousing-and-analytics\/"]}]},{"@type":"ImageObject","inLanguage":"en-IN","@id":"https:\/\/blazeclan.com\/studies\/a-leading-housing-finance-company-leveraged-aws-cloud-for-serverless-data-warehousing-and-analytics\/#primaryimage","url":"https:\/\/blazeclan.com\/wp-content\/uploads\/2020\/01\/A-Leading-Housing-Finance-Company-Leveraged-AWS-Cloud-for-Serverless-Data-Warehousing-and-Analytics-1-1.png","contentUrl":"https:\/\/blazeclan.com\/wp-content\/uploads\/2020\/01\/A-Leading-Housing-Finance-Company-Leveraged-AWS-Cloud-for-Serverless-Data-Warehousing-and-Analytics-1-1.png","width":2000,"height":900},{"@type":"BreadcrumbList","@id":"https:\/\/blazeclan.com\/studies\/a-leading-housing-finance-company-leveraged-aws-cloud-for-serverless-data-warehousing-and-analytics\/#breadcrumb","itemListElement":[{"@type":"ListItem","position":1,"name":"Home","item":"https:\/\/blazeclan.com\/india\/"},{"@type":"ListItem","position":2,"name":"Case Study","item":"https:\/\/blazeclan.com\/india\/case-studies\/"},{"@type":"ListItem","position":3,"name":"A Leading Housing Finance Company Leveraged AWS Cloud for Serverless Data Warehousing and Analytics"}]},{"@type":"WebSite","@id":"https:\/\/blazeclan.com\/india\/#website","url":"https:\/\/blazeclan.com\/india\/","name":"Blazeclan","description":"","publisher":{"@id":"https:\/\/blazeclan.com\/india\/#organization"},"potentialAction":[{"@type":"SearchAction","target":{"@type":"EntryPoint","urlTemplate":"https:\/\/blazeclan.com\/india\/?s={search_term_string}"},"query-input":{"@type":"PropertyValueSpecification","valueRequired":true,"valueName":"search_term_string"}}],"inLanguage":"en-IN"},{"@type":"Organization","@id":"https:\/\/blazeclan.com\/india\/#organization","name":"Blazeclan","url":"https:\/\/blazeclan.com\/india\/","logo":{"@type":"ImageObject","inLanguage":"en-IN","@id":"https:\/\/blazeclan.com\/india\/#\/schema\/logo\/image\/","url":"https:\/\/blazeclan.com\/wp-content\/uploads\/2024\/10\/ITCI-Blazeclan_logo.svg","contentUrl":"https:\/\/blazeclan.com\/wp-content\/uploads\/2024\/10\/ITCI-Blazeclan_logo.svg","caption":"Blazeclan"},"image":{"@id":"https:\/\/blazeclan.com\/india\/#\/schema\/logo\/image\/"},"sameAs":["https:\/\/www.facebook.com\/blazeclan.hq\/","https:\/\/x.com\/blazeclan_hq","https:\/\/www.instagram.com\/blazeclantechnologies\/","https:\/\/www.linkedin.com\/company\/blazeclan-technologies\/","https:\/\/www.youtube.com\/channel\/UCCKF4Lcbtus-pUoZr7Lxrow"]}]}},"_links":{"self":[{"href":"https:\/\/blazeclan.com\/india\/wp-json\/wp\/v2\/case_study\/28556","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/blazeclan.com\/india\/wp-json\/wp\/v2\/case_study"}],"about":[{"href":"https:\/\/blazeclan.com\/india\/wp-json\/wp\/v2\/types\/case_study"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/blazeclan.com\/india\/wp-json\/wp\/v2\/media\/11826"}],"wp:attachment":[{"href":"https:\/\/blazeclan.com\/india\/wp-json\/wp\/v2\/media?parent=28556"}],"wp:term":[{"taxonomy":"case_category","embeddable":true,"href":"https:\/\/blazeclan.com\/india\/wp-json\/wp\/v2\/case_category?post=28556"},{"taxonomy":"case_tags","embeddable":true,"href":"https:\/\/blazeclan.com\/india\/wp-json\/wp\/v2\/case_tags?post=28556"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}