{"id":44199,"date":"2023-11-02T12:33:05","date_gmt":"2023-11-02T07:03:05","guid":{"rendered":"https:\/\/blazeclan.com\/?post_type=case_study&p=44199"},"modified":"2023-11-02T12:39:11","modified_gmt":"2023-11-02T07:09:11","slug":"blazeclans-data-ingestion-framework-helps-globe-telecom-inc-migrate-its-data-platform-to-snowflake-on-aws-within-3-months","status":"publish","type":"case_study","link":"https:\/\/blazeclan.com\/asean\/studies\/blazeclans-data-ingestion-framework-helps-globe-telecom-inc-migrate-its-data-platform-to-snowflake-on-aws-within-3-months\/","title":{"rendered":"Blazeclan’s Data Ingestion Framework Helps\u00a0Globe Telecom, Inc. Migrate its Data Platform\u00a0to Snowflake on AWS within 3 Months"},"content":{"rendered":"\n

About Globe Telecom, Inc.<\/h2>\n\n\n\n

Globe Telecom, Inc. is a leading Philippines-based full-service telecommunications company. It offers a suite of services and products, including mobile, broadband, internet, managed services, and data connectivity, to meet the technology and telecommunications needs of organizations. The company spans a wide presence across digital marketing solutions, financial technology, virtual healthcare, and venture capital funding for startups.<\/p>\n\n\n\n

T<\/strong>he Need for Data Platform Migration within Strict Timeline<\/h2>\n\n\n\n

Globe had its data platform on Teradata, which embodied 3 data marts with historical data of nearly 500 TB having 300-400 tables in total. The customer sought to decommission Teradata and replace it with a cloud-based data warehouse due to support-related issues that directly impacted its data management and eventually, the business. A key challenge in migrating Globe\u2019s data platform was that it was a stringent time frame of 3 months.<\/p>\n\n\n\n

Snowflake as a Solution<\/h2>\n\n\n\n

Keeping Globe\u2019s requirement in mind, Blazeclan proposed using Snowflake as a solution while moving its data platform to AWS. Considering the size of the platform, the Blazeclan team suggested using our data ingestion framework. The reason behind using this framework was its high compatibility in meeting Globe\u2019s requirements and facilitated fast-tracking migration by 60-70% compared to its existing Apache Spark for Amazon EMR operations. <\/p>\n\n\n\n

Initially, the solution was designed using AWS Glue, but considering the cost and budget of Globe, we chose to go with the more cost-effective Snowflake stored procedures. Here, Globe\u2019s responsibility was to transition the data from on-premises to Amazon S3, from where we have moved it to Snowflake. Hence, the data migration would flow in the manner of Teradata to Amazon S3 to Snowflake. Post-migration, Globe wanted support to manage its new data platform on the AWS-Snowflake environment.<\/p>\n\n\n\n

  • <\/div>

    50% faster and improved data ingestion for any number of tables<\/p><\/div><\/li>

  • <\/div>

    60% better transition between development to operations<\/p><\/div><\/li>

  • <\/div>

    80% increase in view performance with automated view creation<\/p><\/div><\/li><\/ul><\/div><\/div>\n\n\n\n

    Solution Approach<\/h3>\n\n\n\n

    The Blazeclan team implemented an ELT-based solution using the below frameworks on Snowflake for every given stage of the data flow:<\/p>\n\n\n\n

      \n
    • Snowflake loading Framework:<\/strong>  It is a customizable framework to load data from S3 in any given format. It can load multiple hidden tables at a time.<\/li>\n\n\n\n
    • DQ Framework:<\/strong> It helps validate the Data Quality (DQ) rules concerning null and length checks.<\/li>\n\n\n\n
    • SCD Framework:<\/strong> It’s the configuration-based dynamic framework to prepare the merge statements based on the conditions. <\/li>\n<\/ul>\n\n\n\n

      For data reconciliation, we maintained audit logs at every stage of data flow with record counts. Moreover, the team created operational & monitoring dashboards on Snowsight for visualization and connected Tableau dashboards to Snowflake as a downstream consuming application.<\/p>\n\n\n\n

      Solution Framework<\/h3>\n\n\n\n
      \"\"<\/figure>\n\n\n\n

      Benefits Achieved<\/h2>\n\n\n\n
        \n
      • Data reconciliation became effortless for Globe due to the implementation of the audit and logging framework.<\/li>\n\n\n\n
      • Direct loading into Snowflake enabled high availability and faster access to the data. <\/li>\n\n\n\n
      • Automated view creation enabled scanning raw tables and generating appropriate views, allowing only specific roles to view the data and determine how RBAC must be applied.<\/li>\n<\/ul>\n\n\n\n

        Tech Stack<\/h2>\n\n\n\n
        Amazon S3<\/td>Snowflake<\/td>Amazon SNS<\/td><\/tr>
        AWS Managed Airflow<\/td><\/td><\/td><\/tr><\/tbody><\/table><\/figure>\n","protected":false},"excerpt":{"rendered":"

        About Globe Telecom, Inc. Globe Telecom, Inc. is a leading Philippines-based full-service telecommunications company. It offers a suite of services and products, including mobile, broadband, internet, managed services, and data connectivity, to meet the technology and telecommunications needs of organizations. The company spans a wide presence across digital marketing solutions, financial technology, virtual healthcare, and […]<\/p>\n","protected":false},"featured_media":44206,"parent":0,"menu_order":0,"template":"","case_category":[3957],"case_tags":[4117,4292,4307,4367],"class_list":["post-44199","case_study","type-case_study","status-publish","has-post-thumbnail","hentry","case_category-data-modernization-asean","case_tags-aws-cloud-asean","case_tags-data-migration-asean","case_tags-data-modernization-asean","case_tags-snowflake-asean"],"acf":[],"yoast_head":"\nGlobe Telecom Migrates its Data Platform to Snowflake in 3 Months<\/title>\n<meta name=\"description\" content=\"Blazeclan's Data Ingestion Framework fast-tracked Globe Telecom, Inc.'s Data Platform Migration to Snowflake on AWS by 70%. How?\" \/>\n<meta name=\"robots\" content=\"index, follow, max-snippet:-1, max-image-preview:large, max-video-preview:-1\" \/>\n<link rel=\"canonical\" href=\"https:\/\/blazeclan.com\/asean\/studies\/blazeclans-data-ingestion-framework-helps-globe-telecom-inc-migrate-its-data-platform-to-snowflake-on-aws-within-3-months\/\" \/>\n<meta property=\"og:locale\" content=\"en_US\" \/>\n<meta property=\"og:type\" content=\"article\" \/>\n<meta property=\"og:title\" content=\"Globe Telecom Migrates its Data Platform to Snowflake in 3 Months\" \/>\n<meta property=\"og:description\" content=\"Blazeclan's Data Ingestion Framework fast-tracked Globe Telecom, Inc.'s Data Platform Migration to Snowflake on AWS by 70%. How?\" \/>\n<meta property=\"og:url\" content=\"https:\/\/blazeclan.com\/asean\/studies\/blazeclans-data-ingestion-framework-helps-globe-telecom-inc-migrate-its-data-platform-to-snowflake-on-aws-within-3-months\/\" \/>\n<meta property=\"og:site_name\" content=\"Blazeclan\" \/>\n<meta property=\"article:publisher\" content=\"https:\/\/www.facebook.com\/blazeclan.hq\/\" \/>\n<meta property=\"article:modified_time\" content=\"2023-11-02T07:09:11+00:00\" \/>\n<meta property=\"og:image\" content=\"https:\/\/blazeclan.com\/wp-content\/uploads\/2023\/11\/Globe-Telecom-Inc.-Migrates-its-Data-Platform-to-Snowflake-on-AWS-within-3-Months.png\" \/>\n\t<meta property=\"og:image:width\" content=\"1681\" \/>\n\t<meta property=\"og:image:height\" content=\"680\" \/>\n\t<meta property=\"og:image:type\" content=\"image\/png\" \/>\n<meta name=\"twitter:card\" content=\"summary_large_image\" \/>\n<meta name=\"twitter:site\" content=\"@blazeclan_hq\" \/>\n<meta name=\"twitter:label1\" content=\"Est. reading time\" \/>\n\t<meta name=\"twitter:data1\" content=\"3 minutes\" \/>\n<script type=\"application\/ld+json\" class=\"yoast-schema-graph\">{\"@context\":\"https:\/\/schema.org\",\"@graph\":[{\"@type\":\"WebPage\",\"@id\":\"https:\/\/blazeclan.com\/asean\/studies\/blazeclans-data-ingestion-framework-helps-globe-telecom-inc-migrate-its-data-platform-to-snowflake-on-aws-within-3-months\/\",\"url\":\"https:\/\/blazeclan.com\/asean\/studies\/blazeclans-data-ingestion-framework-helps-globe-telecom-inc-migrate-its-data-platform-to-snowflake-on-aws-within-3-months\/\",\"name\":\"Globe Telecom Migrates its Data Platform to Snowflake in 3 Months\",\"isPartOf\":{\"@id\":\"https:\/\/blazeclan.com\/asean\/#website\"},\"primaryImageOfPage\":{\"@id\":\"https:\/\/blazeclan.com\/asean\/studies\/blazeclans-data-ingestion-framework-helps-globe-telecom-inc-migrate-its-data-platform-to-snowflake-on-aws-within-3-months\/#primaryimage\"},\"image\":{\"@id\":\"https:\/\/blazeclan.com\/asean\/studies\/blazeclans-data-ingestion-framework-helps-globe-telecom-inc-migrate-its-data-platform-to-snowflake-on-aws-within-3-months\/#primaryimage\"},\"thumbnailUrl\":\"https:\/\/blazeclan.com\/wp-content\/uploads\/2023\/11\/Globe-Telecom-Inc.-Migrates-its-Data-Platform-to-Snowflake-on-AWS-within-3-Months.png\",\"datePublished\":\"2023-11-02T07:03:05+00:00\",\"dateModified\":\"2023-11-02T07:09:11+00:00\",\"description\":\"Blazeclan's Data Ingestion Framework fast-tracked Globe Telecom, Inc.'s Data Platform Migration to Snowflake on AWS by 70%. How?\",\"breadcrumb\":{\"@id\":\"https:\/\/blazeclan.com\/asean\/studies\/blazeclans-data-ingestion-framework-helps-globe-telecom-inc-migrate-its-data-platform-to-snowflake-on-aws-within-3-months\/#breadcrumb\"},\"inLanguage\":\"ASEAN\",\"potentialAction\":[{\"@type\":\"ReadAction\",\"target\":[\"https:\/\/blazeclan.com\/asean\/studies\/blazeclans-data-ingestion-framework-helps-globe-telecom-inc-migrate-its-data-platform-to-snowflake-on-aws-within-3-months\/\"]}]},{\"@type\":\"ImageObject\",\"inLanguage\":\"ASEAN\",\"@id\":\"https:\/\/blazeclan.com\/asean\/studies\/blazeclans-data-ingestion-framework-helps-globe-telecom-inc-migrate-its-data-platform-to-snowflake-on-aws-within-3-months\/#primaryimage\",\"url\":\"https:\/\/blazeclan.com\/wp-content\/uploads\/2023\/11\/Globe-Telecom-Inc.-Migrates-its-Data-Platform-to-Snowflake-on-AWS-within-3-Months.png\",\"contentUrl\":\"https:\/\/blazeclan.com\/wp-content\/uploads\/2023\/11\/Globe-Telecom-Inc.-Migrates-its-Data-Platform-to-Snowflake-on-AWS-within-3-Months.png\",\"width\":1681,\"height\":680},{\"@type\":\"BreadcrumbList\",\"@id\":\"https:\/\/blazeclan.com\/asean\/studies\/blazeclans-data-ingestion-framework-helps-globe-telecom-inc-migrate-its-data-platform-to-snowflake-on-aws-within-3-months\/#breadcrumb\",\"itemListElement\":[{\"@type\":\"ListItem\",\"position\":1,\"name\":\"Home\",\"item\":\"https:\/\/blazeclan.com\/asean\/\"},{\"@type\":\"ListItem\",\"position\":2,\"name\":\"Case Study\",\"item\":\"https:\/\/blazeclan.com\/asean\/case-studies\/\"},{\"@type\":\"ListItem\",\"position\":3,\"name\":\"Blazeclan’s Data Ingestion Framework Helps\u00a0Globe Telecom, Inc. Migrate its Data Platform\u00a0to Snowflake on AWS within 3 Months\"}]},{\"@type\":\"WebSite\",\"@id\":\"https:\/\/blazeclan.com\/asean\/#website\",\"url\":\"https:\/\/blazeclan.com\/asean\/\",\"name\":\"Blazeclan\",\"description\":\"\",\"publisher\":{\"@id\":\"https:\/\/blazeclan.com\/asean\/#organization\"},\"potentialAction\":[{\"@type\":\"SearchAction\",\"target\":{\"@type\":\"EntryPoint\",\"urlTemplate\":\"https:\/\/blazeclan.com\/asean\/?s={search_term_string}\"},\"query-input\":{\"@type\":\"PropertyValueSpecification\",\"valueRequired\":true,\"valueName\":\"search_term_string\"}}],\"inLanguage\":\"ASEAN\"},{\"@type\":\"Organization\",\"@id\":\"https:\/\/blazeclan.com\/asean\/#organization\",\"name\":\"Blazeclan\",\"url\":\"https:\/\/blazeclan.com\/asean\/\",\"logo\":{\"@type\":\"ImageObject\",\"inLanguage\":\"ASEAN\",\"@id\":\"https:\/\/blazeclan.com\/asean\/#\/schema\/logo\/image\/\",\"url\":\"https:\/\/blazeclan.com\/wp-content\/uploads\/2024\/10\/ITCI-Blazeclan_logo.svg\",\"contentUrl\":\"https:\/\/blazeclan.com\/wp-content\/uploads\/2024\/10\/ITCI-Blazeclan_logo.svg\",\"caption\":\"Blazeclan\"},\"image\":{\"@id\":\"https:\/\/blazeclan.com\/asean\/#\/schema\/logo\/image\/\"},\"sameAs\":[\"https:\/\/www.facebook.com\/blazeclan.hq\/\",\"https:\/\/x.com\/blazeclan_hq\",\"https:\/\/www.instagram.com\/blazeclantechnologies\/\",\"https:\/\/www.linkedin.com\/company\/blazeclan-technologies\/\",\"https:\/\/www.youtube.com\/channel\/UCCKF4Lcbtus-pUoZr7Lxrow\"]}]}<\/script>\n<!-- \/ Yoast SEO plugin. -->","yoast_head_json":{"title":"Globe Telecom Migrates its Data Platform to Snowflake in 3 Months","description":"Blazeclan's Data Ingestion Framework fast-tracked Globe Telecom, Inc.'s Data Platform Migration to Snowflake on AWS by 70%. How?","robots":{"index":"index","follow":"follow","max-snippet":"max-snippet:-1","max-image-preview":"max-image-preview:large","max-video-preview":"max-video-preview:-1"},"canonical":"https:\/\/blazeclan.com\/asean\/studies\/blazeclans-data-ingestion-framework-helps-globe-telecom-inc-migrate-its-data-platform-to-snowflake-on-aws-within-3-months\/","og_locale":"en_US","og_type":"article","og_title":"Globe Telecom Migrates its Data Platform to Snowflake in 3 Months","og_description":"Blazeclan's Data Ingestion Framework fast-tracked Globe Telecom, Inc.'s Data Platform Migration to Snowflake on AWS by 70%. How?","og_url":"https:\/\/blazeclan.com\/asean\/studies\/blazeclans-data-ingestion-framework-helps-globe-telecom-inc-migrate-its-data-platform-to-snowflake-on-aws-within-3-months\/","og_site_name":"Blazeclan","article_publisher":"https:\/\/www.facebook.com\/blazeclan.hq\/","article_modified_time":"2023-11-02T07:09:11+00:00","og_image":[{"width":1681,"height":680,"url":"https:\/\/blazeclan.com\/wp-content\/uploads\/2023\/11\/Globe-Telecom-Inc.-Migrates-its-Data-Platform-to-Snowflake-on-AWS-within-3-Months.png","type":"image\/png"}],"twitter_card":"summary_large_image","twitter_site":"@blazeclan_hq","twitter_misc":{"Est. reading time":"3 minutes"},"schema":{"@context":"https:\/\/schema.org","@graph":[{"@type":"WebPage","@id":"https:\/\/blazeclan.com\/asean\/studies\/blazeclans-data-ingestion-framework-helps-globe-telecom-inc-migrate-its-data-platform-to-snowflake-on-aws-within-3-months\/","url":"https:\/\/blazeclan.com\/asean\/studies\/blazeclans-data-ingestion-framework-helps-globe-telecom-inc-migrate-its-data-platform-to-snowflake-on-aws-within-3-months\/","name":"Globe Telecom Migrates its Data Platform to Snowflake in 3 Months","isPartOf":{"@id":"https:\/\/blazeclan.com\/asean\/#website"},"primaryImageOfPage":{"@id":"https:\/\/blazeclan.com\/asean\/studies\/blazeclans-data-ingestion-framework-helps-globe-telecom-inc-migrate-its-data-platform-to-snowflake-on-aws-within-3-months\/#primaryimage"},"image":{"@id":"https:\/\/blazeclan.com\/asean\/studies\/blazeclans-data-ingestion-framework-helps-globe-telecom-inc-migrate-its-data-platform-to-snowflake-on-aws-within-3-months\/#primaryimage"},"thumbnailUrl":"https:\/\/blazeclan.com\/wp-content\/uploads\/2023\/11\/Globe-Telecom-Inc.-Migrates-its-Data-Platform-to-Snowflake-on-AWS-within-3-Months.png","datePublished":"2023-11-02T07:03:05+00:00","dateModified":"2023-11-02T07:09:11+00:00","description":"Blazeclan's Data Ingestion Framework fast-tracked Globe Telecom, Inc.'s Data Platform Migration to Snowflake on AWS by 70%. How?","breadcrumb":{"@id":"https:\/\/blazeclan.com\/asean\/studies\/blazeclans-data-ingestion-framework-helps-globe-telecom-inc-migrate-its-data-platform-to-snowflake-on-aws-within-3-months\/#breadcrumb"},"inLanguage":"ASEAN","potentialAction":[{"@type":"ReadAction","target":["https:\/\/blazeclan.com\/asean\/studies\/blazeclans-data-ingestion-framework-helps-globe-telecom-inc-migrate-its-data-platform-to-snowflake-on-aws-within-3-months\/"]}]},{"@type":"ImageObject","inLanguage":"ASEAN","@id":"https:\/\/blazeclan.com\/asean\/studies\/blazeclans-data-ingestion-framework-helps-globe-telecom-inc-migrate-its-data-platform-to-snowflake-on-aws-within-3-months\/#primaryimage","url":"https:\/\/blazeclan.com\/wp-content\/uploads\/2023\/11\/Globe-Telecom-Inc.-Migrates-its-Data-Platform-to-Snowflake-on-AWS-within-3-Months.png","contentUrl":"https:\/\/blazeclan.com\/wp-content\/uploads\/2023\/11\/Globe-Telecom-Inc.-Migrates-its-Data-Platform-to-Snowflake-on-AWS-within-3-Months.png","width":1681,"height":680},{"@type":"BreadcrumbList","@id":"https:\/\/blazeclan.com\/asean\/studies\/blazeclans-data-ingestion-framework-helps-globe-telecom-inc-migrate-its-data-platform-to-snowflake-on-aws-within-3-months\/#breadcrumb","itemListElement":[{"@type":"ListItem","position":1,"name":"Home","item":"https:\/\/blazeclan.com\/asean\/"},{"@type":"ListItem","position":2,"name":"Case Study","item":"https:\/\/blazeclan.com\/asean\/case-studies\/"},{"@type":"ListItem","position":3,"name":"Blazeclan’s Data Ingestion Framework Helps\u00a0Globe Telecom, Inc. Migrate its Data Platform\u00a0to Snowflake on AWS within 3 Months"}]},{"@type":"WebSite","@id":"https:\/\/blazeclan.com\/asean\/#website","url":"https:\/\/blazeclan.com\/asean\/","name":"Blazeclan","description":"","publisher":{"@id":"https:\/\/blazeclan.com\/asean\/#organization"},"potentialAction":[{"@type":"SearchAction","target":{"@type":"EntryPoint","urlTemplate":"https:\/\/blazeclan.com\/asean\/?s={search_term_string}"},"query-input":{"@type":"PropertyValueSpecification","valueRequired":true,"valueName":"search_term_string"}}],"inLanguage":"ASEAN"},{"@type":"Organization","@id":"https:\/\/blazeclan.com\/asean\/#organization","name":"Blazeclan","url":"https:\/\/blazeclan.com\/asean\/","logo":{"@type":"ImageObject","inLanguage":"ASEAN","@id":"https:\/\/blazeclan.com\/asean\/#\/schema\/logo\/image\/","url":"https:\/\/blazeclan.com\/wp-content\/uploads\/2024\/10\/ITCI-Blazeclan_logo.svg","contentUrl":"https:\/\/blazeclan.com\/wp-content\/uploads\/2024\/10\/ITCI-Blazeclan_logo.svg","caption":"Blazeclan"},"image":{"@id":"https:\/\/blazeclan.com\/asean\/#\/schema\/logo\/image\/"},"sameAs":["https:\/\/www.facebook.com\/blazeclan.hq\/","https:\/\/x.com\/blazeclan_hq","https:\/\/www.instagram.com\/blazeclantechnologies\/","https:\/\/www.linkedin.com\/company\/blazeclan-technologies\/","https:\/\/www.youtube.com\/channel\/UCCKF4Lcbtus-pUoZr7Lxrow"]}]}},"_links":{"self":[{"href":"https:\/\/blazeclan.com\/asean\/wp-json\/wp\/v2\/case_study\/44199","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/blazeclan.com\/asean\/wp-json\/wp\/v2\/case_study"}],"about":[{"href":"https:\/\/blazeclan.com\/asean\/wp-json\/wp\/v2\/types\/case_study"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/blazeclan.com\/asean\/wp-json\/wp\/v2\/media\/44206"}],"wp:attachment":[{"href":"https:\/\/blazeclan.com\/asean\/wp-json\/wp\/v2\/media?parent=44199"}],"wp:term":[{"taxonomy":"case_category","embeddable":true,"href":"https:\/\/blazeclan.com\/asean\/wp-json\/wp\/v2\/case_category?post=44199"},{"taxonomy":"case_tags","embeddable":true,"href":"https:\/\/blazeclan.com\/asean\/wp-json\/wp\/v2\/case_tags?post=44199"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}