{"id":30119,"date":"2022-11-25T18:21:31","date_gmt":"2022-11-25T12:51:31","guid":{"rendered":"https:\/\/blazeclan.com\/manoeuvering-data-highway-shards-amazon-kinesis\/"},"modified":"2023-03-11T15:46:04","modified_gmt":"2023-03-11T10:16:04","slug":"manoeuvering-data-highway-shards-amazon-kinesis","status":"publish","type":"post","link":"https:\/\/blazeclan.com\/india\/blog\/manoeuvering-data-highway-shards-amazon-kinesis\/","title":{"rendered":"Manoeuvering Through the Big Data Highway (Shards) with Amazon Kinesis"},"content":{"rendered":"<p>Source: Screenshot from Official AWS Kinesis video<\/p>\n<p>In my&nbsp;last post, we captured an overview of what Kinesis does and what it is capable of doing. In this post we will dive a bit deeper into the technical building Blocks of Kinesis. Yes you will still understand this Blog even if you\u2019re not a Web Developer, Just to clear your Doubts! Anyways, so lets come back where we took off in the Kinesis Story. We know that&nbsp;<span>Kinesis enables capturing of continuous stream of data; capable of processing data in real time! So what is this Stream made of? How does my data from different sources logically get processed without getting intermingled? That\u2019s what we\u2019re here to find out.<\/span><\/p>\n<p>&nbsp;<\/p>\n<p><span>Shards \u2013 The Data Highway<\/span><\/p>\n<p><span>So what is a Kinesis Stream made of? Well, a Kinesis Stream is made of&nbsp; a single or multiple number of \u201cshards\u201d.So now you might wondering what is a shard ??&nbsp;<\/span><span>Well <a title=\"Learn more on AWS Website\" href=\"https:\/\/docs.aws.amazon.com\/kinesis\/latest\/dev\/key-concepts.html\" target=\"_blank\" rel=\"noopener noreferrer\">AWS Cloud Defines Shards<\/a> as;<span id=\"more-1744\"><\/span><\/span><\/p>\n<p>\u201cA Shard is a scaling unit for a stream. A shard is a uniquely identified group of data records in an Amazon Kinesis stream\u201d<\/p>\n<p><span>Woah ! That may have been a Tangent for many of you, d<\/span><span>on\u2019t worry it\u2019s not as complicated as it sounds. Let me explain it this way:&nbsp;<\/span><span style=\"font-size: 0.75rem; line-height: 1.25rem;\">For now,lets consider shards as carriers of data in a stream. In the previous post we spoke about the lumber jack example remember? We considered the logs of wood as data and the water stream as the Kinesis Stream.<\/span><\/p>\n<p>&nbsp;<\/p>\n<h3>[Curious about Big Data with AWS? See how the Lifecycle Works]<\/h3>\n<p>&nbsp;<\/p>\n<h3>The Highway Example to the Rescue !!<\/h3>\n<p>So now lets take Another example, this time of a highway.<span style=\"font-size: 0.75rem; line-height: 1.25rem;\">&nbsp;The highway is our Kinesis Stream and the vehicles running on it are our data.&nbsp;<\/span><span style=\"font-size: 0.75rem; line-height: 1.25rem;\">For our scenario, let us consider it to be a single lane highway(where all the vehicles are travelling in one direction). As time passes, the number of vehicles on the highway keeps increasing, eventually leading to traffic congestion and then a traffic snarl-up!!!! So what\u2019s the Solution??? Simple, increase the capacity of the road. As the road is widened,the lanes in the road increase i.e our first single laned highway is widened and made into a two lane highway. What if there\u2019s further traffic congestion?? Simple, widen the road and make it a 4 lane highway! So the lanes here represent the \u201cshards\u201d. Want to increase the capacity of the roads, just increase the number of lanes; or want to increase the capacity of the Kinesis Stream, just increase the number of shards!<\/span><\/p>\n<p>&nbsp;<\/p>\n<p><span>How do Shards make your Job a Walk in the Park?<\/span><\/p>\n<p>So now we clearly understand the meaning of the sentence \u201cShards are the scaling unit for a stream\u201d.<br \/>\n<span>Fortunately increasing the capacity of a Kinesis stream is not such a backbreaking task as building a new lane for a&nbsp; highway!! Adding shards to a Kinesis stream is just a matter of a few clicks!! ( We will be including a tutorial for a Step by Step Guide on how to Build your Own Kinesis App in our future blogs, so stay tuned!)<\/span><\/p>\n<p>Courtesy: AWS Website | Amazon Kinesis High Level Architecture<\/p>\n<p>Here are a<strong> few facts about Shards<\/strong> that will make your brain ponder:<\/p>\n<ol>\n<li>Each shard is capable of<strong> ingesting 1MB \/ sec of data<\/strong> and upto&nbsp; <strong>1000 TPS&nbsp;<\/strong>(transaction per second)<\/li>\n<li><strong>HTTP \u201cPuts\u201d<\/strong> can range from <strong>1 KB to a max of 50 KB<\/strong><\/li>\n<li>Data in a shard will be<strong> stored<\/strong> for a <strong>maximum of 24 hrs<\/strong> i.e data is available for read, re-read, backfilled, and analyzed, or moved to long-term storage within this time-frame<\/li>\n<\/ol>\n<p>This adding and removing of shards is not only easy, but can be done <em>without disturbing the running application or the stream<\/em> i.e one can reduce or increase the number of shards in \u201creal-time\u201d thus fulfilling its qualities of \u201cScalability\u201d and \u201cManageability\u201d.<\/p>\n<h3>[Reinvent Big Data with Hadoop in the Clouds!]<\/h3>\n<p>&nbsp;<\/p>\n<h3>Partition Keys &amp; Sequence Numbers- Just Like Lane Markings &amp; Number Plates!<\/h3>\n<p><span>We have almost covered everything we need to know about shards.But wait, just a tiny bit remaining about- \u201cPartition Keys\u201d&nbsp;<\/span><span>So now what are these partition keys!!?<\/span><\/p>\n<p>AWS Cloud defines them as,<\/p>\n<p>Partition Keys are like Lane Markings<\/p>\n<p>\u201cThe partition key is used to group data by shard within the stream\u201d<\/p>\n<p>So, lets get back to the highway example:<br \/>\n<span>We can map partition keys to be the <\/span><a href=\"https:\/\/en.wikipedia.org\/wiki\/Lane_markings\">lane markings<\/a><span>( those white markings) on the highway.&nbsp;<\/span><span>Its like traffic going to destination \u201cabcd\u201d will be on this lane and to \u201cefgh\u201d will be on that lane.&nbsp;<\/span><span>It helps categorize the traffic, i.e partition keys help decide,which data should go into which shard.&nbsp;<\/span><span style=\"font-size: 0.75rem; line-height: 1.25rem;\">Consider,there is data coming into the Kinesis Stream from three sources like Twitter, Facebook and some other random site. Each of these sources have their unique \u201cSource Id\u201d. Ideally we would want that data from these sources be carried in separate shards. In such situations partition keys come to the rescue. If we set the partition keys (A partition key is specified by the applications putting the data into a stream) when inserting data as the source-id, the data will be put into their respective shards automatically.<\/span><\/p>\n<p><strong>Partition keys<\/strong> are <em>Unicode strings with a maximum length limit of 256 bytes<\/em>. An<a title=\"What is that ???\" href=\"https:\/\/en.wikipedia.org\/wiki\/MD5\" target=\"_blank\" rel=\"noopener noreferrer\"> MD5 hash function <\/a>is used to map partition keys to 128-bit integer values and to map associated data records to shards.<\/p>\n<p>Along,with partition keys, there is something called as the <strong>sequence number<\/strong>. Like every vehicle on the road is uniquely identified by its registration number,every <em>data<\/em>( blob of data through a single \u201cput\u201d call ) is identified through its sequence number.<\/p>\n<p>Well there, now you know what Shards are! stay tuned for our Next Blog where we discuss <strong>How to Set up your own Kinesis Application in Detail !<br \/>\n<\/strong>Don\u2019t miss it, or any of our other post! Subscribe to our Blogs.<\/p>\n","protected":false},"excerpt":{"rendered":"<p>Source: Screenshot from Official AWS Kinesis video In my&nbsp;last post, we captured an overview of what Kinesis does and what it is capable of doing. In this post we will dive a bit deeper into the technical building Blocks of Kinesis. Yes you will still understand this Blog even if you\u2019re not a Web Developer, [&hellip;]<\/p>\n","protected":false},"author":192,"featured_media":15784,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"_acf_changed":false,"footnotes":""},"categories":[1407],"tags":[2770,3657,3658,3659],"class_list":["post-30119","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry","category-big-data-on-aws-india","tag-aws-kinesis-india","tag-aws-kinesis-big-data-solution-india","tag-aws-kinesis-what-are-shards-india","tag-what-are-shards-in-aws-kinesis-india"],"acf":[],"yoast_head":"<!-- This site is optimized with the Yoast SEO plugin v25.5 - https:\/\/yoast.com\/wordpress\/plugins\/seo\/ -->\n<title>Manoeuvering Through the Big Data Highway (Shards) with Amazon Kinesis - Blazeclan<\/title>\n<meta name=\"description\" content=\"In this post we will dive a bit deeper into the technical building Blocks of Kinesis. Yes you will still understand this Blog even if you&#039;re not a Web Developer, Just to clear your Doubts!\" \/>\n<meta name=\"robots\" content=\"index, follow, max-snippet:-1, max-image-preview:large, max-video-preview:-1\" \/>\n<link rel=\"canonical\" href=\"https:\/\/blazeclan.com\/india\/blog\/manoeuvering-data-highway-shards-amazon-kinesis\/\" \/>\n<meta property=\"og:locale\" content=\"en_US\" \/>\n<meta property=\"og:type\" content=\"article\" \/>\n<meta property=\"og:title\" content=\"Manoeuvering Through the Big Data Highway (Shards) with Amazon Kinesis - Blazeclan\" \/>\n<meta property=\"og:description\" content=\"In this post we will dive a bit deeper into the technical building Blocks of Kinesis. Yes you will still understand this Blog even if you&#039;re not a Web Developer, Just to clear your Doubts!\" \/>\n<meta property=\"og:url\" content=\"https:\/\/blazeclan.com\/blog\/manoeuvering-data-highway-shards-amazon-kinesis\/\" \/>\n<meta property=\"og:site_name\" content=\"Blazeclan\" \/>\n<meta property=\"article:publisher\" content=\"https:\/\/www.facebook.com\/blazeclan.hq\/\" \/>\n<meta property=\"article:published_time\" content=\"2022-11-25T12:51:31+00:00\" \/>\n<meta property=\"article:modified_time\" content=\"2023-03-11T10:16:04+00:00\" \/>\n<meta property=\"og:image\" content=\"https:\/\/blazeclan.com\/wp-content\/uploads\/2014\/01\/Manoeuvering-Through-the-Big-Data-Highway-Shards-with-Amazon-Kinesis-3.png\" \/>\n\t<meta property=\"og:image:width\" content=\"1650\" \/>\n\t<meta property=\"og:image:height\" content=\"680\" \/>\n\t<meta property=\"og:image:type\" content=\"image\/png\" \/>\n<meta name=\"author\" content=\"Team Blazeclan\" \/>\n<meta name=\"twitter:card\" content=\"summary_large_image\" \/>\n<meta name=\"twitter:creator\" content=\"@blazeclan_hq\" \/>\n<meta name=\"twitter:site\" content=\"@blazeclan_hq\" \/>\n<meta name=\"twitter:label1\" content=\"Written by\" \/>\n\t<meta name=\"twitter:data1\" content=\"Team Blazeclan\" \/>\n\t<meta name=\"twitter:label2\" content=\"Est. reading time\" \/>\n\t<meta name=\"twitter:data2\" content=\"5 minutes\" \/>\n<script type=\"application\/ld+json\" class=\"yoast-schema-graph\">{\"@context\":\"https:\/\/schema.org\",\"@graph\":[{\"@type\":\"Article\",\"@id\":\"https:\/\/blazeclan.com\/blog\/manoeuvering-data-highway-shards-amazon-kinesis\/#article\",\"isPartOf\":{\"@id\":\"https:\/\/blazeclan.com\/india\/blog\/manoeuvering-data-highway-shards-amazon-kinesis\/\"},\"author\":{\"name\":\"Team Blazeclan\",\"@id\":\"https:\/\/blazeclan.com\/india\/#\/schema\/person\/779910eccddff4a1ea6663b6bfb271e8\"},\"headline\":\"Manoeuvering Through the Big Data Highway (Shards) with Amazon Kinesis\",\"datePublished\":\"2022-11-25T12:51:31+00:00\",\"dateModified\":\"2023-03-11T10:16:04+00:00\",\"mainEntityOfPage\":{\"@id\":\"https:\/\/blazeclan.com\/india\/blog\/manoeuvering-data-highway-shards-amazon-kinesis\/\"},\"wordCount\":1017,\"commentCount\":0,\"publisher\":{\"@id\":\"https:\/\/blazeclan.com\/india\/#organization\"},\"image\":{\"@id\":\"https:\/\/blazeclan.com\/blog\/manoeuvering-data-highway-shards-amazon-kinesis\/#primaryimage\"},\"thumbnailUrl\":\"https:\/\/blazeclan.com\/wp-content\/uploads\/2014\/01\/Manoeuvering-Through-the-Big-Data-Highway-Shards-with-Amazon-Kinesis-3.png\",\"keywords\":[\"AWS Kinesis\",\"AWS Kinesis Big Data Solution\",\"AWS kInesis What are Shards?\",\"What are Shards in AWS Kinesis\"],\"articleSection\":[\"Big Data on AWS\"],\"inLanguage\":\"en-IN\",\"potentialAction\":[{\"@type\":\"CommentAction\",\"name\":\"Comment\",\"target\":[\"https:\/\/blazeclan.com\/blog\/manoeuvering-data-highway-shards-amazon-kinesis\/#respond\"]}]},{\"@type\":\"WebPage\",\"@id\":\"https:\/\/blazeclan.com\/india\/blog\/manoeuvering-data-highway-shards-amazon-kinesis\/\",\"url\":\"https:\/\/blazeclan.com\/blog\/manoeuvering-data-highway-shards-amazon-kinesis\/\",\"name\":\"Manoeuvering Through the Big Data Highway (Shards) with Amazon Kinesis - Blazeclan\",\"isPartOf\":{\"@id\":\"https:\/\/blazeclan.com\/india\/#website\"},\"primaryImageOfPage\":{\"@id\":\"https:\/\/blazeclan.com\/blog\/manoeuvering-data-highway-shards-amazon-kinesis\/#primaryimage\"},\"image\":{\"@id\":\"https:\/\/blazeclan.com\/blog\/manoeuvering-data-highway-shards-amazon-kinesis\/#primaryimage\"},\"thumbnailUrl\":\"https:\/\/blazeclan.com\/wp-content\/uploads\/2014\/01\/Manoeuvering-Through-the-Big-Data-Highway-Shards-with-Amazon-Kinesis-3.png\",\"datePublished\":\"2022-11-25T12:51:31+00:00\",\"dateModified\":\"2023-03-11T10:16:04+00:00\",\"description\":\"In this post we will dive a bit deeper into the technical building Blocks of Kinesis. Yes you will still understand this Blog even if you're not a Web Developer, Just to clear your Doubts!\",\"breadcrumb\":{\"@id\":\"https:\/\/blazeclan.com\/blog\/manoeuvering-data-highway-shards-amazon-kinesis\/#breadcrumb\"},\"inLanguage\":\"en-IN\",\"potentialAction\":[{\"@type\":\"ReadAction\",\"target\":[\"https:\/\/blazeclan.com\/blog\/manoeuvering-data-highway-shards-amazon-kinesis\/\"]}]},{\"@type\":\"ImageObject\",\"inLanguage\":\"en-IN\",\"@id\":\"https:\/\/blazeclan.com\/blog\/manoeuvering-data-highway-shards-amazon-kinesis\/#primaryimage\",\"url\":\"https:\/\/blazeclan.com\/wp-content\/uploads\/2014\/01\/Manoeuvering-Through-the-Big-Data-Highway-Shards-with-Amazon-Kinesis-3.png\",\"contentUrl\":\"https:\/\/blazeclan.com\/wp-content\/uploads\/2014\/01\/Manoeuvering-Through-the-Big-Data-Highway-Shards-with-Amazon-Kinesis-3.png\",\"width\":1650,\"height\":680},{\"@type\":\"BreadcrumbList\",\"@id\":\"https:\/\/blazeclan.com\/blog\/manoeuvering-data-highway-shards-amazon-kinesis\/#breadcrumb\",\"itemListElement\":[{\"@type\":\"ListItem\",\"position\":1,\"name\":\"Home\",\"item\":\"https:\/\/blazeclan.com\/india\/\"},{\"@type\":\"ListItem\",\"position\":2,\"name\":\"Manoeuvering Through the Big Data Highway (Shards) with Amazon Kinesis\"}]},{\"@type\":\"WebSite\",\"@id\":\"https:\/\/blazeclan.com\/india\/#website\",\"url\":\"https:\/\/blazeclan.com\/india\/\",\"name\":\"Blazeclan\",\"description\":\"\",\"publisher\":{\"@id\":\"https:\/\/blazeclan.com\/india\/#organization\"},\"potentialAction\":[{\"@type\":\"SearchAction\",\"target\":{\"@type\":\"EntryPoint\",\"urlTemplate\":\"https:\/\/blazeclan.com\/india\/?s={search_term_string}\"},\"query-input\":{\"@type\":\"PropertyValueSpecification\",\"valueRequired\":true,\"valueName\":\"search_term_string\"}}],\"inLanguage\":\"en-IN\"},{\"@type\":\"Organization\",\"@id\":\"https:\/\/blazeclan.com\/india\/#organization\",\"name\":\"Blazeclan\",\"url\":\"https:\/\/blazeclan.com\/india\/\",\"logo\":{\"@type\":\"ImageObject\",\"inLanguage\":\"en-IN\",\"@id\":\"https:\/\/blazeclan.com\/india\/#\/schema\/logo\/image\/\",\"url\":\"https:\/\/blazeclan.com\/wp-content\/uploads\/2024\/10\/ITCI-Blazeclan_logo.svg\",\"contentUrl\":\"https:\/\/blazeclan.com\/wp-content\/uploads\/2024\/10\/ITCI-Blazeclan_logo.svg\",\"caption\":\"Blazeclan\"},\"image\":{\"@id\":\"https:\/\/blazeclan.com\/india\/#\/schema\/logo\/image\/\"},\"sameAs\":[\"https:\/\/www.facebook.com\/blazeclan.hq\/\",\"https:\/\/x.com\/blazeclan_hq\",\"https:\/\/www.instagram.com\/blazeclantechnologies\/\",\"https:\/\/www.linkedin.com\/company\/blazeclan-technologies\/\",\"https:\/\/www.youtube.com\/channel\/UCCKF4Lcbtus-pUoZr7Lxrow\"]},{\"@type\":\"Person\",\"@id\":\"https:\/\/blazeclan.com\/india\/#\/schema\/person\/779910eccddff4a1ea6663b6bfb271e8\",\"name\":\"Team Blazeclan\",\"image\":{\"@type\":\"ImageObject\",\"inLanguage\":\"en-IN\",\"@id\":\"https:\/\/blazeclan.com\/india\/#\/schema\/person\/image\/\",\"url\":\"https:\/\/secure.gravatar.com\/avatar\/a43c1fa01bb3c7e839254c9084bf11ed422d7e633231f9e935096045af416ba2?s=96&d=mm&r=g\",\"contentUrl\":\"https:\/\/secure.gravatar.com\/avatar\/a43c1fa01bb3c7e839254c9084bf11ed422d7e633231f9e935096045af416ba2?s=96&d=mm&r=g\",\"caption\":\"Team Blazeclan\"},\"sameAs\":[\"http:\/\/localhost\/ps-local-wp\"]}]}<\/script>\n<!-- \/ Yoast SEO plugin. -->","yoast_head_json":{"title":"Manoeuvering Through the Big Data Highway (Shards) with Amazon Kinesis - Blazeclan","description":"In this post we will dive a bit deeper into the technical building Blocks of Kinesis. Yes you will still understand this Blog even if you're not a Web Developer, Just to clear your Doubts!","robots":{"index":"index","follow":"follow","max-snippet":"max-snippet:-1","max-image-preview":"max-image-preview:large","max-video-preview":"max-video-preview:-1"},"canonical":"https:\/\/blazeclan.com\/india\/blog\/manoeuvering-data-highway-shards-amazon-kinesis\/","og_locale":"en_US","og_type":"article","og_title":"Manoeuvering Through the Big Data Highway (Shards) with Amazon Kinesis - Blazeclan","og_description":"In this post we will dive a bit deeper into the technical building Blocks of Kinesis. Yes you will still understand this Blog even if you're not a Web Developer, Just to clear your Doubts!","og_url":"https:\/\/blazeclan.com\/blog\/manoeuvering-data-highway-shards-amazon-kinesis\/","og_site_name":"Blazeclan","article_publisher":"https:\/\/www.facebook.com\/blazeclan.hq\/","article_published_time":"2022-11-25T12:51:31+00:00","article_modified_time":"2023-03-11T10:16:04+00:00","og_image":[{"width":1650,"height":680,"url":"https:\/\/blazeclan.com\/wp-content\/uploads\/2014\/01\/Manoeuvering-Through-the-Big-Data-Highway-Shards-with-Amazon-Kinesis-3.png","type":"image\/png"}],"author":"Team Blazeclan","twitter_card":"summary_large_image","twitter_creator":"@blazeclan_hq","twitter_site":"@blazeclan_hq","twitter_misc":{"Written by":"Team Blazeclan","Est. reading time":"5 minutes"},"schema":{"@context":"https:\/\/schema.org","@graph":[{"@type":"Article","@id":"https:\/\/blazeclan.com\/blog\/manoeuvering-data-highway-shards-amazon-kinesis\/#article","isPartOf":{"@id":"https:\/\/blazeclan.com\/india\/blog\/manoeuvering-data-highway-shards-amazon-kinesis\/"},"author":{"name":"Team Blazeclan","@id":"https:\/\/blazeclan.com\/india\/#\/schema\/person\/779910eccddff4a1ea6663b6bfb271e8"},"headline":"Manoeuvering Through the Big Data Highway (Shards) with Amazon Kinesis","datePublished":"2022-11-25T12:51:31+00:00","dateModified":"2023-03-11T10:16:04+00:00","mainEntityOfPage":{"@id":"https:\/\/blazeclan.com\/india\/blog\/manoeuvering-data-highway-shards-amazon-kinesis\/"},"wordCount":1017,"commentCount":0,"publisher":{"@id":"https:\/\/blazeclan.com\/india\/#organization"},"image":{"@id":"https:\/\/blazeclan.com\/blog\/manoeuvering-data-highway-shards-amazon-kinesis\/#primaryimage"},"thumbnailUrl":"https:\/\/blazeclan.com\/wp-content\/uploads\/2014\/01\/Manoeuvering-Through-the-Big-Data-Highway-Shards-with-Amazon-Kinesis-3.png","keywords":["AWS Kinesis","AWS Kinesis Big Data Solution","AWS kInesis What are Shards?","What are Shards in AWS Kinesis"],"articleSection":["Big Data on AWS"],"inLanguage":"en-IN","potentialAction":[{"@type":"CommentAction","name":"Comment","target":["https:\/\/blazeclan.com\/blog\/manoeuvering-data-highway-shards-amazon-kinesis\/#respond"]}]},{"@type":"WebPage","@id":"https:\/\/blazeclan.com\/india\/blog\/manoeuvering-data-highway-shards-amazon-kinesis\/","url":"https:\/\/blazeclan.com\/blog\/manoeuvering-data-highway-shards-amazon-kinesis\/","name":"Manoeuvering Through the Big Data Highway (Shards) with Amazon Kinesis - Blazeclan","isPartOf":{"@id":"https:\/\/blazeclan.com\/india\/#website"},"primaryImageOfPage":{"@id":"https:\/\/blazeclan.com\/blog\/manoeuvering-data-highway-shards-amazon-kinesis\/#primaryimage"},"image":{"@id":"https:\/\/blazeclan.com\/blog\/manoeuvering-data-highway-shards-amazon-kinesis\/#primaryimage"},"thumbnailUrl":"https:\/\/blazeclan.com\/wp-content\/uploads\/2014\/01\/Manoeuvering-Through-the-Big-Data-Highway-Shards-with-Amazon-Kinesis-3.png","datePublished":"2022-11-25T12:51:31+00:00","dateModified":"2023-03-11T10:16:04+00:00","description":"In this post we will dive a bit deeper into the technical building Blocks of Kinesis. Yes you will still understand this Blog even if you're not a Web Developer, Just to clear your Doubts!","breadcrumb":{"@id":"https:\/\/blazeclan.com\/blog\/manoeuvering-data-highway-shards-amazon-kinesis\/#breadcrumb"},"inLanguage":"en-IN","potentialAction":[{"@type":"ReadAction","target":["https:\/\/blazeclan.com\/blog\/manoeuvering-data-highway-shards-amazon-kinesis\/"]}]},{"@type":"ImageObject","inLanguage":"en-IN","@id":"https:\/\/blazeclan.com\/blog\/manoeuvering-data-highway-shards-amazon-kinesis\/#primaryimage","url":"https:\/\/blazeclan.com\/wp-content\/uploads\/2014\/01\/Manoeuvering-Through-the-Big-Data-Highway-Shards-with-Amazon-Kinesis-3.png","contentUrl":"https:\/\/blazeclan.com\/wp-content\/uploads\/2014\/01\/Manoeuvering-Through-the-Big-Data-Highway-Shards-with-Amazon-Kinesis-3.png","width":1650,"height":680},{"@type":"BreadcrumbList","@id":"https:\/\/blazeclan.com\/blog\/manoeuvering-data-highway-shards-amazon-kinesis\/#breadcrumb","itemListElement":[{"@type":"ListItem","position":1,"name":"Home","item":"https:\/\/blazeclan.com\/india\/"},{"@type":"ListItem","position":2,"name":"Manoeuvering Through the Big Data Highway (Shards) with Amazon Kinesis"}]},{"@type":"WebSite","@id":"https:\/\/blazeclan.com\/india\/#website","url":"https:\/\/blazeclan.com\/india\/","name":"Blazeclan","description":"","publisher":{"@id":"https:\/\/blazeclan.com\/india\/#organization"},"potentialAction":[{"@type":"SearchAction","target":{"@type":"EntryPoint","urlTemplate":"https:\/\/blazeclan.com\/india\/?s={search_term_string}"},"query-input":{"@type":"PropertyValueSpecification","valueRequired":true,"valueName":"search_term_string"}}],"inLanguage":"en-IN"},{"@type":"Organization","@id":"https:\/\/blazeclan.com\/india\/#organization","name":"Blazeclan","url":"https:\/\/blazeclan.com\/india\/","logo":{"@type":"ImageObject","inLanguage":"en-IN","@id":"https:\/\/blazeclan.com\/india\/#\/schema\/logo\/image\/","url":"https:\/\/blazeclan.com\/wp-content\/uploads\/2024\/10\/ITCI-Blazeclan_logo.svg","contentUrl":"https:\/\/blazeclan.com\/wp-content\/uploads\/2024\/10\/ITCI-Blazeclan_logo.svg","caption":"Blazeclan"},"image":{"@id":"https:\/\/blazeclan.com\/india\/#\/schema\/logo\/image\/"},"sameAs":["https:\/\/www.facebook.com\/blazeclan.hq\/","https:\/\/x.com\/blazeclan_hq","https:\/\/www.instagram.com\/blazeclantechnologies\/","https:\/\/www.linkedin.com\/company\/blazeclan-technologies\/","https:\/\/www.youtube.com\/channel\/UCCKF4Lcbtus-pUoZr7Lxrow"]},{"@type":"Person","@id":"https:\/\/blazeclan.com\/india\/#\/schema\/person\/779910eccddff4a1ea6663b6bfb271e8","name":"Team Blazeclan","image":{"@type":"ImageObject","inLanguage":"en-IN","@id":"https:\/\/blazeclan.com\/india\/#\/schema\/person\/image\/","url":"https:\/\/secure.gravatar.com\/avatar\/a43c1fa01bb3c7e839254c9084bf11ed422d7e633231f9e935096045af416ba2?s=96&d=mm&r=g","contentUrl":"https:\/\/secure.gravatar.com\/avatar\/a43c1fa01bb3c7e839254c9084bf11ed422d7e633231f9e935096045af416ba2?s=96&d=mm&r=g","caption":"Team Blazeclan"},"sameAs":["http:\/\/localhost\/ps-local-wp"]}]}},"_links":{"self":[{"href":"https:\/\/blazeclan.com\/india\/wp-json\/wp\/v2\/posts\/30119","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/blazeclan.com\/india\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/blazeclan.com\/india\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/blazeclan.com\/india\/wp-json\/wp\/v2\/users\/192"}],"replies":[{"embeddable":true,"href":"https:\/\/blazeclan.com\/india\/wp-json\/wp\/v2\/comments?post=30119"}],"version-history":[{"count":0,"href":"https:\/\/blazeclan.com\/india\/wp-json\/wp\/v2\/posts\/30119\/revisions"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/blazeclan.com\/india\/wp-json\/wp\/v2\/media\/15784"}],"wp:attachment":[{"href":"https:\/\/blazeclan.com\/india\/wp-json\/wp\/v2\/media?parent=30119"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/blazeclan.com\/india\/wp-json\/wp\/v2\/categories?post=30119"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/blazeclan.com\/india\/wp-json\/wp\/v2\/tags?post=30119"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}