{"id":2221,"date":"2019-08-09T09:00:35","date_gmt":"2019-08-09T07:00:35","guid":{"rendered":"https:\/\/voxxeddays.com\/microservices\/?p=2221"},"modified":"2019-08-05T17:47:07","modified_gmt":"2019-08-05T15:47:07","slug":"robin-moffatt-on-from-zero-to-hero-with-kafka-connect","status":"publish","type":"post","link":"https:\/\/voxxeddays.com\/microservices\/2019\/08\/09\/robin-moffatt-on-from-zero-to-hero-with-kafka-connect\/","title":{"rendered":"Robin Moffatt on \u201cFrom Zero to Hero with Kafka Connect\u201d"},"content":{"rendered":"<p><b>Hi Robin, tell us who you are and what lead you into microservices?<\/b><\/p>\n<p><span style=\"font-weight: 400\">I\u2019m a Developer Advocate at Confluent, who are one of the companies that contribute to the open source Apache Kafka project. I got interested in Kafka and microservices from a background in data and analytics. I think being able to model, store, and process data as a stream of events is really powerful and it\u2019s exciting to have the opportunity to share this with the Voxxed crowd.<\/span><\/p>\n<p>&nbsp;<\/p>\n<p><b>What will you be talking about at Voxxed Days Microservices?\u00a0<\/b><\/p>\n<p><span style=\"font-weight: 400\">I\u2019ll be talking about a really important part of Kafka, called Kafka Connect. It gives developers the ability to do streaming integration between systems both in and out of Kafka. It\u2019s just JSON configuration to use, no code, and handles all the tricky stuff for you like scale-out, restarts, fail-over, schemas, and more.<\/span><\/p>\n<p><b>Kafka Connect is about streaming data between Kafka and other systems. How would you use Kafka Connect in a Microservice architecture ? Would it make sense to have it between Microservices ?<\/b><\/p>\n<p><span style=\"font-weight: 400\">Absolutely you would use it in a microservices architecture. For example, you may have a service that is driven by events in an application elsewhere that are peristed to a database. Kafka Connect can stream all the events from a database into a Kafka topic with very low latency. Kafka Connect is also a great fit where you have services generating data that you want to stream elsewhere, such as into Elasticsearch, MongoDB, etc.\u00a0<\/span><\/p>\n<p>&nbsp;<\/p>\n<p><b>Good, see you soon then\u00a0<\/b><\/p>\n<p><span style=\"font-weight: 400\">I\u2019m looking forward to it!<\/span><\/p>\n<p>&nbsp;<\/p>\n<p><span style=\"font-weight: 400\">@apachekafka (does this count as a hashtag? \ud83d\ude42\u00a0<\/span><\/p>\n<p><span style=\"font-weight: 400\">#apachekafka #streaming <\/span><span style=\"font-weight: 400\">#integration <\/span><span style=\"font-weight: 400\">#events<\/span><\/p>\n<p>&nbsp;<\/p>\n<p><b>My contact information <\/b><\/p>\n<p><span style=\"font-weight: 400\">Twitter: @rmoff<\/span><\/p>\n<p><span style=\"font-weight: 400\">Blog: https:\/\/rmoff.net<\/span><\/p>\n<p><span style=\"font-weight: 400\">LinkedIn: https:\/\/www.linkedin.com\/in\/robinmoffatt\/<\/span><\/p>\n<p><span style=\"font-weight: 400\">GitHub: https:\/\/github.com\/rmoff\/<\/span><\/p>\n<p>&nbsp;<\/p>\n","protected":false},"excerpt":{"rendered":"<p>Hi Robin, tell us who you are and what lead you into microservices? I\u2019m a Developer Advocate at Confluent, who are one of the companies that contribute to the open source Apache Kafka project. I got interested in Kafka and microservices from a background in data and analytics. I think being able to model, store, [&hellip;]<\/p>\n","protected":false},"author":1301,"featured_media":2222,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":[],"categories":[12],"tags":[14,30,956,955],"acf":[],"yoast_head":"<!-- This site is optimized with the Yoast SEO plugin v15.3 - https:\/\/yoast.com\/wordpress\/plugins\/seo\/ -->\n<title>Robin Moffatt on \u201cFrom Zero to Hero with Kafka Connect\u201d : Voxxed Days Microservices 2019<\/title>\n<meta name=\"robots\" content=\"index, follow, max-snippet:-1, max-image-preview:large, max-video-preview:-1\" \/>\n<link rel=\"canonical\" href=\"https:\/\/voxxeddays.com\/microservices\/2019\/08\/09\/robin-moffatt-on-from-zero-to-hero-with-kafka-connect\/\" \/>\n<meta property=\"og:locale\" content=\"en_US\" \/>\n<meta property=\"og:type\" content=\"article\" \/>\n<meta property=\"og:title\" content=\"Robin Moffatt on \u201cFrom Zero to Hero with Kafka Connect\u201d : Voxxed Days Microservices 2019\" \/>\n<meta property=\"og:description\" content=\"Hi Robin, tell us who you are and what lead you into microservices? I\u2019m a Developer Advocate at Confluent, who are one of the companies that contribute to the open source Apache Kafka project. I got interested in Kafka and microservices from a background in data and analytics. I think being able to model, store, [&hellip;]\" \/>\n<meta property=\"og:url\" content=\"https:\/\/voxxeddays.com\/microservices\/2019\/08\/09\/robin-moffatt-on-from-zero-to-hero-with-kafka-connect\/\" \/>\n<meta property=\"og:site_name\" content=\"Voxxed Days Microservices 2019\" \/>\n<meta property=\"article:publisher\" content=\"https:\/\/www.facebook.com\/vxdmicroservice\/\" \/>\n<meta property=\"article:published_time\" content=\"2019-08-09T07:00:35+00:00\" \/>\n<meta property=\"article:modified_time\" content=\"2019-08-05T15:47:07+00:00\" \/>\n<meta property=\"og:image\" content=\"https:\/\/voxxeddays.com\/microservices\/wp-content\/uploads\/sites\/54\/2019\/08\/Bannie\u0300re-Robin-Moffatt_Plan-de-travail-1.png\" \/>\n\t<meta property=\"og:image:width\" content=\"2134\" \/>\n\t<meta property=\"og:image:height\" content=\"1067\" \/>\n<meta property=\"fb:app_id\" content=\"vxdmicroservice\" \/>\n<meta name=\"twitter:card\" content=\"summary_large_image\" \/>\n<meta name=\"twitter:creator\" content=\"@agoncal\" \/>\n<meta name=\"twitter:site\" content=\"@vxdmicroservice\" \/>\n<meta name=\"twitter:label1\" content=\"Written by\">\n\t<meta name=\"twitter:data1\" content=\"Antonio Goncalves\">\n\t<meta name=\"twitter:label2\" content=\"Est. reading time\">\n\t<meta name=\"twitter:data2\" content=\"1 minute\">\n<script type=\"application\/ld+json\" class=\"yoast-schema-graph\">{\"@context\":\"https:\/\/schema.org\",\"@graph\":[{\"@type\":\"Organization\",\"@id\":\"https:\/\/voxxeddays.com\/microservices\/#organization\",\"name\":\"Voxxed Days Microservices\",\"url\":\"https:\/\/voxxeddays.com\/microservices\/\",\"sameAs\":[\"https:\/\/www.facebook.com\/vxdmicroservice\/\",\"https:\/\/www.instagram.com\/voxxeddaysmicroservices\",\"https:\/\/www.linkedin.com\/in\/voxxed-days-microservices-906115164\/\",\"https:\/\/www.youtube.com\/playlist?list=PLRsbF2sD7JVrhlYIKTI--IU6xcfUjdNt2\",\"https:\/\/twitter.com\/vxdmicroservice\"],\"logo\":{\"@type\":\"ImageObject\",\"@id\":\"https:\/\/voxxeddays.com\/microservices\/#logo\",\"inLanguage\":\"en-US\",\"url\":\"https:\/\/voxxeddays.com\/microservices\/wp-content\/uploads\/sites\/54\/2019\/06\/large-Voxxed_Days_Microservices_date_2019-01-2.png\",\"width\":1000,\"height\":387,\"caption\":\"Voxxed Days Microservices\"},\"image\":{\"@id\":\"https:\/\/voxxeddays.com\/microservices\/#logo\"}},{\"@type\":\"WebSite\",\"@id\":\"https:\/\/voxxeddays.com\/microservices\/#website\",\"url\":\"https:\/\/voxxeddays.com\/microservices\/\",\"name\":\"Voxxed Days Microservices 2019, Conference & workshops\",\"description\":\"A Developer Conference on Microservices\",\"publisher\":{\"@id\":\"https:\/\/voxxeddays.com\/microservices\/#organization\"},\"potentialAction\":[{\"@type\":\"SearchAction\",\"target\":\"https:\/\/voxxeddays.com\/microservices\/?s={search_term_string}\",\"query-input\":\"required name=search_term_string\"}],\"inLanguage\":\"en-US\"},{\"@type\":\"ImageObject\",\"@id\":\"https:\/\/voxxeddays.com\/microservices\/2019\/08\/09\/robin-moffatt-on-from-zero-to-hero-with-kafka-connect\/#primaryimage\",\"inLanguage\":\"en-US\",\"url\":\"https:\/\/voxxeddays.com\/microservices\/wp-content\/uploads\/sites\/54\/2019\/08\/Bannie\\u0300re-Robin-Moffatt_Plan-de-travail-1.png\",\"width\":2134,\"height\":1067,\"caption\":\"Robin Moffatt\"},{\"@type\":\"WebPage\",\"@id\":\"https:\/\/voxxeddays.com\/microservices\/2019\/08\/09\/robin-moffatt-on-from-zero-to-hero-with-kafka-connect\/#webpage\",\"url\":\"https:\/\/voxxeddays.com\/microservices\/2019\/08\/09\/robin-moffatt-on-from-zero-to-hero-with-kafka-connect\/\",\"name\":\"Robin Moffatt on \\u201cFrom Zero to Hero with Kafka Connect\\u201d : Voxxed Days Microservices 2019\",\"isPartOf\":{\"@id\":\"https:\/\/voxxeddays.com\/microservices\/#website\"},\"primaryImageOfPage\":{\"@id\":\"https:\/\/voxxeddays.com\/microservices\/2019\/08\/09\/robin-moffatt-on-from-zero-to-hero-with-kafka-connect\/#primaryimage\"},\"datePublished\":\"2019-08-09T07:00:35+00:00\",\"dateModified\":\"2019-08-05T15:47:07+00:00\",\"inLanguage\":\"en-US\",\"potentialAction\":[{\"@type\":\"ReadAction\",\"target\":[\"https:\/\/voxxeddays.com\/microservices\/2019\/08\/09\/robin-moffatt-on-from-zero-to-hero-with-kafka-connect\/\"]}]},{\"@type\":\"Article\",\"@id\":\"https:\/\/voxxeddays.com\/microservices\/2019\/08\/09\/robin-moffatt-on-from-zero-to-hero-with-kafka-connect\/#article\",\"isPartOf\":{\"@id\":\"https:\/\/voxxeddays.com\/microservices\/2019\/08\/09\/robin-moffatt-on-from-zero-to-hero-with-kafka-connect\/#webpage\"},\"author\":{\"@id\":\"https:\/\/voxxeddays.com\/microservices\/#\/schema\/person\/871a4bfea3b1bf117a77bc3fbfeb5f14\"},\"headline\":\"Robin Moffatt on \\u201cFrom Zero to Hero with Kafka Connect\\u201d\",\"datePublished\":\"2019-08-09T07:00:35+00:00\",\"dateModified\":\"2019-08-05T15:47:07+00:00\",\"mainEntityOfPage\":{\"@id\":\"https:\/\/voxxeddays.com\/microservices\/2019\/08\/09\/robin-moffatt-on-from-zero-to-hero-with-kafka-connect\/#webpage\"},\"publisher\":{\"@id\":\"https:\/\/voxxeddays.com\/microservices\/#organization\"},\"image\":{\"@id\":\"https:\/\/voxxeddays.com\/microservices\/2019\/08\/09\/robin-moffatt-on-from-zero-to-hero-with-kafka-connect\/#primaryimage\"},\"keywords\":\"ApacheKafka,events,integration,streaming\",\"articleSection\":\"all\",\"inLanguage\":\"en-US\"},{\"@type\":\"Person\",\"@id\":\"https:\/\/voxxeddays.com\/microservices\/#\/schema\/person\/871a4bfea3b1bf117a77bc3fbfeb5f14\",\"name\":\"Antonio Goncalves\",\"image\":{\"@type\":\"ImageObject\",\"@id\":\"https:\/\/voxxeddays.com\/microservices\/#personlogo\",\"inLanguage\":\"en-US\",\"url\":\"https:\/\/secure.gravatar.com\/avatar\/1fc6aa04011b2f0f9721df913b0fd415?s=96&d=mm&r=g\",\"caption\":\"Antonio Goncalves\"},\"description\":\"I am a senior software architect living in Paris. I work as a consultant in helping customers to set up their software architecture. My specialities are Java \/ Java EE and Open Source frameworks that evolve around it. As a former BEA consultant I have a great expertise in application servers (Weblogic, JBoss and GlassFish). So I decided to write a few books about it, create the Paris JUG and Devoxx France.\",\"sameAs\":[\"https:\/\/plus.google.com\/101641663893160877351\",\"https:\/\/twitter.com\/agoncal\"]}]}<\/script>\n<!-- \/ Yoast SEO plugin. -->","_links":{"self":[{"href":"https:\/\/voxxeddays.com\/microservices\/wp-json\/wp\/v2\/posts\/2221"}],"collection":[{"href":"https:\/\/voxxeddays.com\/microservices\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/voxxeddays.com\/microservices\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/voxxeddays.com\/microservices\/wp-json\/wp\/v2\/users\/1301"}],"replies":[{"embeddable":true,"href":"https:\/\/voxxeddays.com\/microservices\/wp-json\/wp\/v2\/comments?post=2221"}],"version-history":[{"count":0,"href":"https:\/\/voxxeddays.com\/microservices\/wp-json\/wp\/v2\/posts\/2221\/revisions"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/voxxeddays.com\/microservices\/wp-json\/wp\/v2\/media\/2222"}],"wp:attachment":[{"href":"https:\/\/voxxeddays.com\/microservices\/wp-json\/wp\/v2\/media?parent=2221"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/voxxeddays.com\/microservices\/wp-json\/wp\/v2\/categories?post=2221"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/voxxeddays.com\/microservices\/wp-json\/wp\/v2\/tags?post=2221"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}