{"id":2435,"date":"2016-02-11T15:58:47","date_gmt":"2016-02-11T13:58:47","guid":{"rendered":"https:\/\/voxxeddays.com\/bucharest\/?p=2435"},"modified":"2016-03-11T01:37:29","modified_gmt":"2016-03-10T23:37:29","slug":"process-your-big-data-in-a-blink-using-spark","status":"publish","type":"post","link":"https:\/\/voxxeddays.com\/greece\/2016\/02\/11\/process-your-big-data-in-a-blink-using-spark\/","title":{"rendered":"Process your big data in a blink using Spark"},"content":{"rendered":"

\"dan-serban\"<\/p>\n

\n

Dan Serban<\/a>\u00a0is a data engineer who occasionally teaches advanced functional programming as well as data engineering (using Spark as the big data framework).<\/span><\/p>\n<\/blockquote>\n

This 2-hour, intensely hands-on workshop introduces Apache Spark, the open-source cluster computing framework with in-memory processing that makes analytics applications up to 100 times faster compared to technologies in wide deployment today. Highly versatile in many environments, and with a strong foundation in functional programming, Spark is known for its ease of use in creating exploratory code that scales up to production-grade quality relatively quickly (REPL driven development).<\/span><\/p>\n

The plan is to start with a few publicly available datasets and gradually work our way through them until we harness some useful insights, gaining a deep understanding of Spark’s rich collections API in the process.<\/span><\/p>\n

Time permitting, we are going to look at a very simple Spark Streaming example (stream of integers \/ moving average).<\/span><\/p>\n

During the workshop, participants are encouraged to exchange with one\u00a0<\/span>another URLs and snippets of code via the issues section of this\u00a0<\/span>GitHub repository ( https:\/\/github.com\/dserban\/SparkVoxxed<\/span><\/a> ).<\/span><\/p>\n","protected":false},"excerpt":{"rendered":"

Dan Serban\u00a0is a data engineer who occasionally teaches advanced functional programming as well as data engineering (using Spark as the big data framework). This 2-hour, intensely hands-on workshop introduces Apache Spark, the open-source cluster computing framework with in-memory processing that makes analytics applications up to 100 times faster compared to technologies in wide deployment today. […]<\/p>\n","protected":false},"author":7816,"featured_media":0,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":[],"categories":[1],"tags":[],"acf":[],"yoast_head":"\nProcess your big data in a blink using Spark - Voxxed Days Greece<\/title>\n<meta name=\"robots\" content=\"index, follow, max-snippet:-1, max-image-preview:large, max-video-preview:-1\" \/>\n<link rel=\"canonical\" href=\"https:\/\/voxxeddays.com\/greece\/2016\/02\/11\/process-your-big-data-in-a-blink-using-spark\/\" \/>\n<meta property=\"og:locale\" content=\"en_US\" \/>\n<meta property=\"og:type\" content=\"article\" \/>\n<meta property=\"og:title\" content=\"Process your big data in a blink using Spark - Voxxed Days Greece\" \/>\n<meta property=\"og:description\" content=\"Dan Serban\u00a0is a data engineer who occasionally teaches advanced functional programming as well as data engineering (using Spark as the big data framework). This 2-hour, intensely hands-on workshop introduces Apache Spark, the open-source cluster computing framework with in-memory processing that makes analytics applications up to 100 times faster compared to technologies in wide deployment today. […]\" \/>\n<meta property=\"og:url\" content=\"https:\/\/voxxeddays.com\/greece\/2016\/02\/11\/process-your-big-data-in-a-blink-using-spark\/\" \/>\n<meta property=\"og:site_name\" content=\"Voxxed Days Greece\" \/>\n<meta property=\"article:publisher\" content=\"https:\/\/www.facebook.com\/voxxedbucharest\/\" \/>\n<meta property=\"article:published_time\" content=\"2016-02-11T13:58:47+00:00\" \/>\n<meta property=\"article:modified_time\" content=\"2016-03-10T23:37:29+00:00\" \/>\n<meta property=\"og:image\" content=\"https:\/\/voxxeddays.com\/bucharest\/wp-content\/uploads\/sites\/19\/2016\/02\/dan-serban-e1455198941566.jpg\" \/>\n<meta name=\"twitter:card\" content=\"summary_large_image\" \/>\n<meta name=\"twitter:creator\" content=\"@VoxxedBucharest\" \/>\n<meta name=\"twitter:site\" content=\"@VoxxedBucharest\" \/>\n<meta name=\"twitter:label1\" content=\"Written by\">\n\t<meta name=\"twitter:data1\" content=\"alexproca\">\n\t<meta name=\"twitter:label2\" content=\"Est. reading time\">\n\t<meta name=\"twitter:data2\" content=\"1 minute\">\n<script type=\"application\/ld+json\" class=\"yoast-schema-graph\">{\"@context\":\"https:\/\/schema.org\",\"@graph\":[{\"@type\":\"WebSite\",\"@id\":\"https:\/\/voxxeddays.com\/greece\/#website\",\"url\":\"https:\/\/voxxeddays.com\/greece\/\",\"name\":\"Voxxed Days Greece\",\"description\":\"Another Voxxed event\",\"potentialAction\":[{\"@type\":\"SearchAction\",\"target\":\"https:\/\/voxxeddays.com\/greece\/?s={search_term_string}\",\"query-input\":\"required name=search_term_string\"}],\"inLanguage\":\"en-US\"},{\"@type\":\"ImageObject\",\"@id\":\"https:\/\/voxxeddays.com\/greece\/2016\/02\/11\/process-your-big-data-in-a-blink-using-spark\/#primaryimage\",\"inLanguage\":\"en-US\",\"url\":\"https:\/\/voxxeddays.com\/bucharest\/wp-content\/uploads\/sites\/19\/2016\/02\/dan-serban-e1455198941566.jpg\"},{\"@type\":\"WebPage\",\"@id\":\"https:\/\/voxxeddays.com\/greece\/2016\/02\/11\/process-your-big-data-in-a-blink-using-spark\/#webpage\",\"url\":\"https:\/\/voxxeddays.com\/greece\/2016\/02\/11\/process-your-big-data-in-a-blink-using-spark\/\",\"name\":\"Process your big data in a blink using Spark - Voxxed Days Greece\",\"isPartOf\":{\"@id\":\"https:\/\/voxxeddays.com\/greece\/#website\"},\"primaryImageOfPage\":{\"@id\":\"https:\/\/voxxeddays.com\/greece\/2016\/02\/11\/process-your-big-data-in-a-blink-using-spark\/#primaryimage\"},\"datePublished\":\"2016-02-11T13:58:47+00:00\",\"dateModified\":\"2016-03-10T23:37:29+00:00\",\"author\":{\"@id\":\"https:\/\/voxxeddays.com\/greece\/#\/schema\/person\/3610fff738a03b155237ab4707e803eb\"},\"inLanguage\":\"en-US\",\"potentialAction\":[{\"@type\":\"ReadAction\",\"target\":[\"https:\/\/voxxeddays.com\/greece\/2016\/02\/11\/process-your-big-data-in-a-blink-using-spark\/\"]}]},{\"@type\":\"Person\",\"@id\":\"https:\/\/voxxeddays.com\/greece\/#\/schema\/person\/3610fff738a03b155237ab4707e803eb\",\"name\":\"alexproca\",\"image\":{\"@type\":\"ImageObject\",\"@id\":\"https:\/\/voxxeddays.com\/greece\/#personlogo\",\"inLanguage\":\"en-US\",\"url\":\"https:\/\/secure.gravatar.com\/avatar\/fb9bbcf4c88be28b95644b3697985fcb?s=96&d=mm&r=g\",\"caption\":\"alexproca\"}}]}<\/script>\n<!-- \/ Yoast SEO plugin. -->","_links":{"self":[{"href":"https:\/\/voxxeddays.com\/greece\/wp-json\/wp\/v2\/posts\/2435"}],"collection":[{"href":"https:\/\/voxxeddays.com\/greece\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/voxxeddays.com\/greece\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/voxxeddays.com\/greece\/wp-json\/wp\/v2\/users\/7816"}],"replies":[{"embeddable":true,"href":"https:\/\/voxxeddays.com\/greece\/wp-json\/wp\/v2\/comments?post=2435"}],"version-history":[{"count":0,"href":"https:\/\/voxxeddays.com\/greece\/wp-json\/wp\/v2\/posts\/2435\/revisions"}],"wp:attachment":[{"href":"https:\/\/voxxeddays.com\/greece\/wp-json\/wp\/v2\/media?parent=2435"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/voxxeddays.com\/greece\/wp-json\/wp\/v2\/categories?post=2435"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/voxxeddays.com\/greece\/wp-json\/wp\/v2\/tags?post=2435"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}