Wednesday, October 7, 2020 at 6:00:00 PM Online event

A sister Meetup group in Austin, Texas is holding this event; due to the new coronavirus outbreak, this will be held online.

Creating an Automated Spark Development Environment with Analysis and Logging

Wednesday, October 7, 2020
6:00 PM

In this meetup, we're going to put ourselves in the shoes of a Data Engineer tasked by the State of Texas to create processes that extract, transform, and load publicly accessible financial data from the Paycheck Protection Program. This data can then be used in order to create reports that state elected officials can use to make decisions. We'll also go over how you can leverage CLI tools to create a system in which you can continuously deploy your newly developed Spark jobs through some automation scripts, saving huge amounts of development and deployment time. At the end we'll even take a look at the finished result of our reports!

Come join us to see this example of the new Data Engineering Experience in action and hopefully inspire similar solutions of your own!

Click here for event

View in KCUG Phone App

0 Response to "October 7: Future of Data: Kansas City - Cross-list: Creating an Automated Spark Development Environment with Analysis"

Post a Comment

Group Tools

Random Prize Winner
Use this tool to generate random numbers for prize drawings.

Follow this twitter list of the twitter accounts for the user groups. Ask for your group to be added to this list: twitter list
Subscribe to the Kansas City User Group Newspaper at

Blog Archive