At this month's Data Matters, we're excited to be joined by Jesse Anderson! Jesse will share the stories of teams who haven’t set up their data engineering culture correctly and what happened, and how to turn it around. Don't miss it!
The biggest initial hurdle to success with Big Data isn’t technical - it’s management. Your data engineering project’s initial success is predicated on your management team correctly staffing and resourcing it. This runs opposite to how most data engineering teams are started and run. If you just choose the best technologies, things will just fall into place. They don’t and that’s a common pattern for failure.
But how do you correctly do something that’s so new? This could be your team’s first data engineering project. What should the team look like? What skills should the team have? What should you look for in Data Engineer (because you’ll probably have to hire a Software Engineer and train them)? What are some of the management pitfalls?
In this talk, we will cover the most common reasons why data engineering teams fail and how to correct them. This will include ways to get your management to understand that data engineering is really complex and time consuming. It is not data warehousing with new names. Management needs to understand that you can’t compare a data engineering team to the web development team, for example.
Jesse will share the stories of teams who haven’t set up their data engineering culture correctly and what happened. Then, Jesse will talk about the teams who’ve turned around their culture and how they did it. FInally, Jesse will share the skills that every data engineering team needs.
YOU MAY ALSO LIKE:
- Real-time Systems with Spark Streaming and Kafka (in London on 23rd - 24th September 2019)
- Keynote: Why Real-Time is the Future (SkillsCast recorded in July 2018)
- Fast Track to Machine Learning with Louis Dorard (in London on 15th - 17th July 2019)
- Infiniteconf 2019 - The conference on Big Data and AI (in London on 4th - 5th July 2019)
- CloudNative London 2019 (in London on 25th - 27th September 2019)
- Causal inference and the data-fusion problem (in London on 18th June 2019)
- The wonders of IBM: Watson, artificial intelligence, Swift coding and databases! (in London on 19th June 2019)
- AI Auditing Framework (SkillsCast recorded in June 2019)
- Accessing Snap ML (SkillsCast recorded in June 2019)
Creating a Data Engineering Culture
Jesse Anderson is a data engineer, creative engineer, and managing director of the Big Data Institute. Jesse trains employees on big data—including cutting-edge technology like Apache Kafka, Apache Hadoop, and Apache Spark. He has taught thousands of students at companies ranging from startups to Fortune 100 companies the skills to become data engineers. He is widely regarded as an expert in the field and recognized for his novel teaching practices. Jesse is published by O’Reilly and Pragmatic Programmers and has been covered in such prestigious media outlets as the Wall Street Journal, CNN, BBC, NPR, Engadget, and Wired. You can learn more about Jesse at Jesse-Anderson.com.