Course Outline
Introduction
Overview of Apache Spark Features and Architecture
- Apache Spark modules: Spark SQL, Spark Streaming, MLlib, GraphX
- RDD, Dataframes, drive-workers, DAG, etc.
Setting up Apache Spark on .NET
- Preparing the Java VM
- Running .NET for Apache Spark using .NET Core
Getting Started
- Creating a sample .NET console application
- Adding the Spark driver
- Initializing a SparkSession
- Executing the application
Preparing Data
- Building a data preparation pipeline
- Performing ETL (Extract, Transform, and Load)
Machine Learning
- Building a machine learning model
- Preparing the data
- Training a model
Real-time Processing
- Processed streaming data in real-time
- Case study: monitoring sensor data
Interactive Query
- Working with Spark SQL
- Analyzing structured data
Visualizing Results
- Plotting results
- Using third-party tools to visualize results
Troubleshooting
Summary and Conclusion
Requirements
- .NET programming experience using C# or F#
Audience
- Developers
Testimonials (10)
I liked that it was practical. Loved to apply the theoretical knowledge with practical examples.
Aurelia-Adriana - Allianz Services Romania
Course - Python and Spark for Big Data (PySpark)
This is one of the best hands-on with exercises programming courses I have ever taken.
Laura Kahn
Course - Artificial Intelligence - the most applied stuff - Data Analysis + Distributed AI + NLP
A lot of practical examples, different ways to approach the same problem, and sometimes not so obvious tricks how to improve the current solution
Rafał - Nordea
Course - Apache Spark MLlib
The trainer was very helpful answering any questions we had and let us share our screen to show the errors we were having which was great.
chithra - Public Health Wales NHS Trust
Course - Advanced Blazor
Just the overall exposure. Very helpful.
Travis - Beckman Coulter
Course - Introduction to Blazor
Question and answer. And project demonstration.
Qing - Ametek
Course - Implementing the Actor Model with Microsoft Orleans
The trainer explained the subjects very good with actual examples from real world which made it simpler for us to grasp the information
Florin-Viorel Marut - Continental Automotive Romania
Course - High-Performance Application Development with .NET Core
It took up good stuff with a good speed, and not stayed in areas that was not important, left that to the student when the course was over. I mean that for a 2 day course it is a good value.
Mikael Forsberg - Kvadrat Örebro AB
Course - Introduction to .Net Core
Very hands on knowledge on the subject. A little bit of theory at the beginning to set the stage.
Thibault Chappuis - Mikron SA Boudry
Course - Entity Framework Core 2.0
I mostly liked the trainer knowledge and approach.