Data Cleaning Training Course

Audience

Analysts, researchers, scientists, graduates and students and anyone who is interested in learning how to facilitate statistical analysis in Microsoft Excel.

Course Objectives

This course will help improve your familiarity with Excel and statistics and as a result increase the effectiveness and efficiency of your work or research.

This course describes how to use the Analysis ToolPack in Microsoft Excel, statistical functions and how to perform basic statistical procedures. It will explain what Excel limitation are and how to overcome them.

R is a very popular, open source environment for statistical computing, data analytics and graphics. This course introduces R programming language to students.  It covers language fundamentals, libraries and advanced concepts.  Advanced data analytics and graphing with real world data.

Audience

Developers / data analytics

Duration

3 days

Format

Lectures and Hands-on

This course covers how to use Hive SQL language (AKA: Hive HQL, SQL on Hive, HiveQL) for people who extract data from Hive

This instructor-led, live training in Greece (online or onsite) is aimed at intermediate-level Python developers and data analysts who wish to enhance their skills in data analysis and manipulation using Pandas and NumPy.

By the end of this training, participants will be able to:

• Set up a development environment that includes Python, Pandas, and NumPy.
• Create a data analysis application using Pandas and NumPy.
• Perform advanced data wrangling, sorting, and filtering operations.
• Conduct aggregate operations and analyze time series data.
• Visualize data using Matplotlib and other visualization libraries.
• Debug and optimize their data analysis code.

Knowledge discovery in databases (KDD) is the process of discovering useful knowledge from a collection of data. Real-life applications for this data mining technique include marketing, fraud detection, telecommunication and manufacturing.

In this instructor-led, live course, we introduce the processes involved in KDD and carry out a series of exercises to practice the implementation of those processes.

Audience

• Data analysts or anyone interested in learning how to interpret data to solve problems

Format of the Course

• After a theoretical discussion of KDD, the instructor will present real-life cases which call for the application of KDD to solve a problem. Participants will prepare, select and cleanse sample data sets and use their prior knowledge about the data to propose solutions based on the results of their observations.

It is estimated that unstructured data accounts for more than 90 percent of all data, much of it in the form of text. Blog posts, tweets, social media, and other digital publications continuously add to this growing body of data.

This instructor-led, live course centers around extracting insights and meaning from this data. Utilizing the R Language and Natural Language Processing (NLP) libraries, we combine concepts and techniques from computer science, artificial intelligence, and computational linguistics to algorithmically understand the meaning behind text data. Data samples are available in various languages per customer requirements.

By the end of this training participants will be able to prepare data sets (large and small) from disparate sources, then apply the right algorithms to analyze and report on its significance.

Format of the Course

• Part lecture, part discussion, heavy hands-on practice, occasional tests to gauge understanding

Participants who complete this instructor-led, live training in Greece will gain a practical, real-world understanding of Big Data and its related technologies, methodologies and tools.

Participants will have the opportunity to put this knowledge into practice through hands-on exercises. Group interaction and instructor feedback make up an important component of the class.

The course starts with an introduction to elemental concepts of Big Data, then progresses into the programming languages and methodologies used to perform Data Analysis. Finally, we discuss the tools and infrastructure that enable Big Data storage, Distributed Processing, and Scalability.

This instructor-led, live training in Greece is aimed at software developers who wish to build search and analytics solutions using Elasticsearch.

The training starts with a discussion of the Elasticsearch architecture, including its distributed model and search API. This is followed by an explanation of Elasticsearch's functionality and how to best integrate it into an existing application.

Hands-on exercises make up an important part of the training, and give participants a chance to put into practice their knowledge while receiving feedback on their implementation and progress.

In the first part of this training, we cover the fundamentals of MATLAB and its function as both a language and a platform.  Included in this discussion is an introduction to MATLAB syntax, arrays and matrices, data visualization, script development, and object-oriented principles.

In the second part, we demonstrate how to use MATLAB for data mining, machine learning and predictive analytics. To provide participants with a clear and practical perspective of MATLAB's approach and power, we draw comparisons between using MATLAB and using other tools such as spreadsheets, C, C++, and Visual Basic.

In the third part of the training, participants learn how to streamline their work by automating their data processing and report generation.

Throughout the course, participants will put into practice the ideas learned through hands-on exercises in a lab environment. By the end of the training, participants will have a thorough grasp of MATLAB's capabilities and will be able to employ it for solving real-world data science problems as well as for streamlining their work through automation.

Assessments will be conducted throughout the course to gauge progress.

Format of the Course

• Course includes theoretical and practical exercises, including case discussions, sample code inspection, and hands-on implementation.

Note

• Practice sessions will be based on pre-arranged sample data report templates. If you have specific requirements, please contact us to arrange.

Data analytics is a crucial tool in business today. We will focus throughout on developing skills for practical hands on data analysis. The aim is to help delegates to give evidence-based answers to questions: 

What has happened?

• processing and analyzing data
• producing informative data visualizations

What will happen?

• forecasting future performance
• evaluating forecasts

What should happen?

• turning data into evidence-based business decisions
• optimizing processes

The course itself can be delivered either as a 6 day classroom course or remotely over a period of weeks if preferred. We can work with you to deliver the course to best suit your needs.

The aim of this course is to provide a clear understanding of the use of SQL for different
databases (Oracle, SQL Server, MS Access...). Understanding of analytic functions and the
way how to join different tables in a database will help delegates to move data analysis
operations to the database side, instead of doing this in MS Excel application. This can also
help in creating any IT system, which uses any relational database.

Apache Kylin is an extreme, distributed analytics engine for big data.

In this instructor-led live training, participants will learn how to use Apache Kylin to set up a real-time data warehouse.

By the end of this training, participants will be able to:

• Consume real-time streaming data using Kylin
• Utilize Apache Kylin's powerful features, rich SQL interface, spark cubing and subsecond query latency

Note

• We use the latest version of Kylin (as of this writing, Apache Kylin v2.0)

Audience

• Big data engineers
• Big Data analysts

Format of the course

• Part lecture, part discussion, exercises and heavy hands-on practice

Datameer is a business intelligence and analytics platform built on Hadoop. It allows end-users to access, explore and correlate large-scale, structured, semi-structured and unstructured data in an easy-to-use fashion.

In this instructor-led, live training, participants will learn how to use Datameer to overcome Hadoop's steep learning curve as they step through the setup and analysis of a series of big data sources.

By the end of this training, participants will be able to:

• Create, curate, and interactively explore an enterprise data lake
• Access business intelligence data warehouses, transactional databases and other analytic stores
• Use a spreadsheet user-interface to design end-to-end data processing pipelines
• Access pre-built functions to explore complex data relationships
• Use drag-and-drop wizards to visualize data and create dashboards
• Use tables, charts, graphs, and maps to analyze query results

Audience

• Data analysts

Format of the course

• Part lecture, part discussion, exercises and heavy hands-on practice

Embedding Projector is an open-source web application for visualizing the data used to train machine learning systems. Created by Google, it is part of TensorFlow.

This instructor-led, live training introduces the concepts behind Embedding Projector and walks participants through the setup of a demo project.

By the end of this training, participants will be able to:

• Explore how data is being interpreted by machine learning models
• Navigate through 3D and 2D views of data to understand how a machine learning algorithm interprets it
• Understand the concepts behind Embeddings and their role in representing mathematical vectors for images, words and numerals.
• Explore the properties of a specific embedding to understand the behavior of a model
• Apply Embedding Project to real-world use cases such building a song recommendation system for music lovers

Audience

• Developers
• Data scientists

Format of the course

• Part lecture, part discussion, exercises and heavy hands-on practice

kdb+ is an in-memory, column-oriented database and q is its built-in, interpreted vector-based language. In kdb+, tables are columns of vectors and q is used to perform operations on the table data as if it was a list. kdb+ and q are commonly used in high frequency trading and are popular with the major financial institutions, including Goldman Sachs, Morgan Stanley, Merrill Lynch, JP Morgan, etc.

In this instructor-led, live training, participants will learn how to create a time series data application using kdb+ and q.

By the end of this training, participants will be able to:

• Understand the difference between a row-oriented database and a column-oriented database
• Select data, write scripts and create functions to carry out advanced analytics
• Analyze time series data such as stock and commodity exchange data
• Use kdb+'s in-memory capabilities to store, analyze, process and retrieve large data sets at high speed
• Think of functions and data at a higher level than the standard function(arguments) approach common in non-vector languages
• Explore other time-sensitive applications for kdb+, including energy trading, telecommunications, sensor data, log data, and machine and network usage monitoring

Audience

• Developers
• Database engineers
• Data scientists
• Data analysts

Format of the course

• Part lecture, part discussion, exercises and heavy hands-on practice