Terry McCann

Terry McCann's Blog

How to prepare for 70-766 - Perform Big Data Engineering on Microsoft Cloud Services

image

There is a new exam currently in beta titled "Perform Big Data Engineering on Microsoft Cloud Services (beta)". With all new exams there is little content on how to revise for the exam beyond the exams summary. This exam however, is what Adatis specialises in! Microsoft may call this "Big Data Engineering" we call it "Modern Data Analytics" and we have a few blogs on the subject. You can sign up to the exam here: https://www.microsoft.com/en-us/learning/exam-70-776.aspx

Below you will find links to blog posts by Adatis consultants on topics related to all the key objectives of this exam. I will endeavour to keep this up-to-date with new content added by the team. Good luck with the exam.

Design and Implement Complex Event Processing By Using Azure Stream Analytics (15-20%)
Streaming data is vital to achieving real-time analytics. The following blogs posts focus on this and offer an introduction and walkthrough for getting started with Stream Analytics. When talking about a wider Lambda approach to Big Data, streaming enables rapid processing via a “Speed” layer.   

http://blogs.adatis.co.uk/simonwhiteley/post/Adatis-Hackathon-Jan-2015-Streaming-Analytics-First-Thoughts
http://blogs.adatis.co.uk/Jose%20Mendes/post/IoT-Hub-Device-Explorer-Stream-Analytics-Visual-Studio-2015-and-Power-BI
http://blogs.adatis.co.uk/sachatomey/post/2017/01/19/Power-BI-Streaming-Datasets-An-Alternative-PowerShell-Push-Script
http://blogs.adatis.co.uk/Jose%20Mendes/post/Data-Data-Revolution

Design and Implement Analytics by Using Azure Data Lake (25-30%)
Azure Data Lake Store and Analytics are a vital component of the “Modern Data Analytics”. Data which is too large for traditional single server processing needs distributed parallel computation. Rather than pulling data and processing ADLA pushes the processing to the data. Understanding how to process large volumes of data is one part of the “Batch” layer in Lambda

http://blogs.adatis.co.uk/ustoldfield/post/data-lakes
http://blogs.adatis.co.uk/ustoldfield/post/Data-Flow-Job-Execution-in-the-Azure-Data-Lake
http://blogs.adatis.co.uk/ustoldfield/post/Data-Flow-Pt-2-Vertexes-In-Azure-Data-Lake

Design and Implement Azure SQL Data Warehouse Solutions (15-20%)
Either as an alternative or in accompaniment to Data Lake is Azure SQL Data Warehouse. If Data Lake is batch across many files, Azure SQLDW is parallel batch over many databases. The key to both services is processing at the storage and not at the compute. The following is an on-going blog series covering the basics all the way to a  deep-dive.  

http://blogs.adatis.co.uk/simonwhiteley/post/A-Guide-to-Azure-SQL-DataWarehouse
http://blogs.adatis.co.uk/simonwhiteley/post/Azure-SQLDW-What-is-it
http://blogs.adatis.co.uk/simonwhiteley/post/Azure-SQLDW-How-Does-Scaling-Work
http://blogs.adatis.co.uk/simonwhiteley/post/Azure-SQLDW-Distribution
http://blogs.adatis.co.uk/simonwhiteley/post/Azure-SQLDW-Polybase
http://blogs.adatis.co.uk/simonwhiteley/post/Azure-SQLDW-Polybase-Design-Patterns
http://blogs.adatis.co.uk/simonwhiteley/post/Azure-SQLDW-Polybase-Limitations
http://blogs.adatis.co.uk/simonwhiteley/post/Azure-SQLDW-CTAS-Statements

Design and Implement Cloud-Based Integration by using Azure Data Factory (15-20%)
If you’re looking for a paas solution to move data in Azure, there is only really one option. Azure Data Factory. The following blogs will get you up-to-speed with ADF.

http://blogs.adatis.co.uk/terrymccann/post/Getting-started-with-Azure-Data-Factory
http://blogs.adatis.co.uk/terrymccann/post/Setting-up-your-first-Azure-Data-Factory
http://blogs.adatis.co.uk/terrymccann/post/Azure-Data-Factory-using-the-Copy-Data-task-to-migrate-data-from-on-premise-SQL-Server-to-Blob-storage

Manage and Maintain Azure SQL Data Warehouse, Azure Data Lake, Azure Data Factory, and Azure Stream Analytics (20-25%)
Know each of the parts is only half the battle, you need to know how, when and why to use each part. What are the best practices?

http://blogs.adatis.co.uk/ustoldfield/post/Deploying-a-Hybrid-Cloud
http://blogs.adatis.co.uk/terrymccann/post/Azure-Data-Factory-Suggested-naming-conventions-and-best-practices
http://blogs.adatis.co.uk/ustoldfield/post/Azure-Data-Lake-Store-Storage-and-Best-Practices
http://blogs.adatis.co.uk/ustoldfield/post/Shaping-The-Lake-Data-Lake-Framework