Awesome Azure - Advanced Analytics ![Awesome](https://awesome.re/badge.svg)
Awesome big data and advanced analytics resources for the Microsoft Azure Cloud
- Azure General
- AI and Machine Learning
- Cloud Scale Analytics
![Microsoft AI platform](https://github.com/dem108/Awesome-Azure-Advanced-Analytics/raw/master/img/CIS.png)
Contributing
Your contributions are welcomed! Please send a pull request to contribute. Make sure you check out the the Markdown Syntax
guide and add the link you want to contribute at the bottom of the appropriate category.
We are in a transition to adopt the best practice from this list guideline.
As part of this efforts, your contributions are appreciated on the items with - DESCRIPTION NEEDED.
, or the ones without the descriptions; You can verfity the link and add description. Try to avoid marketing message but use helpful/objective summary of what it is. Please end the sentence with .
(dot).
:heart: are added to only hand-picked items (ideally less than 2-3 per category for visibility) for now. We welcome ideas to automate this process.
Check out the Issues section to share your ideas to improve this repo.
Table of Contents
-
Azure General
-
AI and Machine Learning
-
Cloud Scale Analytics
Azure General
Getting to know Azure
- Free Azure Subscription - Guide on creating new free Azure subscription and get started on Azure.
- Understand Azure services
- Code, Samples, Templates
- Related Awesome lists
- Blogs, Forums, Newsletters
- :heart: Azure Architecture Center - Application Architecture Guide, Reference Architecture, Microsoft Cloud Adoption Framework for Azure.
- Other general Azure Guides
- (Not just Azure) Microsoft Research Podcast - Microsoft Research ongoing Podcast series, touching variety topics on Machine Learning / Machine Teaching, autonomous systems, Quantom Computing, and much more.
Training Resources
Technical Certifications
-
Microsoft Certifications - Role-based certifications for Developers, Administrators, Solution Architects, Data Engineers, Data Scientists, AI Engineers, DevOps Engineers, Security Engineers, and Functional Consultants.
-
Certifications (Role based)
- Data Engineer - Data Engineers design and implement the management, monitoring, security, and privacy of data using the full stack of data services.
- Data Scientist - Data Scientists apply machine learning techniques to train, evaluate, and deploy models that solve business problems.
- AI Engineer - AI Engineers use Cognitive Services, Machine Learning, and Knowledge Mining to architect and implement Microsoft AI solutions.
- DevOps Engineer - DevOps Engineers combine people, process, and technologies to continuously deliver valuable products and services that meet end user needs and business objectives.
-
Exams
- Active
- AI-100 - Designing and Implementing an Azure AI Solution.
- DP-100 - Designing and Implementing a Data Science Solution on Azure.
- DP-200 - Implementing an Azure Data Solution.
- DP-201 - Designing an Azure Data Solution.
- Old
- 70-473 - Designing and Implementing Cloud Data Platform Solutions.
- 70-475 - Designing and Implementing Big Data Analytics Solutions.
- 70-773 - Analyzing Big Data with Microsoft R.
- 70-774 - Perform Cloud Data Science with Azure Machine Learning.
- 70-775 - Perform Data Engineering on Microsoft Azure HDInsight.
- 70-776 - Perform Big Data Engineering on Microsoft Cloud Services.
- 70-778 - Analyzing and Visualizing Data with Microsoft Power BI.
-
MPPs now retired
-
AI + Machine Learning
Artificial intelligence productivity for every developer and every scenario
AI Apps and Agents
Deliver breakthrough experiences in your apps
Azure Cognitive Services
A collection of APIs to tap into vision, speech, language, knowledge, and search technologies
- Overview (List of APIs) - A comprehensive family of AI services and cognitive APIs to help you build intelligent apps.
- Blog - Azure Cognitive Services Blog.
- Documentation - Learn how to build intelligent and supported algorithms into apps, websites, and bots to see, hear, speak, understand, and interpret your user needs.
- Decison
- Language
- Immersive Reader
- Language Understanding
- QnA Maker
- Text Analytics
- Translator Text
- Custom Translator Portal - Learn how to customize Microsoft Translator's neural text and speech translation systems using your own training data to fit your style and terminology.
- Microsoft Translator - Translated conversations across devices, for one-on-one chats and for larger group interactions.
- Microsoft Translator Git Repo - Samples and utilities for Microsoft Translator.
- Speech
- Speech to Text
- Text to Speech
- Speech Translation
- Speaker Recognition
- Speech Studio
- Custom Speech - A set of online tools that allow you to evaluate and improve Microsoft's speech-to-text accuracy for your applications, tools, and products.
- Custom Keyword - Customizing your keyword is an effective way to differentiate your device and strengthen your branding.
- Custom Voice - Record and upload training data to create a one-of-a-kind voice for your applications.
- Audio Content Creation - Manage SSML files.
- Custom Commands - Easily configure commands, so that users can complete tasks using their voice.
- Speech CLI - Command line tool for using the Speech service without writing any code, it is production-ready and can be scaled up to run larger processes using automated .bat or shell scripts.
- Vision
- Computer Vision
- Custom Vision
- Custom Vision Service Portal - Customize your own state-of-the-art computer vision models that fit with your unique use case by just bringing a few examples of labeled images.
- Face
- Form Recognizer
- Ink Recognizer
- Video Indexer
- Video Indexer Portal - Easily extract insights from your videos and quickly enrich your applications to enhance discovery and engagement.
- Web search
- Bing Autosuggest
- Bing Custom Search
- Bing Entity Search
- Bing Image Search
- Bing News Search
- Bing Spell Check
- Bing Video Search
- Bing Visual Search
- Bing Web Search
- Cognitive Research Technologies - This set of innovative APIs and SDKs provides researchers and developers with an early look at emerging cognitive capabilities.
- From Ignite
- Vowpal Wabbit - Vowpal Wabbit for reinforcement learning (contextual bandit, learning to search), supervised learning (active learning, extreme
- Recommendations Solution - (Old) Azure AI Gallery template for Recommendations Solution.
- Intelligent Kiosk
- GitHub - Find several demos showcasing workflows and experiences built on top of the Microsoft Cognitive Services.
- MS Store - On Microsoft Store: From face identification, emotion understanding and computer vision, to bots, text analytics and Bing services, the kiosk is your toolbox of AI demos, ready whenever you need an intuitive and engaging way of showing off Microsoft AI.
- Tutorial: Build Mobile App with Chat - The tutorial uses several Azure services to power a real-time chat infrastructure that is readymade for analytics.
- Microsoft Azure Developer: Creating and Integrating AI with Azure Services - Explore the landscape of AI in the Microsoft space, and examine some practical examples to get you started.
- Python SDK Samples - Learn how to use the Cognitive Services Python SDK with these samples.
- C# SDK Samples - Learn how to use the Cognitive Services C# SDK with these samples.
- Channel 9 Videos - Channel 9: Cognitive Services.
Microsoft Bot Framework
A framework to build and deploy high-quality bots for conversation experiences
- Get Started online documentations
- Highlights from official online documentations
- Blogs
- Related GitHub repos
- Relevant services
- Training materials
- e-books
Knowledge Mining
Uncover latent insights from all your content
Azure Cognitive Search
AI-powered cloud search service for web and mobile app development
- Official Getting Started documentations
- Demos - DESCRIPTION NEEDED.
- Further industrial applications
- Bootcamps / Workshop Materials
- Knowledge Mining Bootcamp - Training material from Azure AI Customer Engineering (ACE) team.
- Knowledge Mining Solution Accelerator - Working sample with customizable UI template, custom skills, Power BI integration.
- Knowledge Mining Solution Accelerator (workshop) - Step-by-step hands-on workshop guides from KM Solution Accelerator.
- :heart: Mark Heffner's KM Workshop - In-depth workshop content including Knowledge Store, using web frontend, custom skills and Functions, Object Model, Analyzer and Scoring Profiles, Power BI etc.
- From Ignite
- :heart: AIML10: Making Sense of your Unstructured Data with AI - Cover ingest-enrich-explore pattern, skillsets, cognitive skills, natural language processing, computer vision, and beyond.
- KM Solutions
- Training materials
Machine Learning
Quickly and easily build, train, deploy and manage your models
Azure Machine Learning
Cloud-based environment you can use to train, deploy, automate, manage, and track ML models.
- Official Getting Started
- Highlights from online documentations
- Architecture and Concepts - Workflow, Tools, Glossary.
- :heart: MLOps Concepts - MLOps: Model management, deployment and monitoring with Azure Machine Learning.
- e-book: Agile Project Management with Azure DevOps: Concepts, Templates, and Metrics - by Joachim Rossberg.
- TwiML Podcast: TwiML-Enterprise Readiness, MLOps and Lifecyle Management - TwiML Podcast with Jordan Edwards.
- Automated Machine Learning - Covers when to use it, how it works, pre-processing, how to avoid overfitting, ensemble models, imbalanced data etc.
- Interpretability - Why it matters, how it is implemented in Azure ML (SHAP, Mimic, Permutation Feature Importance, LIME, HAN, Tabular).
- Designer - No-code ML experience that spans data preparation, model training, and deployment.
- Enterprise Security - Authentication, authorization, network security, data encryption, monitoring, data flow diagrams with Azure ML.
- Samples, Tutorials, Reference Architectures, Templates, Solution Accelerators
- SDK/CLI References
- Blogs
- Learning materials
- AI at Edge
- Non-Azure general and useful resources
- Data Science Lifecycle Process - Best practices for data science teams, including issue templates, branching strategy, workflows, labels, standard repo structure.
- Azure ML Studio (classic)
Note: Check out the Designer which is an evolution of Azure ML Studio (classic) and is now integrated with Azure Machine Learning.
Deep Learning on Azure
This whole section is planned to be reorganized (product-related, tools, DL frameworks, MLOps/DevOps)
Jupyter Notebooks
A web application to create documents containing live code, visualizations and explanatory text
Microsoft Machine Learning Server
A scalable and deployable enterprise-grade R and Python analytics platform
Cloud Scale Analytics
Azure Analysis Services
An enterprise-grade data modeling engine in the cloud
Azure Cosmos DB
A globally distributed, multi-model NoSQL database service: key-value, graph, document (JSON)
Azure Database for MariaDB
An enterprise-ready, fully managed community MariaDB
Azure Database for MySQL
An enterprise-ready, fully managed community MySQL
Azure Database for PostgreSQL
An enterprise-ready, fully managed community PostgreSQL
Azure Databricks
A fast, easy, and collaborative Apache Spark-based analytics platform
Azure Data Catalog
A tool to register, enrich, discover, understand, and consume data sources
Azure Data Explorer
A fast and highly scalable data exploration service
Azure Data Factory
A globally deployed data movement, orchestration, scheduling, and monitoring service
Azure Data Lake
A distributed storage and analytics service that scales dynamically
Azure Event Hubs
A cloud-scale telemetry ingestion from websites, apps, and devices
Azure HDInsight
A managed Apache Hadoop, Spark, Storm, HBase, and R cloud service
Azure IoT
Cloud services to connect, monitor, and manage billions of IoT assets
Azure Redis Cache
A secure, managed, dedicated Redis cache
Azure SQL Database
A managed cloud database for app developers
Azure SQL Data Warehouse
An elastic data warehouse as a service with enterprise-class features
Azure Stream Analytics
A fully managed, SQL-based, real-time event processing engine
Azure Time Series Insights
A fully managed analytics, storage, and visualization service to explore and analyze IoT events
Microsoft Power BI
A suite of business analytics tools to analyze data, create visualizations and share insights