☁️ Azure Weekly #447 - 3rd December 2023

ML.NET v3, Azure AI Studio, Azure Functions Deep Dive, and Copilot writing your git commit messages! ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌

Azure Weekly Newsletter Issue #447

powered by endjin

Welcome to issue 447 of Azure Weekly. Let's start this week with AI; ML.NET 3.0 Boosts Deep Learning, Data Processing for .NET-Based AI Apps, there's also a nice Getting started with Azure AI Studio, and a feature I'm quite interested in trying - Write Your Git Commits with GitHub Copilot (hopefully it can deliver something more meaninful than "tweak", "change", "tweak" which too many of my commit messages seem to be).

In the data and analytics space: Semantic Link: OneLake integrated Semantic Models and Microsoft Fabric real-time analytics exploration:KQL Database mirroring and What are Kusto Query Language KQL databases in Microsoft Fabric?.

In Cloud Native Apps, a particularly good article - Getting Hands-On with Azure Functions: A Deep Dive and Secure access to your Azure App Services/Function Apps/Logic Apps using Azure AD OAuth and API.

I mentioned this topic earlier in the year, but code = energy = money = carbon. Creating highly efficient code, can have a huge positive impact on your infrastructure, your budget, and the environment. Several years ago we worked on a data and analytics project that needed to inject large amounts of real time data - marine shipping vessel locations from the entire planet. The initial implementation used a popular Python package (a wrapper over a C++ library) and that could process 50,000 AIS (Automatic Identification System) messages per second, and needed a 45 node cluster in order to ingest the data volume. We hypothesised that we could do a much better job, and re-implemented the AIS specification using C# / .NET Core 2.0 and achieved 2.6 million messages / sec / core, and allowed us to move the entire data ingestion process into a single Azure Function and reduced the ingestion lag from hours to near real time. With ever subsequent release of .NET we have seen significant performance improvements (with no additional code changes); and with .NET 8.0 was no exception; we've seen AIS.NET performance boosted by 27% which means we can now process 4.75 million messages / sec / core. Python may well be the most popular language for data science / engineering workloads, but for computationally intensive workloads, .NET is a great choice (and in my opinion needs better support in Spark & ML training environments like Microsoft Fabric).

If you have any content you'd like to contribute to the newsletter, please tweet @AzureWeekly or ping an email to AzureWeekly@endjin.com.

Interested in Power BI? Sign up to our sibling newsletter Power BI Weekly or follow on Twitter @powerbiweekly to receive all the week's Power BI news.

@HowardvRooijen | @endjin

AI + Machine Learning

Covering: Anomaly detector, Azure Bot Service, Azure Machine Learning, Azure Open Datasets, Bing APIs, Cognitive Services, Computer Vision, Content moderator, Custom vision, Data Science Virtual Machines, Face, Form Recogniser, Immersive Reader, Ink Recogniser, Language Understanding (LUIS), Machine Learning Studio, Microsoft Genomics, ML.NET, Personaliser, Project Cortex, QnA Maker, Speaker Recognition, Speech-to-Text, Speech translation, Text Analytics, Text to Speech , Translator Speech, Translator Text

Analytics

Covering: Apache Spark for HDInsight, Azure Analysis Services, Azure Data Explorer, Azure Data Share, Azure Databricks, Azure Stream Analytics, Azure Synapse Analytics, Data Factory, Event Hubs, HDInsight, Microsoft Purview, Microsoft Fabric

Compute

Covering: Azure CycleCloud, Azure Dedicated Host, Azure Functions, Azure VMware Solution by CloudSimple, Batch, Cloud Services, Linux Virtual Machines, SAP HANA on Azure Large Instances, Service Fabric, Virtual Machines, Virtual Machine Scale Sets

Containers

Covering: Azure Kubernetes Service (AKS), Azure Red Hat OpenShift, CNAB, CNCF, Container Instances, Container Registry, Porter, WSL, Web App for Containers

Databases

Covering: Azure Cosmos DB, Azure Database for MariaDB, Azure Database for MySQL, Azure Database for PostgreSQL, Azure SQL Database, Azure SQL Database Edge, Azure Cache for Redis, SQL Data Warehouse, SQL Server on virtual machines, SQL Server Stretch Database, Table storage

Developer Tools

Covering: App Configuration, Azure Lab Services, CLIs, Developer tool integrations, SDKs, Visual Studio, Visual Studio Code, Visual Studio Online

DevOps

Covering: Azure Artifacts, Azure Boards, Azure DevOps, Azure Pipelines, Azure Repos, Azure Test Plans, Azure DevTest Labs, DevOps tool integrations

Hybrid + Multicloud

Covering: Azure Arc, Azure Stack

Identity

Covering: Azure Active Directory (AD), Azure Active Directory B2C, Azure Active Directory Domain Services

Integration

Covering: Azure API for FHIR, Event Grid, Logic Apps, Service Bus

Internet of Things

Covering: Azure Digital Twins, Azure IoT Central, Azure IoT Edge, Azure IoT Hub, Azure IoT solution accelerators, Azure Maps, Azure Sphere, Azure Time Series Insights, IoT DevKit, WildernessLabs, Windows 10 IoT Core Services

  • No content this week

Learning

Covering: Microsoft Certifications, Azure Certifications, Microsoft Learning Paths, Certification Pathway Information

Management and Governance

Covering: Automation, Azure Advisor, Azure Backup, Azure Blueprints, Azure Lighthouse, Azure Managed Applications, Azure mobile app, Azure Monitor, Azure Policy, Azure Resource Manager, Azure Service Health, Azure Site Recovery, Cloud Shell, Cost Management, Microsoft Azure portal, Scheduler, Azure Purview

Media

Covering: Azure Media Player, Content Protection, Encoding, Live and On-Demand Streaming, Media Analytics, Media Services, Video Indexer

  • No content this week

Migration

Covering: Azure Database Migration Service, Azure Migrate, Data Box

Mobile

Covering: App Service (Mobile), Mobile apps, Notification Hubs, Visual Studio App Centre, Xamarin

  • No content this week

Networking

Covering: Application Gateway, Azure Bastion, Azure DNS, Azure ExpressRoute, Azure Firewall, Azure Firewall Manager, Azure Front Door, Azure Internet Analyzer, Azure Private Link, Content Delivery Network, Load Balancer, Network Watcher, Traffic Manager, Virtual Network, Virtual WAN, VPN Gateway, Web Application Firewall

Security

Covering: Azure DDoS Protection, Azure Information Protection, Azure Sentinel, Key Vault, Security Center

Storage

Covering: Archive Storage, Avere vFXT for Azure, Azure Data Lake Store, Azure FXT Edge Filer, Azure HPC Cache, Azure NetApp Files, Blob Storage, Disk Storage, File Storage, Managed Disks, Queue Storage, Storage Accounts, Storage Explorer, StorSimple

Web

Covering: API apps, API Management, App Service (Web), Azure Cognitive Search, Azure SignalR Service, Azure Spring Cloud, Web apps

Azure Virtual Desktop

Covering: Azure Virtual Desktop

Thought Leadership from endjin

Useful Links

  • Azure Resource Inventory - Azure Resource Inventory - It's a Powerful tool to create EXCEL inventory from Azure Resources with low effort
  • Azure Quick Review (azqr) - A command-line interface (CLI) tool specifically designed to analyze Azure resources and identify whether they comply with Azure's best practices and recommendations.
  • AzSaveMoney - Clean-up and save money by identifying and marking unused Azure resources/groups as subject for deletion by tagging.
  • Azure Cost CLI - CLI tool to perform cost analysis on your Azure subscription
  • Azure Code Samples - Explore Microsoft's samples and discover the things you can build.
  • Azure Resource Inventory - Azure Resource Inventory is a powerful script written in PowerShell to generate an Excel report of any Azure Environment you have read access
  • Azure Quickstart Templates - Learn how to deploy to Azure using ARM Templates. Over 850 examples in this repo.
  • Azure CNAB Quickstarts Library - You can deploy to the Cloud, on Prem and on the Edge using CNAB & Porter. This library provides a number of quickstart templates to help you get started, fast!
  • Power BI Weekly - Interested in Power BI? Sign up to our sister newsletter Power BI Weekly to receive all the week's Power BI news.
  • Azure Resources - A fantastic collection of resources contained in this repo. Issue a PR if you have resources to share. Managed by Azure MVP Gregor Suttie.
  • Azure Charts - Azure Charts is a set of auto-rebuilt charts to keep you updated on Azure changes, news, stats. Public updates, RSS channels and web pages are used as data sources
  • The Developer’s Guide to Microsoft Azure (2nd Edition) - ebook from Microsoft showcasing architectural approaches and common design patterns you face when building modern applications.
  • Cyber Security Demystified - ebook from Microsoft describing how to keep your organisation safe.
  • Azure Resource Center - Whitepapers, code samples, solution architectures
  • Azure Architecture Center - guidance from the Patterns & Practices team covering API Design, API implementation, Autoscaling, Background jobs, CDN, Caching, Data partitioning, Monitoring and diagnostics, Retry, Scalability and availability.
  • Design scalable and performant tables - a guide from the storage team.
  • Azure Speed Test 2.0 - a simple web tool that measures the latency between you and Azure Datacenters to suggest which might be fastest for you location.
  • Microsoft Azure Symbol/Icon Set - a set of Visio and PowerPoint shapes for use in architecture diagrams / presentations.
  • Service Bus Explorer - a free and open source tool for managing and exploring Azure Service Bus(including Event Hubs).
  • Microsoft cloud for IT architects illustrations - These cloud architecture posters give you information about Microsoft cloud services, including Microsoft 365, Azure Active Directory (Azure AD), Microsoft Intune, Microsoft Dynamics 365, and hybrid on-premises and cloud solutions.
  • Whitepapers for Power BI - numerous whitepapers ranging various Power BI topics
  • Farmer - This is a DSL for ARM template creation - "Making repeatable Azure deployments easy"!

Tweet  |  Forward  |  Preferences  |  Unsubscribe

Older messages

Power BI Weekly #235 - 29th November 2023

Wednesday, November 29, 2023

Power BI Weekly Newsletter Issue #235 powered by endjin Welcome to the 235th edition of Power BI Weekly! No official announcements this week after the Ignite influx, although Darren Gosbell has shared

Power BI Weekly #234 - 21st November 2023

Tuesday, November 21, 2023

Power BI Weekly Newsletter Issue #234 powered by endjin Welcome to the 234th edition of Power BI Weekly! You'll probably be aware that last week was the Microsoft Ignite conference, which was, well

☁️ Azure Weekly #445 - 19th November 2023

Sunday, November 19, 2023

Azure Weekly Newsletter Issue #445 powered by endjin Welcome to issue 445 of Azure Weekly! Well, what an interesting week it has been. .NET 8.0 was released, there was .NET Conf 2023, then Microsoft

Power BI Weekly #233 - 14th November 2023

Tuesday, November 14, 2023

Power BI Weekly Newsletter Issue #233 powered by endjin Welcome to the 233rd edition of Power BI Weekly! This week the ground-breaking news is that Datasets have been renamed to semantic models. I

☁️ Azure Weekly #444 - 12th November 2023

Sunday, November 12, 2023

Azure Weekly Newsletter Issue #444 powered by endjin Welcome to issue 444 of Azure Weekly. A short and sweet issue, as I expect a many announcements are being held back for the Microsoft Ignite

You Might Also Like

When accelerator dreams become company nightmares

Thursday, May 2, 2024

Plus: Illinois gives Rivian incentives and AI is not SaaS View this email online in your browser By Christine Hall Thursday, May 2, 2024 Hello, and welcome back to TechCrunch PM. We have a great lineup

📱 Issue 409 - Claude Team plan and iOS app

Thursday, May 2, 2024

This week's Awesome iOS Weekly Read this email on the Web The Awesome iOS Weekly Issue » 409 Release Date May 02, 2024 Your weekly report of the most popular iOS news, articles and projects Popular

💻 Issue 415 - Hotel WiFi JavaScript Injection (2012)

Thursday, May 2, 2024

This week's Awesome JavaScript Weekly Read this email on the Web The Awesome JavaScript Weekly Issue » 415 Release Date May 02, 2024 Your weekly report of the most popular JavaScript news, articles

💎 Issue 415 - Choosing the Right Audit Trail Approach in Ruby

Thursday, May 2, 2024

This week's Awesome Ruby Newsletter Read this email on the Web The Awesome Ruby Newsletter Issue » 415 Release Date May 02, 2024 Your weekly report of the most popular Ruby news, articles and

💻 Issue 408 - Speeding up C++ build times

Thursday, May 2, 2024

This week's Awesome .NET Weekly Read this email on the Web The Awesome .NET Weekly Issue » 408 Release Date May 02, 2024 Your weekly report of the most popular .NET news, articles and projects

💻 Issue 415 - Ditch dotenv: Node.js Now Natively Supports .env File Loading

Thursday, May 2, 2024

This week's Awesome Node.js Weekly Read this email on the Web The Awesome Node.js Weekly Issue » 415 Release Date May 02, 2024 Your weekly report of the most popular Node.js news, articles and

💻 Issue 333 - React 19 Beta

Thursday, May 2, 2024

This week's Awesome React Weekly Read this email on the Web The Awesome React Weekly Issue » 333 Release Date May 02, 2024 Your weekly report of the most popular React news, articles and projects

📱 Issue 412 - The Composable Architecture: My 3 Year Experience

Thursday, May 2, 2024

This week's Awesome Swift Weekly Read this email on the Web The Awesome Swift Weekly Issue » 412 Release Date May 02, 2024 Your weekly report of the most popular Swift news, articles and projects

💻 Issue 410 - Lessons learned after 3 years of fulltime Rust game development, and why we're leaving Rust behind

Thursday, May 2, 2024

This week's Awesome Rust Weekly Read this email on the Web The Awesome Rust Weekly Issue » 410 Release Date May 02, 2024 Your weekly report of the most popular Rust news, articles and projects

📺 How to Stop Any Smart TV From Spying On You — Single Player Games That Are Fun With Friends

Thursday, May 2, 2024

Also: Alienware's Latest Gaming Laptop is Great For Work, and More! How-To Geek Logo May 2, 2024 Did You Know The voice actors behind Mickey and Minnie Mouse throughout the 1980s, 1990s, and most