Archive for the ‘Microsoft Azure’ Category

Microsoft Azure Data Platform – September (2017) update

October 1, 2017 Leave a comment

Microsoft Azure updates curated from September-2017 on: Azure SQL DB/DW, HD Insight, Machine Learning (ML), Azure Data Lake (ADL), etc.

1. Run Hortonworks clusters and easily access Azure Data Lake

2. Microsoft at PostgresOpen 2017

3. Bot conversation history with Azure Cosmos DB

4. Azure Stream Analytics drives retail industry transformation with real-time insights

5. Try Azure CosmosDB for free

6. Using Azure Analysis Services with Azure Data Lake Store

7. Ask us anything about the new Azure Log Analytics language

8. Azure HDInsight training resources – Learn about big data using open source technologies

9. September updates to the Azure Analysis Services web designer

10. Azure Analysis Services now available in Azure Government

11. Diving deep into what’s new with Azure Machine Learning

12. Azure CosmosDB – database for serverless era

13. Announcing tools for the AI-driven digital transformation

14. Introducing SQL Vulnerability Assessment for Azure SQL Database and on-premises SQL Server!

15. Azure Data Factory – announcing new capabilities in public preview

16. Get insights into your Azure CosmosDB: partition heatmaps, OMS, and more

17. Run you Hive LLAP & PySpark Job in Visual Studio Code

18. Azure SQL Database and Data Warehouse VNET Service Endpoints public preview

19. General availability of HDInsight Interactive Query – blazing fast queries on hyper-scale data

20. Azure Log Analytics – meet our new query language

21. Paxata launches Self-Service Data Preparation on Azure HDInsight to accelerate Data Prep

22. Introducing HDInsight integration with Azure Log Analytics Preview

23. Azure Analysis Services adds firewall support

24. Monitoring Azure SQL Data Sync using OMS Log Analytics


Microsoft Azure Data Platform – August (2017) update

September 1, 2017 Leave a comment

Microsoft Azure updates curated from August-2017 on: Azure SQL DB/DW, HD Insight, Machine Learning (ML), Azure Data Lake (ADL), etc.

1. Teradata Bolsters Analytics and Database capabilities for Azure

2. Migrating a Web App from ClearDB to Azure Database for MySQL

3. Online training for Azure Data Lake (ADL)

4. Introducing the #Azure CosmosDB Change Feed Processor Library

5. August updates to the Azure Analysis Services web designer

6. Bring Interactive Analytics to Azure HDInsight: Kyligence Analytics Platform enables sub-second query

7. Azure AD (AAD) authentication extensions for Azure SQL DB and SQL DW tools

8. Data Management Gateway (DMG) – High Availability and Scalability Preview

9. Using Azure Analysis Services over Azure SQL DB and DW

10. Azure Data Factory (ADF) July new features update

11. Replicated tables now in preview for Azure SQL Data Warehouse

12. On-premises data gateway support for Azure Analysis Services

13. Imanis Data – Cloud migration, backup for your big data apps on Azure HDInsight

14. Azure Database for MySQL and Azure Database for PostgreSQL availability in India

15. Perform advanced analytics on Application Insights data using Jupyter Notebook

16. Announcing the public preview of Azure Archive Blob Storage and Blob-Level Tiering

17. Azure Analysis Services web designer adds visual model editing to the preview

18. Debug Spark Code Running in Azure HDInsight from Your Desktop

19. Hortonworks extends IaaS offering on Azure with Cloudbreak

20. Announcing Azure Data Lake Store Capture Provider for Event Hubs Capture

21. Default compatibility level 140 for Azure SQL databases

22. Preview: SQL Transparent Data Encryption (TDE) with Bring Your Own Key support

23. Announcing Azure Blob storage events preview

24. Stream Processing Changes: Azure CosmosDB change feed + Apache Spark

25. Machine Learning based anomaly detection in Azure Stream Analytics

26. Announcing Default Encryption for Azure Blobs, Files, Table and Queue Storage

27. Automation of Azure Analysis Services with Service Principals and PowerShell

Microsoft Azure Data Platform – July (2017) update

August 1, 2017 Leave a comment

Powershell error – Import-Module : File AzureRM.psm1 cannot be loaded because running scripts is disabled on this system

After installing the AzureRM module, I tried to import it, but it gave me an error:

Import-Module : File C:\Program Files\WindowsPowerShell\Modules\AzureRM\4.0.2\AzureRM.psm1 cannot
be loaded because running scripts is disabled on this system. For more information, see
about_Execution_Policies at
At line:1 char:1
+ Import-Module AzureRM
+ ~~~~~~~~~~~~~~~~~~~~~
+ CategoryInfo : SecurityError: (:) [Import-Module], PSSecurityException
+ FullyQualifiedErrorId : UnauthorizedAccess,Microsoft.PowerShell.Commands.ImportModuleComman

This error means that the AzureRM module downloaded from internet must be signed by a trusted publisher before they can be run.

–> Now to fix it you need to change the execution policy by this simple command:

PS c:\> Set-ExecutionPolicy RemoteSigned

If you are on PowerShell Window then it will throw a popup to confirm to change the Execution policy, you can choose “Yes”:

Now try running again the import command, it will run:

PS c:\> Import-Module AzureRM

Powershell error – The term ‘Login-AzureRmAccount’ is not recognized as the name of a cmdlet, function, script file, or operable program

If you are new to PowerShell like me then you would have encountered this ans similar errors.

Recently while executing one PowerShell script to connect to Azure Resource Manager I faced following error:

XyzPSScript.ps1 : The term ‘Login-AzureRmAccount’ is not recognized as the name of a cmdlet, function, script file, or operable program. Check the spelling of the name, or if a path was included, verify that the path is correct and try again.
+ CategoryInfo : ObjectNotFound: (Login-AzureRmAccount:String) [XyzPSScript.ps1], CommandNotFoundException
+ FullyQualifiedErrorId : CommandNotFoundException,XyzPSScript.ps1

This error means that you do not have Azure PowerShell module installed on your system or server.

–> So, let’s see how to install the dependent modules.

1. Connect to PowerShell from command prompt (CMD) in Admin mode:

c:\> powershell.exe

Windows PowerShell
Copyright (C) 2016 Microsoft Corporation. All rights reserved.


2. Check the version of PowerShell:

PS c:\> $PSVersionTable.PSVersion

Major Minor Build Revision
—– —– —– ——–
5 1 14409 1005


3. Run the below command to check if you have PowerShellGet installed on your system:

PS c:\> Get-Module PowerShellGet -list | Select-Object Name,Version,Path

Name Version Path
—- ——- —-
PowerShellGet C:\Program Files\WindowsPowerShell\Modules\PowerShellGet\\PowerShellGet.psd1


4. Now we can easily install the Azure PowerShell from the PowerShell Gallery by runnign following command:

PS C:\> Install-Module AzureRM

NuGet provider is required to continue
PowerShellGet requires NuGet provider version ‘’ or newer to interact
with NuGet-based repositories. The NuGet provider must be available in
‘C:\Program Files\PackageManagement\ProviderAssemblies’ or
‘C:\Users\essensed\AppData\Local\PackageManagement\ProviderAssemblies’. You can
also install the NuGet provider by running ‘Install-PackageProvider -Name
NuGet -MinimumVersion -Force’. Do you want PowerShellGet to install
and import the NuGet provider now?
[Y] Yes [N] No [S] Suspend [?] Help (default is “Y”): Y

Untrusted repository
You are installing the modules from an untrusted repository. If you trust this
repository, change its InstallationPolicy value by running the Set-PSRepository
cmdlet. Are you sure you want to install the modules from ‘PSGallery’?
[Y] Yes [A] Yes to All [N] No [L] No to All [S] Suspend [?] Help
(default is “N”):Y

On every prompt type ‘Y’ to proceed ahead.

While Installing the module you will see this screen:

5. Finally you just need to import the AzureRM module:

PS C:\> Import-Module AzureRM

This import command will not give any output, and you may proceed with the PS prompt.