Connect Azure Databricks to Azure Cosmos DB in Firewall enabled Environment

  by Ranjeet Singh Ahlawat Introduction Most of you are already connecting Azure Databricks to CosmosDB using SPN in firewall enabled environment. If you are one of those many, just give a like to this post and enjoy something different. But if you are trying hard and tired of trying anymore, then take a walk, drink tea/coffee and come back to read this article, as tired mind will not be achieving the solutions. Now proceed to article to solve this issue.      Understanding the Challenge: For Cyber requirement, we normally disable the public access to Azure Cosmos DB and creates a private endpoint for that. Along with that, most documentations by Microsoft or Databricks provide only Master Key as a connection method and property of SPN are hardly mentioned.   And Master Key connectivity is blocked by Admins. Now what can we do? Nothing, Ask Cyber personnel to make the connection and tells us how we should do that. That’s the best solution. But ...