Microsoft has announced that Azure Databricks, the fast, easy Apache Spark based analytics platform for Azure, is now open to general availability.
Developed in collaboration with Databricks, a provider of Apache Spark powered leading Unified Analytics Platform, Azure Databricks provides better processing of massive amounts of data on Azure public cloud.
Azure Databricks is flagship analytics platform designed by Databricks, and is offered as an integrated service within Azure platform. This platform is based on Apache Spark, used to harness the power of artificial intelligence through a unified approach to data analytics.
The integration of Spark-based cloud service and Azure cloud will help organizations to speed up innovation with one-click set-up and streamlined workflows. It will enable an interactive workspace between data scientists, data engineers, and business analysts.
“Microsoft Azure Databricks has proven to be the most efficient way for us to meet customer demand for Spark on Azure. We experienced a lot of interest and engagement in the preview from organizations in need of a high-performance analytics platform based on Spark,” said Rohan Kumar, corporate vice president, Azure Data, Microsoft Corp.
Enhancing the user productivity in development of big data apps is the primary goal of Azure Databricks. Data science teams will be able to collaborate and build AI models using top languages like Ruby, Python, Scala, and SQL. With it, they can work on all their data rather than a simple data set.
Since it is based on Apache Spark, which performs many times faster than vanilla Spark, the machine learning models can be deployed at scale. Azure Databricks is as secure as Azure, protecting data using enterprise-grade SLAs, and role-based access controls with Azure Active Directory integration.
Azure Databricks consists of all the data services on Azure, including Azure Portal, Azure Active Directory, Azure SQL Data Warehouse, Azure Cosmos DB, Azure Data Lake Store, and Microsoft Power BI.
“With Azure Databricks, deeply integrated with services like Azure SQL Data Warehouse, our customers are now positioned to increase productivity and collaboration and globally scale analytics and data science projects on a trusted, secure cloud environment,” added Rohan Kumar.
Its integration with Azure IoT Hub, Azure Event Hubs and Azure HDInsight Kafka will allow enterprises to build scalable streaming solutions for real-time analytics scenarios like fraud detection, predictive maintenance etc.
“Our collaboration with Microsoft builds on our momentum as a leading cloud platform for Apache Spark-based analytics. The ability to provide our Unified Analytics Platform to all Microsoft Azure users in such an integrated fashion is invaluable to end users looking to simplify big data and AI,” said Ali Ghodsi, co-founder and CEO of Databricks.
Announced for preview at Microsoft Connect in November 2017, Azure Databricks is now generally available.