Microsoft Azure

Microsoft’s Making A Serious Commitment To Apache Spark

microsoft hero

This week in San Francisco, thousands of people are gathering for Spark Summit, the Apache Spark developer conference. Attending the show this year, and also keynoting, is Microsoft, who is making a serious commitment to the platform to help power the company’s big data and analysis offerings.

Apache Spark is a general engine for large scale data processing that is used by more than a thousand organizations and that number will likely grow in the near future as Microsoft is announcing new support for the product.

  • Spark for Azure HDInsight General Availability, previously announced as public preview, Spark for Azure HDInsight generally available today, and introducing a fully managed Spark service from Hortonworks that has been hardened for the enterprise
  • R Server for HDInsight in the cloud powered by Spark, previously announced as public preview, R Server for HDInsight will be generally available this summer.
  • R Server for Hadoop on-premises is now powered by Spark, R Server for Hadoop will support both Microsoft R and native Spark execution frameworks available in June.
  • Power BI support for Spark Streaming, previously announced with Power BI General Availability, Spark support in Power BI is now expanded with new support for Spark Streaming scenarios.

Several years ago, announcements like this would have seen out of the ordinary for a company who has its own products that compete with Apache Spark. But, in the past couple of years, the company has been opening up its platforms to be more inclusive in the open source community and these types of announcements have become commonplace.

Sponsored Content

What is “Inside Microsoft Teams”?

“Inside Microsoft Teams” is a webcast series, now in Season 4 for IT pros hosted by Microsoft Product Manager, Stephen Rose. Stephen & his guests comprised of customers, partners, and real-world experts share best practices of planning, deploying, adopting, managing, and securing Teams. You can watch any episode at your convenience, find resources, blogs, reviews of accessories certified for Teams, bonus clips, and information regarding upcoming live broadcasts. Our next episode, “Polaris Inc., and Microsoft Teams- Reinventing how we work and play” will be airing on Oct. 28th from 10-11am PST.

While it’s a bit too early to definitively say if being more open has improved or hindered its bottom line, early indications show that the general feelings toward the company are improving and Azure is growing at a significant rate.

Related Topics:


Don't have a login but want to join the conversation? Sign up for a Petri Account

Comments (0)

Leave a Reply

Brad Sams has more than a decade of writing and publishing experience under his belt including helping to establish new and seasoned publications From breaking news about upcoming Microsoft products to telling the story of how a billion dollar brand was birthed in his book, Beneath a Surface, Brad is a well-rounded journalist who has established himself as a trusted name in the industry.
External Sharing and Guest User Access in Microsoft 365 and Teams

This eBook will dive into policy considerations you need to make when creating and managing guest user access to your Teams network, as well as the different layers of guest access and the common challenges that accompany a more complicated Microsoft 365 infrastructure.

You will learn:

  • Who should be allowed to be invited as a guest?
  • What type of guests should be able to access files in SharePoint and OneDrive?
  • How should guests be offboarded?
  • How should you determine who has access to sensitive information in your environment?

Sponsored by: