Your company has assigned you the task of choosing the right batch processing solution from Azure for your new product. There are certain capabilities which you are looking for. They are Auto-scaling capability
In-memory caching for data
Azure AD based authentication
Which of the following services is the best choice?
 

Answer options:

A.Azure Data Lake Analytics
B.Azure Synapse
C.HDInsight with Spark
D.HDInsight with Hive
E.Azure DataBricks

Correct Answer: E 
Here we should compare the abilities and eliminate the ones without those capabilities in the list. Azure Data Lake Analytics and Azure Synapse don`t have the auto-scaling capability. And In -memory caching ability is not available for HDInsight with Hive. Finally, HDInsight with Spark doesn’t support Azure AD authentication. So, Azure databricks is a suitable choice here. Options A and Bare incorrect: Azure Data Lake Analytics and Azure Synapse don`t have the auto-scaling capability.
Option C is incorrect: HDInsight with Spark doesn’t support Azure AD authentication.
Option D is incorrect: In-memory caching ability is not available for HDInsight with Hive.
Option E is correct: It has all the capabilities listed.
Reference: 
To know more, please refer to the docs below: 

https://docs.microsoft.com/en-us/azure/architecture/data-guide/technology-choices/batch-processing#capabilities