Tags

, , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , ,


NEW T-SQL FEATURES IN SQL SERVER 2016 – XIX | PolyBase

In this post we shall check out the new features Microsoft introduced in SQL Server 2016 | PolyBase

New feature – XIX | PolyBase


PolyBase is a technology that allows us to access data outside of the database via the t-sql language. We can access data from Azure Blob Storage, Hadoop and Parallel Data Warehouse.


From Microsoft – PolyBase allows you to run queries on external data in Hadoop or to import/export data from Azure Blob Storage. Queries are optimized to push computation to Hadoop. In Azure SQL Data Warehouse, you can import/export data from Azure Blob Storage and Azure Data Lake Store.


PolyBase can be used to analyze both relational data and other data that is not structured into tables —notably Hadoop. This is difficult to do unless you have a way to transfer data among the different types of data stores. PolyBase bridges this gap by operating on data that is external to SQL Server.


PolyBase does not require you to install additional software to your Hadoop environment. Querying external data uses the same syntax as querying a database table. This all happens transparently. PolyBase handles all the details behind-the-scenes, and no knowledge about Hadoop is required by the end user to query external tables.

SQL Server 2016 New Features - Polybase

SQL Server 2016 New Features – Polybase


**-From Microsoft

PolyBase can be used to –

1. Query data stored in Hadoop from SQL Server or PDW via T-SQL.
2. Query data stored in Azure Blob Storage via T-SQL.
3. Import data from Hadoop, Azure Blob Storage, or Azure Data Lake into relational DB using T-SQL. With this we do not need additionl ETL.
4. Export data to Hadoop, Azure Blob Storage, or Azure Data Lake Store.
5. For Microsoft’s business intelligence and analysis stack, or use any third party tools that are compatible with SQL Server.

PolyBase Installation

To install PolyBase please follow the instructions from below Microsoft URL.

https://docs.microsoft.com/en-us/sql/relational-databases/polybase/polybase-installation

Confirm Installation

To confirm the installation please execute the query given below and if the query returns 1 then it is installed and if it returns 0 then it is not installed.

--

SELECT SERVERPROPERTY ('IsPolybaseInstalled') AS IsPolybaseInstalled; 

--

Configure PolyBase

To configure PolyBase please refer the URL from Microsoft.

https://docs.microsoft.com/en-us/sql/relational-databases/polybase/get-started-with-polybase

Refer Microsoft LINK below for more details-

1. https://docs.microsoft.com/en-us/sql/relational-databases/polybase/get-started-with-polybase
2. https://docs.microsoft.com/en-us/sql/relational-databases/polybase/polybase-guide

Enjoy !!! Keep Learning

Pawan Khowal 

Http://MSBISkills.com