• Home
  • SQL Server
    • Articles
    • T-SQL Puzzles
    • Output Puzzles
    • Interview Questions
    • Performance Tuning
    • SQL SERVER On Linux
    • Resources
  • SSRS
    • SSRS Articles
    • Interview Questions
  • SSAS
    • SSAS Articles
    • DAX
  • SQL Puzzles
  • Interview Questions
    • SQL Interview Questions
    • Data Interview Questions
  • Python Interview Puzzles
  • New Features(SQL SERVER)
    • SQL SERVER 2017
    • SQL SERVER 2016
    • SQL SERVER On Linux
  • Social
    • Expert Exchange
      • Top Expert in SQL
      • Yearly Award
      • Certifications
      • Achievement List
      • Top Expert of the Week
    • HackerRank (SQL)
    • StackOverflow
    • About Me
      • Contact Me
      • Blog Rules

Improving my SQL BI Skills

Improving my SQL BI Skills

Daily Archives: September 2, 2015

Types of Spools in Execution Plan – Deep Dive

02 Wednesday Sep 2015

Posted by Pawan Kumar Khowal in SQL Performance Tuning

≈ Leave a comment

Tags

26 performance tuning questions and solutions, Avoid SQL Server functions in the WHERE clause for Performance, Avoid Using Function in WHERE Clause – Scan to Seek, Avoid Using Functions in WHERE Clause tutorial and example, Functions in the WHERE Clause, How to avoid convert function in the where clause, How to handle large number of insertions in SQL Server?, How to tune SQL queries, Increase SQL Server performance avoid using functions in Where Clause, Interview questions for SQL Server Performance Tuning, Looking for SQL Optimization Interview Questions, performance sql server, Performance tips for faster SQL queries, Performance Tuning, Performance Tuning for SQL Server, Query Optimization, Query Performance Tuning, Spools in Execution Plan?, Spools in SQL Server, sql - How do I avoid functions like UPPER in where clause, SQL - Spools, SQL Complex Queries, SQL Optimization Interview Questions, sql performance, sql performance and tuning, sql performance explained pdf, sql performance tips, SQL Performance Tuning, sql performance tuning and optimization, SQL Performance Tuning and Optimization - Where CTEs are stored ?, sql performance tuning interview questions, sql performance tuning tips, SQL Query Optimizer, SQL Query Tuning or Query Optimization, SQL Server 2008 Query Performance Tuning Distilled, SQL Server Interview Question - How to handle large number of insertions in SQL Server?, SQL SERVER Interview questions, SQL Server Optimization - Parallel Execution Plans, SQL server optimization interview questions and answers, sql server performance query, sql server performance slow, SQL Server Performance Tuning, SQL Server Performance Tuning Tips, SQL Server Query Optimization: Parallel Plans, SQL SERVER Tips, SQL Tuning Overview, SQL Where Clause Performance, T-SQL Best Practices - Don't Use Scalar Value Functions in Where Clause, Tips for SQL Database Tuning and Performance, Top 10 performance tuning tips for relational databases, WHERE Clause Functions: A Word of Caution, Where CTEs are stored ?</, Which one is better for performance Table Variables or Temp Tables – Only in terms of performance optimization?


Types of Spools in Execution Plan – Deep Dive

Today let’s talk about types of spools in detail. The Spool operator saves an intermediate query result to the tempdb database. Means you get all of your data in tempdb and then queries it. Query optimizer uses spools when it thinks that it’s better to put data in the temp table rather than hitting a table again and again using seeks and scans. So what it does is, it picks data from the table and saves that in the temp table as a hidden table and uses it whenever query optimizer requires it. Note – Please note that this hidden table is not same as temp table. Consider this as a hidden table (Work table) for a particular query.  I have explained spool operator in details here (https://msbiskills.com/2015/07/26/spools-in-execution-plan-are-they-bad/). Today I am going to talk about the types of spools. So the types of spools are-

1. Table Spool
2. Index Spool
3. Row Count Spool
4. Window Spool
5. Eager Spool
6. Lazy Spool

Let’s first understand each of the above spool in details and then we will proceed for examples-

Table Spool

1. Table Spool is a physical operator.

2. The Table Spool operator scans the input and places a copy of each row in a hidden spool table that is stored in the tempdb database. In tempdb it is stored as a Worktable.

3. It exists only for the lifetime of the query. If the operator is rewound (for example, by a Nested Loops operator) but no rebinding is needed, the spooled data is used instead of rescanning the input.

Index Spool

1. Index Spool is a physical operator

2. The Index Spool operator scans its input rows, placing a copy of each row in a hidden spool file (stored in the tempdb database as a worktable and existing only for the lifetime of the query)

3. After this optimizer creates a Nonclustered index on the rows. This will give the optimizer to use the seeking capability of indexes to output only those rows that satisfy the SEEK:() predicate.

4. If the operator is rewound (for example, by a Nested Loops operator) but no rebinding is needed, the spooled data is used instead of rescanning the input.

Row Count Spool

1. Row Count Spool is a physical Operator

2. The Row Count Spool operator scans the input, counting how many rows are present and returning the same number of rows without any data in them.

3. This operator is used when it is important to check for the existence of rows, rather than the data contained in the rows.

4. For example, if a Nested Loops operator performs a left semi join operation and the join predicate applies to inner input, a row count spool may be placed at the top of the inner input of the Nested Loops operator. Then the Nested Loops operator can determine how many rows are output by the row count spool (because the actual data from the inner side is not needed) to determine whether to return the outer row.

Window Spool

1. Window spool is a logical and physical operator.

2. The Window Spool operator expands each row into the set of rows that represents the window associated with it.

3. Example – In a query, the OVER clause defines the window within a query result set and a window function then computes a value for each row in the window.

4. When using the default window frame (Range Unbounded preceding) window spool operator uses an on disk worktable to process the window, but it doesn’t not spill the data to tempdb.

Eager Spool

1. Eager Spool is a logical operator.

2. The Eager Spool operator takes the entire input, storing each row in a hidden temporary object stored in the tempdb database. If the operator is rewound (for example, by a Nested Loops operator) but no rebinding is needed, the spooled data is used instead of rescanning the input.

3. If rebinding is needed, the spooled data is discarded and the spool object is rebuilt by rescanning the (rebound) input.

4. The Eager Spool operator builds its spool file in an “eager” manner: when the spool’s parent operator asks for the first row, the spool operator consumes all rows from its input operator and stores them in the spool.

Lazy Spool

1. Lazy Spool is a logical operator.

2. The Lazy Spool logical operator stores each row from its input in a hidden temporary object stored in the tempdb database.

3. If the operator is rewound (for example, by a Nested Loops operator) but no rebinding is needed, the spooled data is used instead of rescanning the input.

4. If rebinding is needed, the spooled data is discarded and the spool object is rebuilt by rescanning the (rebound) input.

5. The Lazy Spool operator builds its spool file in a “lazy” manner, that is, each time the spool’s parent operator asks for a row, the spool operator gets a row from its input operator and stores it in the spool, rather than consuming all rows at once.

Some common examples where we find these kind of spools

1. Let’s start with Table and Index Spool. We have a simple recursive CTE query of a very common business problem i.e. Manager and the employee. Check out the query below-


--

;WITH CTE(EmpName , EmpId, Level,FullyQualifiedName) AS (
     Select E.EmpName, E.EmpID, 0 Level
     , Cast('.'+E.EmpName+'.' as Varchar(MAX)) FullyQualifiedName         
     From Employees E Where E.ReportsTo IS NULL
     UNION ALL
     Select E.EmpName, E.EmpID, c.Level + 1 , c.FullyQualifiedName+'.'+E.EmpName+'.' FullyQualifiedName  
     From Employees E INNER JOIN CTE c on c.EmpID = e.ReportsTo 
)
SELECT SPACE(LEVEL*4) + H.EmpName Hierarchy,SPACE(LEVEL*4) + CAST(H.EmpID AS VARCHAR(MAX)) Hierarchy , * FROM CTE H 
ORDER BY H.FullyQualifiedName

--

Let’s go through the execution plan. Here we have 2 spool operators – Table and index spool

Pawan Khowal - Table & Index Spool

Pawan Khowal – Table & Index Spool

2. Window Spool


--

SELECT * , SUM(ID) OVER (PARTITION BY ID ORDER BY FromPoint) rnk FROM dbo.Area

--

Let’s go through the execution plan. Here we have 1 spool operator – Window Spool

Pawan Khowal - Window Spool

Pawan Khowal – Window Spool

3. Row Count Spool


--

SELECT ID, Vendor
  FROM Products 
 WHERE NOT EXISTS(SELECT 1
                    FROM Products 
                   WHERE Dates = '20050101'
                     AND Quantiy > 10)
OPTION(MAXDOP 1)
--

Let’s go through the execution plan. Here we have 1 spool operator – Row Count Spool

Pawan Khowal - Row Count

Pawan Khowal – Row Count

Cheers, Thanks for reading !

-Pawan Khowal

MSBISkills.com

Share this

  • LinkedIn
  • Facebook
  • Twitter
  • WhatsApp
  • Email

Answers to SQL Server Interview Questions – # 5

02 Wednesday Sep 2015

Posted by Pawan Kumar Khowal in Download SQL Interview Q's, SQL Server Interview Questions

≈ Leave a comment

Tags

Advanced SQL tutorial pdf, Download SQL Questions, Download SQL Server Interview Question in PDF, Download SQL SERVER Interview questions, Download SQL Server Interview questions and answers, download sql server interview questions and answers pdf, download sql server interview questions by Pawan Khowal, download sql server interview questions by Pawan Kumar, download sql server interview questions by Pawan Kumar Khowal, Download T-SQL Interview Questions, Free Download SQL SERVER Interview questions, SQL, SQL Common Interview Questions, SQL Common Interview Questions and answers, SQL FAQ, SQL FAQs, SQL Interview Q & A, SQL Interview Questions, SQL Queries asked in interviews, SQL Questions, SQL Server - General Interview Questions and Answers, SQL Server developer Interview questions and answers, SQL Server developer Interview questions with answers, SQL SERVER Indexes, SQL SERVER Interview questions, SQL SERVER Interview questions & Answers, SQL Server Interview questions and answers, SQL Server Interview Questions and Answers - Free PDF, sql server interview questions and answers for net developers, SQL SERVER Tips, SQL Tips & Tricks, SQL Tips and Tricks, SQL Tricks, T-SQL Server Interview Questions


Answers to SQL Server Interview Questions – # 5

Answers to given below for SQL Server Interview Questions – # 5. Please note that these are two the point answers, If you want any answer in detail please let me know.

1. Can we put table data and Clustered index on different file groups?

No its not possible. If a table has a clustered index, moving the clustered index to a new filegroup moves the table to that filegroup. Also note that you cannot move indexes created using a UNIQUE or PRIMARY KEY constraint using Management Studio. To move these indexes use the CREATE INDEX statement with the (DROP_EXISTING=ON) option in Transact-SQL.You require ALTER permission on the table or view. User must be a member of the sysadmin fixed server role or the db_ddladmin and db_owner fixed database roles.

2. Can we put table data and Non Clustered index on different file groups?

Yes its possible. It is usually done to get better performance.By default, indexes are stored in the same filegroup as the base table on which the index is created. By creating the nonclustered index on a different filegroup, you can achieve performance gains if the filegroups are using different physical drives with their own controllers. Data and index information can then be read in parallel by the multiple disk heads. For example, if Table_A on filegroup f1 and Index_A on filegroup f2 are both being used by the same query, performance gains can be achieved because both filegroups are being fully used without contention. However, if Table_A is scanned by the query but Index_A is not referenced, only filegroup f1 is used. This creates no performance gain. Because you cannot predict what type of access will occur and when it will occur, it could be a better decision to spread your tables and indexes across all filegroups. This would guarantee that all disks are being accessed because all data and indexes are spread evenly across all disks, regardless of which way the data is accessed. This is also a simpler approach for system administrators.

3. How many key columns you can put in a clustered index?

We can have 16 columns as key column in clustered index. It’s really that the KEY of an index can be 900 bytes OR 16 columns – whichever comes first. But, even that’s not always true. If a table has an XML column then the PK can have a maximum of 15 columns.

4. What are role playing Dimensions in analysis services?

Dimensions can be used for different purposes within the same database. One of the very common example is “Date” dimension.
We can have “Order Date” and “Order Processing Date” and “Order Delivery Date”. This is often referred to as a “role-playing dimension”. In simple words you can say that same dimension can be used for different purposes in the cube then it is called role playing dimension.

5. What are blocking and unblocking transformations? Provide me a some examples of blocking & unblocking transformations in SSIS.

Data flow transformations in SSIS use memory/buffers in different ways. The way transformation uses memory can impact the performance of your package. Transformations memory/Buffer usage are classified into 3 categories:

1.Non Blocking 2.Semi Blocking 3. Full Blocking

For details and list of blocking and non blocking transformations click here –
http://sqlchampion.com/2015/02/12/ssis-non-blocking-partially-blocking-and-full-blocking/

6. What are the ways to deploy a SSIS package?

To deploy SQL Server Integration Services packages, you use the Package Installation Wizard. By using this wizard, you can deploy packages to one of two locations:

  • To an instance of SQL Server.
  • To the file system.

To deploy packages to an instance of SQL Server

  • Open the deployment folder on the target computer.Double-click the manifest file, .SSISDeploymentManifest, to start the Package Installation Wizard. 
  • On the Deploy SSIS Packages page, select the SQL Server deployment option.
  • Optionally, select Validate packages after installation to validate packages after they are installed on the target server.
  • On the Specify Target SQL Server page, specify the instance of SQL Server to install the packages to and select an authentication mode. If you select SQL Server Authentication, you must provide a user name and a password.
  • On the Select Installation Folder page, specify the folder in the file system for the package dependencies that will be installed.
    If the package includes configurations, you can edit configurations by updating values in the Value list on the Configure Packages page. 
  • If you elected to validate packages after installation, view the validation results of the deployed packages.

To deploy packages to the file system

  • Open the deployment folder on the target computer. 
  • Double-click the manifest file, .SSISDeploymentManifest, to start the Package Installation Wizard.
  • On the Deploy SSIS Packages page, select the File system deployment option.
  • Optionally, select Validate packages after installation to validate the packages after they are installed on the target server.
  • On the Select Installation Folder page, specify the folder in which to install packages and package dependencies.
  • If the package includes configurations, you can edit updatable configurations by updating values in the Value list on the Configure Packages page.
  • If you elected to validate packages after installation, view the validation results of the deployed packages.

https://technet.microsoft.com/en-us/library/ms140117%28v=sql.105%29.aspx?f=255&MSPPError=-2147217396

7. Let’s say you have two data flows in control flow and based on some condition you want to call one data flow and based on the another you want to call another one? How can you do this?

Use Precedence constraints

Precedence constraints link executables, containers, and tasks in packages in a control flow, and specify conditions that determine whether executables run. An executable can be a For Loop, Foreach Loop, or Sequence container; a task; or an event handler. Event handlers also use precedence constraints to link their executables into a control flow.

A precedence constraint links two executables: the precedence executable and the constrained executable. The precedence executable runs before the constrained executable, and the execution result of the precedence executable may determine whether the constrained executable runs or not.

For details please visit-

https://msdn.microsoft.com/en-us/library/ms141261.aspx

8. Can you remove one of the export options that we have in SSRS for a particular user?

Export ( Rendering Extensions ) options are controlled from a configuration file called rsreportserver.config. The RSReportServer.config is located in the following folders, depending on the report server mode:

Native mode report server:
C:\Program Files\Microsoft SQL Server\MSRS12.MSSQLSERVER\Reporting Services\ReportServer

SharePoint mode report server:
C:\Program Files\Common Files\Microsoft Shared\Web Server Extensions\15\WebServices\Reporting

Directly it is not possible. You have to write custom code to achieve this. Javascript could a good solution for it. You can capture the user details at page load and based on that you can remove particular rendering option.

9. Assume you have two data sets and you want to map these two data sets to a single tablix in a SSRS report? Is it possible? If yes, how?

Use lookup. Use Lookup to retrieve the value from the specified dataset for a name/value pair where there is a 1-to-1 relationship. To retrieve multiple values for a single name or key field where there is a 1-to-many relationship, use LookupSet Function. To call Lookup for a set of values, use Multilookup Function.

10. Let’s say you have folder and inside that you have some excel files, Now you to insert these excel files into respective database tables. Now the headers of each excel is not at the top(First row), it is placed at some random location like 5th row, 10th row etc. Design a SSIS package for this.

Ya, It’s very weird kind of requirement where you need build a logic and the requirement is not fixed. In this case you can use a script task and inside that you can handle the random header issue using the .net code. Please let me know if any better way to achieve this.

Cheers, Thanks for reading !

-Pawan Khowal

MSBISkills.com

Share this

  • LinkedIn
  • Facebook
  • Twitter
  • WhatsApp
  • Email

Blog Stats

  • 1,084,784 hits

Enter your email address to follow this blog and receive notifications of new posts by email.

Join 1,131 other subscribers

Pawan Khowal

502 SQL Puzzles with answers

Achievement - 500 PuzzlesJuly 18, 2018
The big day is here. Finally presented 500+ puzzles for SQL community.

200 SQL Server Puzzle with Answers

The Big DayAugust 19, 2016
The big day is here. Completed 200 SQL Puzzles today

Archives

September 2015
M T W T F S S
 123456
78910111213
14151617181920
21222324252627
282930  
« Aug   Oct »

Top Articles

  • pawankkmr.wordpress.com/2…
  • pawankkmr.wordpress.com/2…
  • pawankkmr.wordpress.com/2…
  • pawankkmr.wordpress.com/2…
  • pawankkmr.wordpress.com/2…

Archives

  • October 2020 (29)
  • September 2018 (2)
  • August 2018 (6)
  • July 2018 (25)
  • June 2018 (22)
  • May 2018 (24)
  • April 2018 (33)
  • March 2018 (35)
  • February 2018 (53)
  • January 2018 (48)
  • December 2017 (32)
  • November 2017 (2)
  • October 2017 (20)
  • August 2017 (8)
  • June 2017 (2)
  • March 2017 (1)
  • February 2017 (18)
  • January 2017 (2)
  • December 2016 (5)
  • November 2016 (23)
  • October 2016 (2)
  • September 2016 (14)
  • August 2016 (6)
  • July 2016 (22)
  • June 2016 (27)
  • May 2016 (15)
  • April 2016 (7)
  • March 2016 (5)
  • February 2016 (7)
  • December 2015 (4)
  • October 2015 (23)
  • September 2015 (31)
  • August 2015 (14)
  • July 2015 (16)
  • June 2015 (29)
  • May 2015 (25)
  • April 2015 (44)
  • March 2015 (47)
  • November 2012 (1)
  • July 2012 (8)
  • September 2010 (26)
  • August 2010 (125)
  • July 2010 (2)

Article Categories

  • Analysis Services (6)
    • DAX (6)
  • Data (2)
    • Data warehousing (2)
  • Integration Services (2)
  • Magazines (3)
  • Python (29)
  • Reporting Services (4)
  • SQL SERVER (820)
    • Download SQL Interview Q's (212)
    • SQL Concepts (323)
    • SQL Performance Tuning (155)
    • SQL Puzzles (331)
    • SQL SERVER 2017 Linux (6)
    • SQL Server Interview Questions (308)
    • SQL SERVER Puzzles (332)
    • T SQL Puzzles (547)
    • Tricky SQL Queries (439)
  • UI (30)
    • ASP.NET (5)
    • C# (13)
    • CSS (9)
    • OOPS (3)
  • Uncategorized (5)

Recent Posts

  • Python | The Print and Divide Puzzle October 30, 2020
  • Python | Count consecutive 1’s from a list of 0’s and 1’s October 30, 2020
  • Python | How to convert a number into a list of its digits October 26, 2020
  • Python | Validate an IP Address-IPV6(Internet Protocol version 6) October 26, 2020
  • Python | Print the first non-recurring element in a list October 26, 2020
  • Python | Print the most recurring element in a list October 26, 2020
  • Python | Find the cumulative sum of elements in a list October 26, 2020
  • Python | Check a character is present in a string or not October 26, 2020
  • Python | Check whether a string is palindrome or not October 26, 2020
  • Python | Find the missing number in the array of Ints October 26, 2020
  • Python | How would you delete duplicates in a list October 26, 2020
  • Python | Check whether an array is Monotonic or not October 26, 2020
  • Python | Check whether a number is prime or not October 26, 2020
  • Python | Print list of prime numbers up to a number October 26, 2020
  • Python | Print elements from odd positions in a list October 26, 2020
  • Python | Print positions of a string present in another string October 26, 2020
  • Python | How to sort an array in ascending order October 26, 2020
  • Python | How to reverse an array October 26, 2020
  • Python | Find un-common words from two strings October 26, 2020
  • Python | How to convert a string to a list October 26, 2020
  • Python | Find unique words from a string October 26, 2020
  • Python | Calculate average word length from a string October 26, 2020
  • Python | Find common words from two strings October 26, 2020
  • Python | Find the number of times a substring present in a string October 26, 2020
  • Python | Find maximum value from a list October 26, 2020
  • Python | How to find GCF of two numbers October 26, 2020
  • Python | How to find LCM of two numbers October 26, 2020
  • Python | How to convert a list to a string October 26, 2020
  • Python | Replace NONE by its previous NON None value October 26, 2020
  • Microsoft SQL Server 2019 | Features added to SQL Server on Linux September 26, 2018

Create a website or blog at WordPress.com

  • Follow Following
    • Improving my SQL BI Skills
    • Join 231 other followers
    • Already have a WordPress.com account? Log in now.
    • Improving my SQL BI Skills
    • Customize
    • Follow Following
    • Sign up
    • Log in
    • Report this content
    • View site in Reader
    • Manage subscriptions
    • Collapse this bar
 

Loading Comments...
 

You must be logged in to post a comment.