• Home
  • SQL Server
    • Articles
    • T-SQL Puzzles
    • Output Puzzles
    • Interview Questions
    • Performance Tuning
    • SQL SERVER On Linux
    • Resources
  • SSRS
    • SSRS Articles
    • Interview Questions
  • SSAS
    • SSAS Articles
    • DAX
  • SQL Puzzles
  • Interview Questions
    • SQL Interview Questions
    • Data Interview Questions
  • Python Interview Puzzles
  • New Features(SQL SERVER)
    • SQL SERVER 2017
    • SQL SERVER 2016
    • SQL SERVER On Linux
  • Social
    • Expert Exchange
      • Top Expert in SQL
      • Yearly Award
      • Certifications
      • Achievement List
      • Top Expert of the Week
    • HackerRank (SQL)
    • StackOverflow
    • About Me
      • Contact Me
      • Blog Rules

Improving my SQL BI Skills

Improving my SQL BI Skills

Category Archives: Data warehousing

Data Interview Question | What are the differences between a Data Warehouse and a Data Hub?

09 Wednesday May 2018

Posted by Pawan Kumar Khowal in Data, Data warehousing, SQL Server Interview Questions

≈ Leave a comment


Data Interview Question | What are the differences between a Data Warehouse and a Data Hub?

In the traditional data warehouse, data is extracted from transactional system and then transformed into the required format and then it is loaded another system for analysis or other business purposes. In an enterprise data hub model, however, data is first loaded into the Hadoop platform, and then analytics and data mining tools are applied to the data where it resides in the hub.

Major points of differences are (from Datavail)

1. Flexibility of adding New Sources

EDW lacks flexibility due to the difficulty in adding new data sources. But this is not the case with the modern EDH, which can connect multiple databases, data warehouses, and other systems. This is achieved on the fly, as quickly as the data can be captured, integrating the diverse data types from multiple sources to reveal relationships.

2. Up-to date data – No Delays

In the world of data warehousing, speed, cost, and value are of paramount importance. With traditional EDW, data can be out of date by days which may affect the day-to-day Business Intelligence (BI) processes. A modern data hub overcomes this problem by presenting fresh data that is readily available for analysis as soon as it is captured. It responds to queries in near real time, and one can immediately start getting analytic value from it.

3. Ability to handle Complex Queries

In traditional EDW, we are typically limited by how our data architect operates in terms of what source of query one can ask and how flexible it is. However, a modern data hub offers a rich set of tools for processing and analyzing data. It can directly query semi-structured data on large volumes of unknown value, including JSON, CSE, XML, and essentially anything you can scan into these modern data sources.

4. Rapid Deployment and Cost Effectiveness

EDH can be deployed in a matter of days or weeks in contrast to the traditional EDW that may take days, weeks, months, and even years to deploy a sole system. Being able to connect directly to the data has made it much simpler to implement and run EDH at a very low cost. It has also made it cost-effective to run data-driven experiments and analysis over unlimited data.

An EDH is an ideal companion to an EDW because, in addition to its storage and processing benefits, it helps alleviate some of the primary challenges that face an EDW. When deployed alongside common EDW infrastructure, an EDH helps streamline data integration processing by offloading data transformations and improving performance, thus reducing costs.

References-

• https://en.wikipedia.org/wiki/Data_hub
• https://searchcio.techtarget.com/definition/enterprise-data-hub
• https://en.wikipedia.org/wiki/Data_warehouse
• https://www.techopedia.com/definition/1184/data-warehouse-dw
• https://www.datavail.com/blog/data-warehouse-vs-data-hub/

Enjoy 🙂

Please add comment(s) if you have one or multiple solutions in mind. Thank You.

Pawan Khowal

Pawan is a SQL Server Developer. If you need any help in writing code/puzzle or training please email at – pawankkmr”AT”gmail.com. Meanwhile please go throgh the top pages from his blog.

Page Detail URL
☛ SQL Advance Puzzles https://msbiskills.com/tsql-puzzles-asked-in-interview-over-the-years/
☛ SQL Tricky Queries https://msbiskills.com/sql-puzzles-finding-outputs/
☛ SQL Server Perfomance tuning Articles https://msbiskills.com/sql-performance-tuning/
☛ SQL Server Articles https://msbiskills.com/t-sql/
☛ SQL Interview Questions & Answers https://msbiskills.com/sql-server-interview-questions/

My SQL Groups on Facebook:

1. If you like this post, you may want to join my SQL SERVER Interview Puzzles/Interview Questions on Facebook: https://www.facebook.com/groups/1430882120556342/

2. If you like this post, you may want to join my SQL Server Puzzles on Facebook:
https://www.facebook.com/groups/206594023090781/

My SQL Page on Facebook:

2. For all the updates you may follow my page -> https://www.facebook.com/MSBISkillscom-1602779883299222/

Enjoy !!! Keep Learning

Http://MsbiSkills.com

Share this

  • LinkedIn
  • Facebook
  • Twitter
  • WhatsApp
  • Email

Data Interview Question | What is a Data hub ?

30 Monday Apr 2018

Posted by Pawan Kumar Khowal in Data, Data warehousing, Download SQL Interview Q's, SQL SERVER, SQL Server Interview Questions

≈ Leave a comment


Data Interview Question | What is a Data hub ?

Hello Friends, Last month I recieved an email from one of my reader saying why you are not write on data related questions. I replied saying that I shall start soon. Today is a very good day to start the data related question. I shall also cover the BIG Data as well as data warehousing question. Now the category I am using these kind of questions as data interview questions. So today lets start with the data hub.

What is a data hub?-

A data hub basically is a collection of data (consider this as Big Data Management) from multiple sources. It uses a Hadoop platform as the central data repository. The idea of an data hub is to provide an organization with a centralized data source that can quickly provide users with the information they need.

The data distribution normally happens in the form of a hub and spoke architecture. The spoke-hub distribution paradigm is a form of transport topology optimization in which traffic routes are organized as a series of ‘spokes’ that connect outlying points to a central ‘hub.’

Enterprise data hubs are designed to address the challenge of data that is ballooning in volume, variety and velocity (3Vs). This term is largely associated with Cloudera and MapR.

Data Hub notes-
1. Data from all the sources data is moved to one place.
2. Data is (at least partially) harmonized as it is moved.
3. Data is indexed in the harmonized form for efficient access and analysis.

Data hubs products avaible are-

1. Apache Hadoop
2. Avoiding Mass Extinctions Engine
3. CKAN
4. DataHub
5. DataMarket
6. Dataverse
7. DSpace
8. MarkLogic
9. OpenDataSoft
10. Quandl
11. QuickCode
12. Socrata

References-

https://en.wikipedia.org/wiki/Data_hub
https://en.wikipedia.org/wiki/Spoke%E2%80%93hub_distribution_paradigm
https://searchcio.techtarget.com/definition/enterprise-data-hub
https://www.marklogic.com/blog/data-lakes-data-hubs-federation-one-best/

Enjoy 🙂

Please add comment(s) if you have one or multiple solutions in mind. Thank You.

Pawan Khowal

Pawan is a SQL Server Developer. If you need any help in writing code/puzzle or training please email at – pawankkmr”AT”gmail.com. Meanwhile please go throgh the top pages from his blog.

Page Detail URL
☛ SQL Advance Puzzles https://msbiskills.com/tsql-puzzles-asked-in-interview-over-the-years/
☛ SQL Tricky Queries https://msbiskills.com/sql-puzzles-finding-outputs/
☛ SQL Server Perfomance tuning Articles https://msbiskills.com/sql-performance-tuning/
☛ SQL Server Articles https://msbiskills.com/t-sql/
☛ SQL Interview Questions & Answers https://msbiskills.com/sql-server-interview-questions/

My SQL Groups on Facebook:

1. If you like this post, you may want to join my SQL SERVER Interview Puzzles/Interview Questions on Facebook: https://www.facebook.com/groups/1430882120556342/

2. If you like this post, you may want to join my SQL Server Puzzles on Facebook:
https://www.facebook.com/groups/206594023090781/

My SQL Page on Facebook:

2. For all the updates you may follow my page -> https://www.facebook.com/MSBISkillscom-1602779883299222/

Enjoy !!! Keep Learning

Http://MsbiSkills.com

Share this

  • LinkedIn
  • Facebook
  • Twitter
  • WhatsApp
  • Email

Blog Stats

  • 1,084,774 hits

Enter your email address to follow this blog and receive notifications of new posts by email.

Join 1,131 other subscribers

Pawan Khowal

502 SQL Puzzles with answers

Achievement - 500 PuzzlesJuly 18, 2018
The big day is here. Finally presented 500+ puzzles for SQL community.

200 SQL Server Puzzle with Answers

The Big DayAugust 19, 2016
The big day is here. Completed 200 SQL Puzzles today

Archives

March 2023
M T W T F S S
 12345
6789101112
13141516171819
20212223242526
2728293031  
« Oct    

Top Articles

  • pawankkmr.wordpress.com/2…
  • pawankkmr.wordpress.com/2…
  • pawankkmr.wordpress.com/2…
  • pawankkmr.wordpress.com/2…
  • pawankkmr.wordpress.com/2…

Archives

  • October 2020 (29)
  • September 2018 (2)
  • August 2018 (6)
  • July 2018 (25)
  • June 2018 (22)
  • May 2018 (24)
  • April 2018 (33)
  • March 2018 (35)
  • February 2018 (53)
  • January 2018 (48)
  • December 2017 (32)
  • November 2017 (2)
  • October 2017 (20)
  • August 2017 (8)
  • June 2017 (2)
  • March 2017 (1)
  • February 2017 (18)
  • January 2017 (2)
  • December 2016 (5)
  • November 2016 (23)
  • October 2016 (2)
  • September 2016 (14)
  • August 2016 (6)
  • July 2016 (22)
  • June 2016 (27)
  • May 2016 (15)
  • April 2016 (7)
  • March 2016 (5)
  • February 2016 (7)
  • December 2015 (4)
  • October 2015 (23)
  • September 2015 (31)
  • August 2015 (14)
  • July 2015 (16)
  • June 2015 (29)
  • May 2015 (25)
  • April 2015 (44)
  • March 2015 (47)
  • November 2012 (1)
  • July 2012 (8)
  • September 2010 (26)
  • August 2010 (125)
  • July 2010 (2)

Article Categories

  • Analysis Services (6)
    • DAX (6)
  • Data (2)
    • Data warehousing (2)
  • Integration Services (2)
  • Magazines (3)
  • Python (29)
  • Reporting Services (4)
  • SQL SERVER (820)
    • Download SQL Interview Q's (212)
    • SQL Concepts (323)
    • SQL Performance Tuning (155)
    • SQL Puzzles (331)
    • SQL SERVER 2017 Linux (6)
    • SQL Server Interview Questions (308)
    • SQL SERVER Puzzles (332)
    • T SQL Puzzles (547)
    • Tricky SQL Queries (439)
  • UI (30)
    • ASP.NET (5)
    • C# (13)
    • CSS (9)
    • OOPS (3)
  • Uncategorized (5)

Recent Posts

  • Python | The Print and Divide Puzzle October 30, 2020
  • Python | Count consecutive 1’s from a list of 0’s and 1’s October 30, 2020
  • Python | How to convert a number into a list of its digits October 26, 2020
  • Python | Validate an IP Address-IPV6(Internet Protocol version 6) October 26, 2020
  • Python | Print the first non-recurring element in a list October 26, 2020
  • Python | Print the most recurring element in a list October 26, 2020
  • Python | Find the cumulative sum of elements in a list October 26, 2020
  • Python | Check a character is present in a string or not October 26, 2020
  • Python | Check whether a string is palindrome or not October 26, 2020
  • Python | Find the missing number in the array of Ints October 26, 2020
  • Python | How would you delete duplicates in a list October 26, 2020
  • Python | Check whether an array is Monotonic or not October 26, 2020
  • Python | Check whether a number is prime or not October 26, 2020
  • Python | Print list of prime numbers up to a number October 26, 2020
  • Python | Print elements from odd positions in a list October 26, 2020
  • Python | Print positions of a string present in another string October 26, 2020
  • Python | How to sort an array in ascending order October 26, 2020
  • Python | How to reverse an array October 26, 2020
  • Python | Find un-common words from two strings October 26, 2020
  • Python | How to convert a string to a list October 26, 2020
  • Python | Find unique words from a string October 26, 2020
  • Python | Calculate average word length from a string October 26, 2020
  • Python | Find common words from two strings October 26, 2020
  • Python | Find the number of times a substring present in a string October 26, 2020
  • Python | Find maximum value from a list October 26, 2020
  • Python | How to find GCF of two numbers October 26, 2020
  • Python | How to find LCM of two numbers October 26, 2020
  • Python | How to convert a list to a string October 26, 2020
  • Python | Replace NONE by its previous NON None value October 26, 2020
  • Microsoft SQL Server 2019 | Features added to SQL Server on Linux September 26, 2018

Create a website or blog at WordPress.com

  • Follow Following
    • Improving my SQL BI Skills
    • Join 231 other followers
    • Already have a WordPress.com account? Log in now.
    • Improving my SQL BI Skills
    • Customize
    • Follow Following
    • Sign up
    • Log in
    • Report this content
    • View site in Reader
    • Manage subscriptions
    • Collapse this bar