Blog

Back to all articles

Data Lake and Data Warehouse merging

|||

Another one trend is data lake and data warehouse combine that promotes data stack simplification. Until recent times data lake and data warehouse subsist separately. Both objects are intended to data holding. But they are not synonymous and there is a principal difference between them.

The first object is a repository for a big volume of raw data in its original form from different sources. Data can be of different types: structured, semi-structured and unstructured. Data lake is characterized by high data flexibility and availability and a big choice oh machine learning usage.

The second object is also a repository for a big volume of data. But in this case data runs processing and gets into the storage already structured strictly regulated ways. Data warehouse is characterized by less flexibility, fixed configuration and transactional analytics and BI support.

Wishing to get the best of both sides, organizations try to combine 2 variants. As a result, they have both data lake and data warehouse (sometimes several with many parallel pipelines). Today’s data storage solution providers offer more such possibilities. For example, Snowflake – its platform allows to connect data warehouse and data lake; Microsoft Synapse – its cloud warehouse has integrated capabilities of data lake.

Previous post #maindatainsfrastucturetrends 
Previous Post Next Post

Related posts

Master data: the first step for enlightment

In the last post we start discussing master data topic, what role it plays in business processes and why it is too important to manage them correctly....

Read more

DBA: proactivity or “fighting fires”?

One of the most popular requirements for a specialist and it means one of the most valuable characteristics is proactivity. A proactive employee is ch...

Read more

Master data: the main business weapon

The technologic advance gave enterprises a possibility to implement more different information systems into operational activity (staff management, cu...

Read more
GoUp Chat