Let’s quickly outline the main bullet points about the integral part of any data repository – a data catalog. A good data governance starts with the business glossary. It’s obvious that for the data to make sense first we need to define what each data element means. Methodology and choosing the approach to catalog your …
Continuing on the topic of the data storage evolution, let’s shift our focus to the data warehouses, data lakes, lakehouses and their pros and cons. History of data warehouses and data lakes Going back to the 80-ies we can recall the high level evolution of information of the storage architecture. In the 80-ies data warehouses …
Information is knowledge, and knowledge is the key to success. Relying on one’s memory is not a very good idea – people realized it 30,000 years ago and we have witnessed evolution of the storage medium – from stones to papyrus, to paper, and then to bits and bytes. Groundwork: magnetic tapes and flat files …
The public cloud adoption is changing how enterprises host and manage their database systems.With a range of Database as a Service (DBaaS) options, and public cloud providers relieved many organizations from mundane and costly database management tasks like provisioning, updates, upgrades and administration. Let’s compare database products that some of the verndors – Amazon, GCP, …
There are many scenarios that showcase the pains organizations are going through with their data platfoms. Of course, everyone is different, but we wanted to draw your attention to just three use cases that may cover big chunk of the business landscape. Can we use our Netezza instance to store a little bit of transactional …
The challenges of the data marts and data warehouses Read More »
OLTP (Online Transactional Processing) For your daily business needs the transaction processing system stores just enough data, such as sales, accounting, inventory etc. – in other words, your routine transactions.When you couple it with appropriate external data it enables executive decision making – monitoring organization’s performance, developing strategies, and business analytics. Furthermore, coupled with business …
A typical question in a world of data-driven business: what do I need to do to start leveraging my data for decision making, for growth, to get ahead of competition? While each customer’s situation is different, there are some basic truths that needs to be followed i order to set up a stage for the …
How to end up with the right model, right code, proper data dictionary, clear data lineage… A quick note about a typical challenge, based on the real life experience. Let’s imagine for a minute a computer game where we go from level to level until we get to the final winning goal. One of the …
What’s the difference between data and information and when one turns into the other? One of the data challenges taht organizations have to deal with is managing what has been collected, organizing it and making it available for analysis and decision making. Like anything in the life of an organization, data has its own lifecycle, …
Both cloud vendors offer comparable solutions, let’s review them. AWS S3 / GCP Cloud Storage The basic storage is S3 in AWS and Cloud Storage in GCP. You can store petabytes of blob-like, unstructured data durably and cost-effectively. Depending on your data access patterns you can option for Nearline or Coldline in GCP or Glacier …
Cloud Data Storage options comparison on GCP and AWS Read More »