Let’s quickly outline the main bullet points about the integral part of any data repository – a data catalog. A good data governance starts with the business glossary. It’s obvious that for the data to make sense first we need to define what each data element means. Methodology and choosing the approach to catalog your …
Continuing on the topic of the data storage evolution, let’s shift our focus to the data warehouses, data lakes, lakehouses and their pros and cons. History of data warehouses and data lakes Going back to the 80-ies we can recall the high level evolution of information of the storage architecture. In the 80-ies data warehouses …
Good software is always a well-designed software. Software engineering takes good thinking, reviewing past solutions and paying attention to the difficulties that we had to go through when making changes, refactoring, testing our solutions.But as we accumulate experience, we inevitably ask ourselves: do we need to reinvent the design all the time?No, of course – …
Information is knowledge, and knowledge is the key to success. Relying on one’s memory is not a very good idea – people realized it 30,000 years ago and we have witnessed evolution of the storage medium – from stones to papyrus, to paper, and then to bits and bytes. Groundwork: magnetic tapes and flat files …
When planning your cloud on-boarding it’s important to remember the differences as well as pros and cons of different clouds. This could be one of the most difficult decisions as it may translate into big savings or large bills, ease of maintenance or long weekends of imlementation… Let’s review the cloud types and outline their …
Advantages of different types of cloud, with a sprinkle of history Read More »
The public cloud adoption is changing how enterprises host and manage their database systems.With a range of Database as a Service (DBaaS) options, and public cloud providers relieved many organizations from mundane and costly database management tasks like provisioning, updates, upgrades and administration. Let’s compare database products that some of the verndors – Amazon, GCP, …
We are going to review databases, their challenges and architectural approaches. Firstly let’s revisit the CAP theorem. It states that only 2 of the 3 constraints (Consistency, Availability, Partitioning) can be guaranteed in a shared distributed data system at a time. For example, Cassandra prefers Availability and Partitioning tolerance (A-P system with Eventual consistency). You …
CAP theorem, Lambda Architecture and how to pick the right database for your application Read More »
There are many scenarios that showcase the pains organizations are going through with their data platfoms. Of course, everyone is different, but we wanted to draw your attention to just three use cases that may cover big chunk of the business landscape. Can we use our Netezza instance to store a little bit of transactional …
The challenges of the data marts and data warehouses Read More »
At the base of a solid technology team is monitoring. Monitoring is your eyes – if you don’t monitor you don’t know if your processes are running fine. In fact you don’t know if they are running at all. Plus, you don’t want to find out about the crash from your business client, right? Incident …
OLTP (Online Transactional Processing) For your daily business needs the transaction processing system stores just enough data, such as sales, accounting, inventory etc. – in other words, your routine transactions.When you couple it with appropriate external data it enables executive decision making – monitoring organization’s performance, developing strategies, and business analytics. Furthermore, coupled with business …