Big Data

CAP theorem, Lambda Architecture and how to pick the right database for your application

We are going to review databases, their challenges and architectural approaches. Firstly let’s revisit the CAP theorem. It states that only 2 of the 3 constraints (Consistency, Availability, Partitioning) can be guaranteed in a shared distributed data system at a time. For example, Cassandra prefers Availability and Partitioning tolerance (A-P system with Eventual consistency). You …

CAP theorem, Lambda Architecture and how to pick the right database for your application Read More »

The challenges of the data marts and data warehouses

There are many scenarios that showcase the pains organizations are going through with their data platfoms. Of course, everyone is different, but we wanted to draw your attention to just three use cases that may cover big chunk of the business landscape. Can we use our Netezza instance to store a little bit of transactional …

The challenges of the data marts and data warehouses Read More »

Cloud Data Storage options comparison on GCP and AWS

Both cloud vendors offer comparable solutions, let’s review them. AWS S3 / GCP Cloud Storage The basic storage is S3 in AWS and Cloud Storage in GCP. You can store petabytes of blob-like, unstructured data durably and cost-effectively. Depending on your data access patterns you can option for Nearline or Coldline in GCP or Glacier …

Cloud Data Storage options comparison on GCP and AWS Read More »