A typical question in a world of data-driven business: what do I need to do to start leveraging my data for decision making, for growth, to get ahead of competition? While each customer’s situation is different, there are some basic truths that needs to be followed i order to set up a stage for the …
How to end up with the right model, right code, proper data dictionary, clear data lineage… A quick note about a typical challenge, based on the real life experience. Let’s imagine for a minute a computer game where we go from level to level until we get to the final winning goal. One of the …
What’s the difference between data and information and when one turns into the other? One of the data challenges taht organizations have to deal with is managing what has been collected, organizing it and making it available for analysis and decision making. Like anything in the life of an organization, data has its own lifecycle, …
What are the characteristics that make a skilled data modeler? In short, it always helps not only to know technology well, but also to have experience in both working with data and understanding business side of information stored. So the first thing that an aspiring modeler needs to do is to stay very close to …
Both cloud vendors offer comparable solutions, let’s review them. AWS S3 / GCP Cloud Storage The basic storage is S3 in AWS and Cloud Storage in GCP. You can store petabytes of blob-like, unstructured data durably and cost-effectively. Depending on your data access patterns you can option for Nearline or Coldline in GCP or Glacier …
Cloud Data Storage options comparison on GCP and AWS Read More »
Let’s take a look at DMS problems from the perspective of the DW data concerns: Data Accuracy, Ease of Accessibility, Security etc. The typical problems of many organizations stem from not staying true to the primary objectives of the data storage. Many copies of the same data, with sometimes conflicting attribute values. It’s not uncommon …
What are the typical problems with data management systems? Read More »
This is a real-life example: recommendations issued to a client after review of their environments and development processes. The client had a lot ETL coded in Stored Procs and it wasn’t feasible to change that – but still some things could be improved a lot without breaking the bank or causing a revolution – as …
Real-life example: recommendations issued to a client Read More »
This is a walk-though article. Covered in this article: Git merging Git rebasing Git merging with squashing commits into one Git merging with fast forwarding commits Deleting old commits Visualizing commits When working with Git branches you need to check if your current feature branch deviated from the main branch (e.g. master) and bring those …
When using Git one inevitably find himself in a position when some work is unfinished yet you need to switch to working on a more urgent change.What do you with the code that’s work in progress? You don’t want to lose what you have started, yet it’s untested, not ready to be committed and will …
Stashing your changes in Git and pull request workflow Read More »
Covered in this article: Git cherry-picking commits from another branch Visualizing commits Cherry-picking commits from another branch Let’s say we have two branches: master and feature1, and we don’t want to merge all the feature1 commits to master, but rather cherry-pick only some of the commits.In our case, we want the second recent one – …