Big Data Architecture: Choose the Right Plumbing for Your Pipelines
Last week, I wrote an article about data pipelines (check it out here) covering the main characteristics of a robust and optimized build, ideally using a…
Topic
Ahead of the AI
Data Pipelines - Is Your Company's Plumbing Carrying Clean Water or Sewage?
Pipeline is an English term that can be translated into Portuguese as “tubagem” or “canalização” (piping or plumbing). In our language, the concept is used to refer to a computing architecture. These virtual pipes are created…
Big Data: On Premise vs Cloud Computing - A Market View and a Starter Study Guide
For some years now, companies all over the world have been tapping into the immense value Big Data can add to their business. Implementing Big Data ecosystems is a reality in both the global and the Brazilian market. With ever…
Databricks: The Swiss Army Knife of Your Big Data Platform
Imagine a team made up of a SQL developer, a Python professional and a Scala contributor. They all work together to ingest data into your Datalake, your Datawarehouse or simply…
Afraid of Bees? Tips and Tricks for Apache Hive
Increasingly popular and widely used, Apache Hive is a data warehouse system for Hadoop. Hive enables data summarization, querying, and analysis. Hive queries are written in HiveQL, which is a language…
Taming the Elephant - Key Hadoop Commands for Managing HDFS
In this article, I’ll walk through the main Hadoop operations for working with HDFS through shell commands. To try them out, you can run these commands on one of the VMs from Cloudera, Hortonworks, HDInsight, or…
A DW on Hadoop? How to model your Star Schema for HDFS
Over the years, data warehouses have been the main tool for company decision-making and analysis. These include conventional OLAP and ETL tools supplied by countless hardware and…
NoSQL Databases: What Do You Mean There's No Query?
Continuing the series of articles on Big Data, let’s talk a bit about non-relational databases.
What you need to know about Big Data so you don't embarrass yourself at the coffee machine?
Picture this: a director at the company you work for starts asking the following questions: