Filter Bots in Google Analytics
Filter Bots in Google Analytics Data is only good as the methods you use to collect it. With Google Analytics you track everything including search bots which isn’t helpful. Search bots crawl every page [...]
Removing Duplicates from Order Data Using Spark
Removing Duplicates from Order Data Using Spark If you work with data, there is a high probability that you have run into duplicate data in your data set. Removing duplicates in Big Data is [...]
Storing Nested Objects in Cassandra with Composite Columns
Storing Nested Objects in Cassandra with Composite Columns One of the popular features of MongoDB is the ability to store arbitrarily nested objects and be able to index on any nested field. In this post I will [...]
Data Normalization with Spark
Data Normalization with Spark Data normalization is a required data preparation step for many Machine Learning algorithms. These algorithms are sensitive to the relative values of the feature attributes. Data normalization is the process of bringing all the [...]
Uber’s Big Data Platform: 100+ Petabytes with Minute Latency
Uber’s Big Data Platform: 100+ Petabytes with Minute Latency By Reza Shiftehfar Uber is committed to delivering safer and more reliable transportation across our global markets. To accomplish this, Uber relies heavily on making [...]
Web Server Logs
Web Server logs are server log files of a web server. A server log is a log file (or several files) automatically created and maintained by a server consisting of a list of activities [...]
Marmaray: An Open Source Generic Data Ingestion and Dispersal Framework and Library for Apache Hadoop
Connecting users worldwide on our platform all day, every day requires an enormous amount of data management. When you consider the hundreds of operations and data science teams analyzing large sets of anonymous, aggregated [...]
Redefine data analytics with Modern Data Warehouse on Azure
Data is more critical than ever in all aspects of modern business. As more organizations embark on digital transformation and embrace a data-driven culture, a common IT challenge is building the definitive source of [...]