Bulk Insert, Update and Delete in Hadoop Data Lake Hadoop Data Lake, unlike traditional data warehouse, does not enforce schema on write and serves as a repository of data with different formats from various sources. If [...]
Handling Categorical Feature Variables in Machine Learning using Spark Categorical features variables i.e. features variables with fixed set of unique values appear in the training data set for many real world problems. However, categorical variables [...]
Combating High Cardinality Features in Supervised Machine Learning Typical training data set for real world machine learning problems has mixture of different types of data including numerical and categorical. Many machine learning algorithms can not [...]
In a project several years ago I built a rule engine from scratch. In a recent project, which needed a rule engine, I decided to take different route. I decided to give Drools rule engine [...]
Uber’s Big Data Platform: 100+ Petabytes with Minute Latency By Reza Shiftehfar Uber is committed to delivering safer and more reliable transportation across our global markets. To accomplish this, Uber relies heavily on making [...]
Andrew Ng launches 'AI for Everyone', a new Coursera program aimed at Business Professionals Above: Coursera cofounder Andrew Ng poses in an undated photo. Image Credit: Andrew Ng Andrew Ng, a computer scientist who [...]
Innovation continues to flow from Third Eye Consulting Services & Solutions, which just announced the release of its powerful Safera crime analysis and prediction system. Billed as a solution for “ushering in a Safe [...]
The Hybrid Cloud Market Just Got A Heck Of A Lot More Compelling Let’s start with a basic premise that the vast majority of the world’s workloads remain in private data centers. Cloud infrastructure [...]
At Netflix, the Big Data Platform team is responsible for building a reliable data analytics platform shared across the whole company. In general, Netflix product decisions are very data driven. So we play a [...]
Digital transformation is in full effect, and giants of the tech industry are investing heavily in new technologies Due to its nearly limitless potential, artificial intelligence is at the forefront of much of this [...]
