Data Engineering Projects

Developing end-to-end Solutions, Custom Applications, POCs, and Demos using the latest Big Data, Artificial Intelligence, Cognitive Services & Machine Learning technologies.

Technologies Used:
HDInsights, HDInsight Spark, Azure, EventHub, Azure Streaming Analytics, Azure Machine Learning, Azure Data Factory, Azure Storage, Cognitive Analytics, Data Lake Analytics, R Server, CosmosDB, Azure SQL DB, Azure Data Lake, Azure SQL Data Warehouse, Polybase, Xamarin Apps, PowerBI

Built Marketing Analytics
Link all Ad Data sets to transaction data through common identifiers and derive metrics and insights based on the linked data.

Technologies Used:
NA

Predictive Analytics Solution

Technologies Used: Amazon Redshift, Amazon Aurora, VPC, S3, Kony MobileFabric, Tibco Spotfire, Attunity CloudBeam, Trend Micro Deep Security, SoftNAS Cloud NAS

Image Quality Detection Platform

Technologies Used: TensorFlow, Google Vertex AI, Google AI Platform , Google Kubernetes Services, Azure Data Factory, Azure Function Apps, CosmosDB

MLOps Engineering

Technologies Used: Enterprise Java & Python, Apache Kafka, Apache MLFlow, MinIO, GraphDB, ElasticSearch

Data Lake Implementation and Operationalization
Inventory Optimization System

Technologies Used: Azure Cloud, Azure ML, Azure Data Factory, Azure Blobs, Azure SQL Data Warehouse, SQL DB, PowerBI, Microsoft Azure Cloud, Azure Data Factory, Azure Blob Storage, Azure SQL Server, SQL Server (on premise), Power BI, SQL Scripts, PowerShell Scripts

Data Platform + Daily Ops

Technologies Used: Amazon AWS, Amazon S3, Amazon Redshift, Amazon Glue, Amazon Lambda Functions, Python

Hadoop DW – Dev & Ops Support

Technologies Used: Cloudera Hadoop, MapReduce, Hive, Pig, HBase, Impala, SASM, Amazon Redshift, S3.

Price Optimization System

Technologies Used: Azure Cloud, Azure ML, Open Source Pricing Algorithms, Azure Data Factory, Azure Blobs, Azure SQL Data Warehouse, SQL DB, PowerBI

Automated Data Pipeline

Technologies Used:Amazon Redshift, ElasticSearch, Kibana, Apache Spark, Apache Kafka, MySQL RDBMs, Python, Java programming languages

Knowledge Management System

Technologies Used: IBM Bluemix Cloud, Watson Suite, Watson Analytics, DashDB, CloudandDB, Node.js

Anomaly Detection Platform

Technologies Used: Apache Spark, Kafka, InfluxDB, Kapacitor, TensorFlow (LSTM), fbProphet, Docker, Kubernetes, Amazon AWS Cloud

Big Data Management & Analytics

Technologies Used:Apache Hadoop, MapReduce, Hive, Pig, HBase, Apache Storm, Apache Kafka, Amazon EC2, S3.

AI Based Cyber Security Platform
NLP based Search Engine
Technologies Used: Apache Spark, Kafka, MongoDB, Datastax Cassandra, Docker, Kubernetes, Calico, Prometheus, Grafana, Helm, IBM Cloud, React, Springboot Microservices, NGINX, Solr, NLTK, Python Flask, Dockers, Kubernetes, IBM Private Cloud

Campaign Conversion Platform

Technologies Used:Apache Hadoop, MapReduce, Apache Spark, Apache Spark Machine Learning, Couchbase, Amazon EC2, S3.

Semantic Search
Technologies Used: Azure Cognitive Search, Azure Custom Skills, Open Source NLP Algorithms (NLTK), Python, Responsive HTML

Predictive Maintenance Platform
Technologies Used: Apache Spark, Apache Kafka, Apache Ignite, Hadoop HDFS, HP Vertica, App Server, Shiny R Server, D3.js

Secured Mobile Payments for Retailers

Technologies Used: Cloudera Hadoop, MapReduce, Hive, Pig, HBase, Impala, Security, Sentry, Compression, Multi tenancy, MySQL, Java, Amazon AWS.

Data Warehouse Migration

Technologies Used: Teradata

Marketing Analytics Platform

Technologies Used: Apache Hadoop, MapReduce, Hive, Pig, MySQL, Google Cloud Platform.

Data Platform Enhancements

Technologies Used: Apache Kafka, Apache Cassandra, MongoDB, SingleStore , Python, Dockers & Kubernetes, Google Cloud

Data Platform Development

Technologies Used: NA

Data Lake – Design & Setup

Technologies Used: Amazon AWS, , Amazon S3, Amazon Redshift, Amazon Glue, Amazon Kinesis, Amazon Lambda Functions, Python

Staffing Services

ThirdEye is among the handful of third-party vendors helping them in digital transformation initiatives for important positions like Senior Data Engineers, Data & Cloud Architects.

Technologies Used: NA