Blogs or Expert Columns
VERIFIED REVIEW – Data Development & Management for Private Supply Company
BACKGROUND Introduce your business and what you do there. I’m the IT portfolio manager for a privately-held supply company. We distribute and process tubular goods for the oil and gas industries. OPPORTUNITY / CHALLENGE What challenges were you trying to address with ThirdEye Data? We needed help with data development and management for our company. SOLUTION What was the scope of their involvement? ThirdEye Data set up an analytics platform to create a digital replica of our organization which includes IT. This was in order to bring visibility to our current performance levels for all functions. They helped us [...]
Power of AI to the SMBs in the Times of Coronavirus
Power of AI to the SMBs in the Times of Coronavirus The Coronavirus pandemic has threatened the world and completely locked us down. There is a massive economic breakdown and chaos everywhere. Thereby, posing serious threats to SMBs. As Claire Kramer Mills, Assistant Vice President at the Federal Reserve Bank of New York puts it, "Small businesses nationwide now face unprecedented challenges as the country grapples with the significant economic and social effects of the COVID-19 pandemic.” With a rise in the graph of affected people, small stores and restaurants are struggling to survive the severe effects of this [...]
Keeping the lights on in the times of Coronavirus – ThirdEye has a plan!
Keeping the lights on in the times of Coronavirus - ThirdEye has a plan! Over the past few weeks, the word as we know it has become unrecognizable. The impact of the coronavirus, a pandemic turned global economic recession, will be felt by humankind for decades to come, and ThirdEye wants to do its part to help. Here is our action plan: First, we, at ThirdEye, pledge to donate a portion of all revenues that we generate this quarter (April to June 2020) to the Center for Disaster Philanthropy’s COVID-19 Response Fund. We will promote CDP’s events across [...]
ETL Pipeline demonstration using Apache NiFi
ETL Pipeline Demonstration Using Apache NiFi Introduction: Apache NiFi is an integrated data logistics platform for automating the movement of data between disparate systems. It provides real-time control that makes it easy to manage the movement of data between any source and any destination. It is data source agnostic, supporting disparate and distributed sources of differing formats, schemas, protocols, speeds, and sizes such as machines, geolocation devices, click streams, files, social feeds, log files and videos and more. It is configurable plumbing for moving data around, similar to how FedEx, UPS or other courier delivery services move parcels [...]
Anomaly Detection Using Apache Airflow
Anomaly Detection Using Apache Airflow Introduction: In this blog, we will discuss how to implement Outlier Detection using Airflow. Outlier detection is the process of detecting anomalies and subsequently excluding them from a given set of data. An outlier may be defined as a piece of data or observation that deviates drastically from the given norm or average of the data set. This solution process data, collected from the web servers, in a single data store. Collected data gets parsed and processed to generate the actionable insights. Airflow Workflow: Apache Airflow is an open-source tool for orchestrating complex [...]
fbProphet – Comparatve Analysis of Incremental and Normal Learning
fbProphet - Comparative Analysis of Incremental and Normal Learning This blog presents a comprehensive analysis of ‘incremental learning’ with fbProphet with different approaches. Analysis was done on data provided by one of ThirdEye’s clients. Five metrics with different patterns were picked from the data for our analysis. The main purpose of this report is to showcase how incremental learning behaves for fbProphet and how it can be beneficial in the long run. Incremental Learning (or partial fitting): In computer science, incremental learning is a method of machine learning in which input data is continuously used to extend the [...]
Semantic Search: Less Searching, More Finding.
Semantic Search: Less Searching, More Finding. The humble search engine has come a long way since its conception in the early 1990s. Yet only recently has it taken serious strides towards giving much more nuanced and relevant responses, with the help of artificial intelligence (AI) technologies machine learning (ML) and natural language processing (NLP). Incorporating the capabilities of AI into search engines creates semantic search. No longer are searches based on keywords and their dictionary definition: Semantic search means understanding the intent behind the query and representing the “knowledge in a way suitable for meaningful retrieval,” according to [...]
Deep Learning Notebooks on AzureML
"Deep Learning is a superpower. With it you can make a computer see, synthesize novel art, translate languages, render a medical diagnosis, or build pieces of a car that can drive itself. If that isn’t a superpower, I don’t know what is.” - Andrew Ng, Founder of deeplearning.ai and Coursera Deep Learning Specialization ThirdEye Data brings Deep Learning Notebooks on AzureML for the entire development community. The Deep Learning Notebooks offers a perfect platform for developers to get a grasp over vital Deep Learning topics. The Deep Learning course on Coursera is available for everyone, but ThirdEye Data [...]
Making Good Use of Artificial Intelligence Solution at the Workplace
Making Good Use of Artificial Intelligence Solution at the Workplace Internet of Things (IoT) has transformed all our daily use devices into a source of raw data to generate business insight. It is true that Artificial Intelligence solutions are making a drastic change to all the businesses in the world. To be precise, the changes are mainly being made to the data-driven companies. Influence of AI in the Business All the globally acclaimed enterprises are expected to generate more data in the coming years. Managing those data can be really tough. Therefore, we need proper big data and AI [...]
Top 3 AI Trends That’s Taking Over the Business World
Top 3 AI Trends That’s Taking Over the Business World Businesses across the spectrum are discovering the value that artificial intelligence (AI) can deliver in helping them achieve their goals. Not just a distant idea that provokes ideas of killer robots and job-taking machines, commercially applicable AI is more accessible than ever before. In fact, 37% of organizations are now implementing AI in one way or another, a number which is only set to grow as the technology develops and businesses realize its commercial potential. That’s why it’s essential to keep our fingers on the pulse of AI’s [...]
SQL Server Migration to Azure – Live show
You're invited to join the SQL Server Migration to Azure Live Show on October 14th (Part 1) and October 15th (Part 2) from 8-10AM PST. Click here to register! Part 1: Why migrate, migration options and tools Part 2: Best practices, Expert advice for SQL Server Migration to Azure We are pleased to invite you to the SQL Server Migration to Azure live show where members of Azure Data engineering, product marketing, and sales strategy teams will discuss why enterprises should migrate their on-prem databases to Azure, explore different SQL Server migration scenarios and options, and show how to [...]
Announcing TensorFlow 2.0 Beta
Announcing TensorFlow 2.0 Beta We’re delighted to announce the release of the beta of TensorFlow 2.0 today. It can be installed using: > pip install tensorflow==2.0.0-beta0 Keras as a high-level API for quick and easy model design and training Eager execution as a default for fast, intuitive development and debugging @tf.function for graph performance and portability We are already seeing how these usability improvements in the Alpha release are helping users get started, and are thrilled to see how the TensorFlow community is growing. Over 130,000 students have enrolled in the deeplearning.ai and Udacity courses that launched alongside the alpha, and the GitHub repository has [...]
Bringing together deep bioscience and AI to help patients worldwide: Novartis and Microsoft work to reinvent treatment discovery and development
Bringing together deep bioscience and AI to help patients worldwide: Novartis and Microsoft work to reinvent treatment discovery and development Oct 1, 2019 | Peter Lee - Corporate Vice President, Microsoft HealthcareIn the world of commercial research and science, there’s probably no undertaking more daunting – or more expensive – than the process of bringing a new medicine to market. For a new compound to make it from initial discovery through development, testing and clinical trials to finally earn regulatory approval can take a decade or more. Nine out of 10 promising drug candidates fail somewhere along the way. As a result, [...]
Data Analytics Service and Big Data Management – How It Benefits Your Business
Data Analytics Service and Big Data Management - How It Benefits Your Business When it is about establishing your business, you always have to look out for something that can take your business to the next level. Well, data analytics services and big data management is the present and future of the business world and it has been influencing the business world for quite a long time. Adaptation of the business is really slow. For over ten years the idea has been in the market, but the sad part is such an idea took so long to get established [...]
Six Unsupervised Extractive Text Summarization Techniques Side by Side
Six Unsupervised Extractive Text Summarization Techniques Side by Side In text summarization, we create a summary of the original content that is coherent and captures the salient points in the original content. There are various important usages of text summarization. Something we face almost every day is the text snippet that is shown in the search engine results. That snippet is essentially a summary. Our decision of whether to click on an items in the search result is largely driven by the title and the summary of the content. In this post we will go through 6 unsupervised extractive text [...]
The Public Cloud Did Not Kill Hadoop — But Complexity Could
The Public Cloud Did Not Kill Hadoop — But Complexity CouldMonte Zweben by Monte Zweben2019 has been a rocky year for the big three Hadoop distributors. From the internal optimism and external skepticism regarding the Cloudera/Hortonworks merger completing in January to MapR’s letter of impending doom in May and subsequent purchase by HPE, to Cloudera’s very bad Wednesday in June which saw a stock price collapse and the departure of Tom Reilly, the news has not been good. Perhaps the most telling piece of content comes from Cloudera’s quarterly earnings announcement that frames Hadoop’s challenge as one that needs a cloud solution:“While some customers in the [...]
DeepMind uses AI to track Serengeti wildlife with photos
DeepMind uses AI to track Serengeti wildlife with photos It should help protect fragile species from human encroachment. Jon Fingas, @jonfingas DeepMind DeepMind has joined the ranks of those using AI to save fragile wildlife populations, and it's doing that on a grand scale. The company is partnering with conservationists and ecologists on a project that uses machine learning to speedily detect and count animals in "millions" of photos taken over the past nine years in Tanzania's Serengeti National Park. Where it normally takes up to a year for volunteers to return labeled photos, DeepMind has developed a model that can label [...]
Is Staff Burnout the Best Reason to Implement Cybersecurity AI?
Is Staff Burnout the Best Reason to Implement Cybersecurity AI? By George Platsis Many in the cybersecurity workforce can’t keep up with technological change and are too busy to learn about the latest threats. Some are even so burned out that they are leaving the industry entirely. These are some of the findings of a June 2019 study by Goldsmiths, the University of London and Symantec, the results of which should not only worry those who work in the cybersecurity space, but everyone who relies on a computer to do their work. If there was ever a need to talk about integrating cybersecurity [...]
LDA Topic Modeling: An Explanation
LDA Topic Modeling: An Explanation Tyler Doll Follow Jun 25, 2018 Photo by Patrick Tomasso on Unsplash Background Topic modeling is the process of identifying topics in a set of documents. This can be useful for search engines, customer service automation, and any other instance where knowing the topics of documents is important. There are multiple methods of going about doing this, but here I will explain one: Latent Dirichlet Allocation (LDA). The Algorithm LDA is a form of unsupervised learning that views documents as bags of words (ie order does not matter). LDA works by first making a key assumption: the way [...]
Topic Modeling and Latent Dirichlet Allocation (LDA) in Python
Topic Modeling and Latent Dirichlet Allocation (LDA) in Python Susan Li Follow May 31, 2018 Photo Credit: Pixabay Topic modeling is a type of statistical modeling for discovering the abstract “topics” that occur in a collection of documents. Latent Dirichlet Allocation (LDA) is an example of topic model and is used to classify text in a document to a particular topic. It builds a topic per document model and words per topic model, modeled as Dirichlet distributions. Here we are going to apply LDA to a set of documents and split them into topics. Let’s get started! The Data The data set we’ll [...]
Cultivated data is the next Gold Rush
Cultivated data is the next Gold Rush Five years ago, Frank Meehan, my SparkLabs Global Ventures co-founder, described the goal of our seed-stage fund as follows: “The future is data. We are looking to invest in companies that are generating valuable data around usage patterns, customer behavior, company information.” It was prescient — it has guided us well over the years, but also allowed us to look at relevant startups with a critical eye. During the first three years of our fund, we would look at startups — especially in the Internet-of-Things space — that would collect millions of data points, but most companies [...]
ThirdEye Data at West Bengal Colleges for An Alluring Internship Programs
ThirdEye Data at West Bengal Colleges for An Alluring Internship Programs ThirdEye Data is a one-stop solution for data science, analytics, and engineering services and we are currently organizing a college campus intern recruitment program. Till now we have visited various colleges in West Bengal including, B.P. Poddar Institute of Management and Technology, Haldia Institute of Technology, MCKVE, Kalyani University, and Calcutta University. We received immense enthusiasm from the students about Artificial Intelligence, data science, and data engineering. We look forward to meet-up more colleges like Future Institute of Engineering and Management, Techno International, Calcutta Institute of Technology, and [...]
Huge Influence Of Machine Learning in Healthcare Sector
Huge Influence Of Machine Learning in Healthcare Sector Machine learning in healthcare is seriously making headlines and have gained immense popularity. Google developed a machine learning (ML) algorithm that can help in identifying cancerous tumors. ML is successfully making the diagnosis process easier for any disease. Advanced technology has offered a helping hand to new medical procedures and made treatment an easier process. Diabetes detection, radiology, pathology, cardiology are all taken care of by the ML. Stanford is making use of deep learning to detect skin cancer. Therefore, it is quite clear from this evidence that medical science [...]
DeepMind touts predictive healthcare AI ‘breakthrough’ trained on heavily skewed data
DeepMind, the Google-owned U.K. AI research firm, has published a research letter in the journal Nature in which it discusses the performance of a deep learning model for continuously predicting the future likelihood of a patient developing a life-threatening condition called acute kidney injury (AKI). The company says its model is able to accurately predict that a patient will develop AKI “within a clinically actionable window” up to 48 hours in advance. In a blog post trumpeting the research, DeepMind couches it as a breakthrough — saying the paper demonstrates artificial intelligence can predict “one of the leading causes of avoidable patient harm” up [...]
