Posting some great resources to understand the Transformer architecture for NLP presented in the paper “Attention is All You Need” (Vaswani et al. 2017). This website by J Al-Ammar is excellent Second, read this article called “Attention! Attention!” by Lilian Weng For further background on Word Embeddings, look into this post by Jason Brownlee.
Category: Data Science
Categories
SQL Notes for Data Science
SQL is one of the most widely used programming language but yet it remains too much undervalued. Here is some quick SQL query snippets for refreshing the memory. Introductory Concepts Optional: Learn about FOREIGN KEY and PRIMARY KEY and the different Database Normalization types from this Wikipedia page. Probably you will need only up to […]
Image Classification: Class distribution per image Semantic Segmentation: Class distribution per pixel Instance Segmentation: Class distribution per pixel with unique ID Object Detection: List of bounding boxes with Class distribution per box
Convolution layer for CNN is explained in simple words
To differentiate the loss function in a Neural Network, there are four options Manual differentiation: It is labor intensive and often it is hard to calculate the closed form solution especially for complex function Symbolic differentiation: Like manual, it is also hard for complex function Numerical differentiation: Can handle complex function but may cause numerical […]
There are many flavors of games in Game Theory which are interesting from Machine Learning perspectives, especially from multi-agent Reinforcement Learning applications. Here is the summary of multiple game types are if MinMax algorithm works and what type of strategy one needs to employ.
Entropy is the fundamental unit of information in Information Theory and is extensively useful in Machine Learning. Let us introduce the concepts: Entropy, Joint Entropy, Mutual Information.
This is the recommended template for a Project Proposal for a freelance Machine Learning project. This is my personal choice, and definitely depending on project requirements, you might need to explicitly modify change/modify/add to this list. One size does not always fit all for Machine Learning projects. But anyway this could be a good starting point.
Quick introduction to basic Reinforcement Learning algorithms including Bellman Equation, Policy Iteration, Value Iteration, and Q-Learning
Collection of useful tips when working with Big Data tools including Hadoop, Hive, Spark