Neural Network Differentiation

To differentiate the loss function in a Neural Network, there are four options Manual differentiation: It is labor intensive and often it is hard to calculate the closed form solution especially for complex function Symbolic differentiation: Like manual, it is also hard for complex function Numerical differentiation: Can handle complex function but may cause numerical […]


My OMSCS journey

I started my MS in Computer Science at Georgia Tech in Spring 2019. Since then it has been a very challenging yet rewarding journey. Let me revisit the courses every semester. Database System Design Reinforcement Learning and Decision Making (Eventually dropped) Software Architecture and Design Graduate Introduction to Operating System Information Security Machine Learning for […]