Book Notes: Handbook of Sikh Theology
My notes from the book 'Handbook of Sikh Theology' ...
RNN, LSTM, GRU and Attention
Dive into the transformative world of neural networks with this comprehensive guide on RNN, LSTM, GRU, and Attention mechanisms. Explore how these models tackle the challenges of sequence prediction, manage long-term dependencies, and revolutionize language processing tasks. This article provides intuitive explanations, detailed visualizations, and contrasts between the architectures to ...
Backpropagation and Automatic Differentiation
This article covers backpropagation in detail and why it is used to train neural networks. Later, we cover how it is implemented practically in machine learning frameworks using Automatic Differentiation ...
Policy Gradient Methods
Understand the mathematical foundations and practical applications of optimizing policies directly through gradients, exploring episodic and continuous environments. The piece offers theoretical insights and proofs, illuminating complex concepts like the policy gradient theorem and function approximation ...
What is missing from current NLU systems?
Unsupervised representation learning (both autoregressive and autoencoding) has been highly successful in NLP. So much so that researchers are coming up with new datasets or coming up with stricter guidelines to make room for future research. RECLOR is a recent dataset that uses questions present in standardized exams like GMAT ...
Paper Review: Extending Machine Language Models toward Human-Level Language Understanding
Find the paper here. Paper Gist:The paper introduces Integrated Understanding System(IUS) as an effort to make better language understanding models. They argue that up until now, models have only focused on the language part and have ignored how humans understand and communicate about the world around us. The authors say, ...
Let’s talk about stress
Some people are blessed with infinite mental capacity and a body that never tires. I always thought that I was such a person. I wasn't. I treated my work as a sprint. As far as I can remember, I have always worked like that. I would get sudden jolts of ...
Paper Review: Essentials of General Intelligence: The Direct Path to Artificial General Intelligence
In this post, I talk about Peter Voss's paper. I first read about Peter's theory of mind approach in Chapter 1 of the Artificial General Intelligence Textbook. I talk about much of what I learn in this paper in this video. In this paper, Peter discusses about essential properties of ...
How to find your purpose?
What do you want to do with your life? This is a question that each person asks himself/herself at some point in time. From my experience, it’s not easy to come up with an answer to that. While growing up we try to fit with our parents and the world ...