I have been maintaining an online diary from 2019. Earlier I was using Evernote to document my life, my targets, and my frustrations. In 2023, I switched to Github. I exported all my notes to markdown and used git commits to add new entries in my life. I have been using LLMs on those markdown…
Dive into the transformative world of neural networks with this comprehensive guide on RNN, LSTM, GRU, and Attention mechanisms. Explore how these models tackle the challenges of sequence prediction, manage long-term dependencies, and revolutionize language processing tasks. This article provides intuitive explanations, detailed visualizations, and contrasts between the architectures to enhance your understanding of their practical applications.
This article covers backpropagation in detail and why it is used to train neural networks. Later, we cover how it is implemented practically in machine learning frameworks using Automatic Differentiation.
Understand the mathematical foundations and practical applications of optimizing policies directly through gradients, exploring episodic and continuous environments. The piece offers theoretical insights and proofs, illuminating complex concepts like the policy gradient theorem and function approximation.
Unsupervised representation learning (both autoregressive and autoencoding) has been highly successful in NLP. So much so that researchers are coming up with new datasets or coming up with stricter guidelines to make room for future research. RECLOR is a recent dataset that uses questions present in standardized exams like GMAT to check the logical reasoning…
Find the paper here. Paper Gist:The paper introduces Integrated Understanding System(IUS) as an effort to make better language understanding models. They argue that up until now, models have only focused on the language part and have ignored how humans understand and communicate about the world around us. The authors say, to understand the language better…
Some people are blessed with infinite mental capacity and a body that never tires. I always thought that I was such a person. I wasn’t. I treated my work as a sprint. As far as I can remember, I have always worked like that. I would get sudden jolts of motivation, set new targets and…
In this post, I talk about Peter Voss’s paper. I first read about Peter’s theory of mind approach in Chapter 1 of the Artificial General Intelligence Textbook. I talk about much of what I learn in this paper in this video. In this paper, Peter discusses about essential properties of an AGI system and the…
What do you want to do with your life? This is a question that each person asks himself/herself at some point in time. From my experience, it’s not easy to come up with an answer to that. While growing up we try to fit with our parents and the world around us. We do it…