Nitin Introduction TF-IDF (Term Frequency-Inverse Document Frequency) is a statistical measure used to evaluate the importance of a word in a document relative to a collection of documents (corpus). It combines two metrics: Term Frequency (TF) and Inverse Document Frequency (IDF). The TF-IDF value increases proportionally with the number of times a word appears in the … Read more
Introduction The latest Ollama update makes it easier than ever to run quantized GGUF models directly from Hugging Face on your local machine. With a single command, you can bypass previous limitations, no longer needing a separate model on the Ollama Model Hub. Step-by-Step Guide 1. Install Ollama 2. Select a Model from Hugging Face … Read more
Introduction OpenAI has launched a groundbreaking new feature for ChatGPT: SearchGPT. This innovative tool blends the conversational nature of a chatbot with the vast resources of the internet, potentially changing the way we search for information forever. With SearchGPT, users can ask questions in natural language and receive concise answers, complete with links to relevant … Read more
NotebookLM: An AI-Powered Research Assistant NotebookLM is a research assistant powered by Google’s Gemini 1.5 Pro model. It’s centred around the idea of using sources and then leveraging the power of Gemini to interact with and learn from them. Here are some of the key features that make NotebookLM such a powerful tool: 1. Versatile … Read more
Tokenization is a fundamental yet often misunderstood process in the realm of large language models (LLMs). Despite its crucial role, it is a part of working with LLMs that many find daunting due to its complexity and the numerous challenges it introduces. In this blog post, we will explore the concept of tokenization, its importance … Read more
For part 1 refer to this: Unveiling the Secrets Behind ChatGPT – Part 1 (learncodecamp.net) Implementing a Bigram Language Model When diving into the world of natural language processing (NLP) and language modeling, starting with a simple baseline model is essential. It helps establish a foundation to build upon. One of the simplest and most … Read more
Introduction Hello everyone! By now, you’ve likely heard of ChatGPT, the revolutionary AI system that has taken the world and the AI community by storm. This remarkable technology allows you to interact with an AI through text-based tasks. The Technology Behind ChatGPT: Transformers The neural network that powers ChatGPT is based on the Transformer architecture, … Read more
Introduction This blog post dives into the fascinating world of computer vision, exploring how we can teach machines to “see” using convolutional neural networks (CNNs). This post is based on a lecture from MIT’s 6.S191: Introduction to Deep Learning course. What Does it Mean to “See”? Before diving into the technical details, let’s define “vision”. … Read more
Introduction In the world of software development, the ability to build and deploy applications across different architectures is invaluable. This capability becomes particularly essential when dealing with ARM-based applications such as those for embedded systems or newer ARM-based servers. In this blog post, we will explore how to build ARM64 Docker container images on an … Read more
Introduction Intelligence: The ability to process information and use it for future decision-making. Artificial Intelligence (AI): Empowering computers with the ability to process information and make decisions. Machine Learning (ML): A subset of AI focused on teaching computers to learn from data. Deep Learning (DL): A subset of ML utilizing neural networks to process raw … Read more
