Nitin Introduction In this blog post, we dive deep into tokenization, the very first step in preparing data for training large language models (LLMs). Tokenization is more than just splitting sentences into words—it’s about transforming raw text into a structured format that neural networks can process. We’ll build a tokenizer, encoder, and decoder from scratch in … Read more
Ever wondered how advanced AI models can tackle truly complex problems with a depth of analysis that seems to mimic human thought? The secret lies in a groundbreaking capability known as “thinking.” This fascinating development is designed to unblock key bottlenecks on the path to greater intelligence in AI. Moving Beyond Fixed Compute Historically, powerful … Read more
If you’re displaying images stored in an AWS S3 private bucket using signed URLs, you might have encountered a confusing scenario: images display perfectly in your web pages but throw CORS errors when you try to download them using JavaScript’s fetch API. Let’s break down the issue and explore a practical solution. Understanding the Problem … Read more
Introduction ComfyUI is a powerful, open-source, node-based interface for generative AI workflows, majorly for image and video workflows. While it’s primarily known for its visual interface, ComfyUI also offers robust API capabilities, enabling developers to integrate and automate workflows programmatically. This guide will walk you through using ComfyUI in API mode. ComfyUI offers a suite … Read more
Introduction If you’re involved in building software today, chances are you’re dealing with data. Lots of it. Maybe it’s user activity, sensor readings, financial transactions, or something else entirely. Martin Kleppmann’s phenomenal book, “Designing Data-Intensive Applications” (often called DDIA), is practically required reading for navigating this landscape. Let’s dive into some key takeaways from this essential … Read more
Natural Language Processing (NLP) has revolutionized the way machines understand human language. But before models can learn from text, they need a way to break it down into smaller, understandable units. This is where tokenization comes in — a critical preprocessing step that transforms raw text into a sequence of meaningful components, or tokens. 🧠 … Read more
Introduction to MCP The Model Context Protocol (MCP) is an open standard for connecting AI assistants (like large language models) to the systems where data and tools live In essence, MCP aims to bridge the gap between isolated AI models and real-world data sources – think of it as a “USB-C for AI applications”, providing … Read more
What is Signaling in WebRTC, and Why is it Needed? WebRTC allows direct peer-to-peer (P2P) communication, but before two peers can connect, they need to exchange network and media information. This process is called signaling. Signaling is needed for: WebRTC does not define a signaling protocol. Developers must implement their own using available technologies like … Read more
WebRTC (Web Real-Time Communication) is an open-source project that enables real-time communication between browsers and devices using peer-to-peer connections. It allows audio, video, and data sharing without requiring additional plugins or external software. How Does WebRTC Work? WebRTC works by establishing a direct connection between two peers (browsers or applications) to transmit media (audio/video) and … Read more
The recent release of DeepSeek R1 has generated significant buzz in the AI community. While much of the discussion has centered on its performance relative to models like OpenAI’s GPT-4 and Anthropic’s Claude, the real breakthrough lies in the underlying algorithmic innovations that make DeepSeek R1 both highly efficient and cost-effective. This post explores the … Read more
