Podcasts by Category

Learn with Arjan KC - Digital Marketing Expert in Nepal

Learn with Arjan KC - Digital Marketing Expert in Nepal

Arjan KC - Digital Marketing Expert in Nepal

Learn with Arjan KC - Digital Marketing Expert in Nepal is your go-to podcast for deep dives into digital marketing, e-commerce, IT, e-governance, and beyond. Featuring recorded classes, insightful audio sessions, and discussions on topics like information systems and applications, this podcast is perfect for students, professionals, and enthusiasts eager to learn. Stay updated with the latest trends in digital marketing and technology while exploring Arjan KC's expert insights. Unlock the knowledge you need to excel in the digital age—tune in and start learning today! Got feedback? Share it!

159 - Giving Models Hands: Mastering AI Tool Calling and Actions
0:00 / 0:00
1x
  • 159 - Giving Models Hands: Mastering AI Tool Calling and Actions

    In this episode, we explore how Large Language Models move beyond pure text responses by acquiring "hands"—the ability to interact with external APIs and execute code through Function Calling. We break down the exact contract between an LLM and a server, detailing how tools are declared using JSON Schemas, requested by the model, executed in server code, and synthesized back into natural language answers.

    We also examine real-world tool implementation, including calculator functions and turning RAG semantic search into a callable tool that the AI can invoke when needed. Finally, we dive into key architecture and security patterns, covering dual endpoint routing (POST /query vs. POST /tools), setting bounded execution loops (MAX_TOOL_CALLS) to stop runaway billing cycles, and avoiding dangerous security vulnerabilities like unrestricted eval() tools.

    Sun, 20 Sep 2026 - 39min
  • 158 - Beyond the Chatbot: Building Autonomous AI Agents & Sequential Workflows

    In this episode, we explore the paradigm shift from single-prompt reactive chatbots to goal-oriented, multi-step AI agents. We unpack the core cognitive loop—Perceive, Plan, Act, Observe, and Repeat—and see how agents autonomously break down complex goals into sequential tasks. Discover how to implement chained LLM workflows in Node, manage state and memory accumulation, and apply crucial safety controls like Human-in-the-Loop (HITL) and artifact verification to stop compounding errors. Whether you are chaining basic prompts or preparing for advanced tool calling, this episode delivers the foundational engineering blueprint for agentic systems.

    Sat, 19 Sep 2026 - 51min
  • 157 - AI-Assisted Software Engineering: Using AI as a Development Partner, Not a Replacement

    How do you stay in control of your codebase when AI can write your code for you? In this episode, we explore the profound shift in the software engineering paradigm—moving from being a simple "code typist" to acting as an architect and director. While AI tools are incredible at eliminating boilerplate and pattern-matching training data, they do not build "mental models" or understand the deep, architectural "why" behind your system.We dive into the dangerous trap of "vibe coding" and blindly clicking the generate button. Over-reliance on auto-generated code without active comprehension leads to "knowledge debt"—segments of your codebase that work but lack a corresponding mental theory in any developer's mind, eventually risking what computer scientist Peter Naur called "the death of a program".To combat this, we outline practical, real-world strategies to transform your relationship with AI:

    The AI-Assisted Navigator: Why treating your AI editor as "the world’s best grep tool" to understand and navigate codebase structures is far more valuable than letting it write entire features.High-Context Prompting: How to move away from "clever incantations" and instead supply the exact language versions, framework constraints, and behavior requirements your AI teammate needs.The "Evaluate-Refine" Cycle: Establishing a strict, non-negotiable review workflow that treats AI-generated code as a confident but fallible first draft requiring rigorous human review for logic, security, and edge cases.The Personal Mentor: Transforming your IDE sidebar into a tireless senior developer to explain inherited legacy modules, generate unit tests, and patiently teach you complex concepts without judgment.

    Whether you are a software developer, technical lead, or engineering manager, this episode will equip you with the frameworks to responsibly harness AI as a force multiplier while maintaining the critical human judgment that can never be replaced.

    Sat, 29 Aug 2026 - 54min
  • 156 - Context Engineering: Designing the data that feeds the AI

    Context Engineering: Designing the data that feeds the AI is a deep-dive podcast series exploring the architectural control plane that powers modern agentic AI systems. Moving far beyond basic prompt engineering, this show untangles how data engineers and AI developers design, structure, and govern the runtime payloads that models consume to execute reliable, real-world workflows.If this podcast were created directly from your notebook's sources, its episode or series description would highlight the following core themes:

    The Shift Beyond RAG: While Retrieval-Augmented Generation (RAG) solved basic grounding problems, mature AI systems require much more. Listeners will explore why retrieval alone is insufficient for autonomous agents that must coordinate APIs, track conversation history, preserve user preferences, and execute multi-step decisions safely.The Physics of LLM Working Memory: The show tackles the hard physical and economic constraints of language models—including token window limitations, latency, and the quadratic cost of context bloat. Episodes will break down the infamous "Lost in the Middle" phenomenon, detailing how models suffer severe performance drops and fail to retrieve critical information when it is buried in the center of long prompts.The Context Stack Framework: A guide through the five operational layers that define production-grade context: Retrieval (grounding), Memory (continuity), Tools (live APIs), Orchestration (handoffs), and Governance (access control and cost tracing).Cutting-Edge Implementations: Real-world architectural blueprints are put under the microscope. The show reviews frameworks like Cisco’s HYVE (Hybrid Views), which uses request-scoped SQL datastores to dynamically generate space-saving columnar and row-oriented views, alongside AIGNE's Agentic File System (AFS), which treats memory, tools, and human-in-the-loop overrides as structured files mounted onto a virtual file system.A New Engineering Discipline: Why prompt design is ultimately downstream of context design. The series details why the future of AI economics and reliability depends not on the largest models, but on the teams that engineer the highest-signal, lowest-noise data pipelines.

    This podcast serves as an essential guide for any developer, data architect, or tech leader looking to transition their AI applications from fragile, prompt-padded prototypes into robust, governed, and highly efficient digital collaborators.

    Sat, 29 Aug 2026 - 1h 05min
  • 155 - Prompting & Structured Outputs: Controlling LLM behavior and enforcing data schemas

    In this episode of Prompting & Structured Outputs, we explore how the artificial intelligence industry transitioned from the "Wild West" of raw prompt engineering—where developers simply crossed their fingers and hoped for valid JSON—to the modern paradigm of mathematical constraints. We trace the evolution of structured data generation, analyzing why early solutions like standard JSON Mode only guaranteed syntactically valid outputs but still permitted hallucinated schemas and missing keys.

    Discover the core mechanics of constrained decoding, a technique that converts JSON schemas into finite state machines (FSMs) or context-free grammars (CFGs) to actively mask out invalid logits during token generation—making structural failures physically impossible. We also demystify the open-source and proprietary tooling landscape, comparing schema-driven engines like Outlines and Instructor with high-performance serving frameworks and compilers like SGLang and Guidance.

    Listeners will learn how to navigate critical trade-offs, particularly why a flawless format guarantee does not equate to semantic accuracy. We break down why strict schemas can actually degrade a model's multi-step reasoning performance, and how a hybrid pattern of free-form reasoning scratchpads can preserve chain-of-thought while securing the final structured payload. Finally, we peer into the future of LLM control, discussing how these deterministic guardrails are expanding to local model deployments and even discrete diffusion language models.

    Whether you are building production-grade agents or optimizing local inference pipelines, this episode provides the definitive architectural blueprint for forcing structure from probabilistic AI.

    Thu, 27 Aug 2026 - 26min
Show More Episodes