Machine Learning

HNSW Vector Search Explained: The Shortcut Graph Behind Fast Retrieval

Quick summary Navigate a layered graph: HNSW finds vector neighbours without scanning every item. Tune the trade-offs: balance recall, latency, memory and construction cost. Test real queries: filtering and search breadth affect results. Enforce permissions separately: retrieval does not establish who may access a document. HNSW vector search is one of the quiet constraints behind […]

Artificial Intelligence Software Architecture

How Jev Works: The Parallel Decision Model That Skips Token-by-Token JSON

Quick summary Target bounded decisions: Jev returns typed answers rather than free-form prose. Separate interface from speculation: the article distinguishes public behaviour from unconfirmed internals. Validate correctness: typed output still needs evaluation and calibrated thresholds. Control consequential use: log outcomes and review uncertain cases. How Jev works starts with a simple observation: most software does […]

AI Agents Software Architecture

AI Agent Evaluation in Production: Trace the Path, Verify the Outcome

Quick summary Evaluate actions and answers: polished text can hide a failed workflow. Check three surfaces: the outcome, tool-use path and final external state. Combine suitable graders: deterministic checks, rubrics and human review. Learn from failures: turn traces into regression cases and measure cost and constraints. AI agent evaluation starts with a simple reality: an […]

LLM Software Architecture

Why LLMs Pause Before They Start: Time to First Token Explained

Quick summary Separate latency measures: first-token delay differs from later token cadence and total time. Inspect preparation work: retrieval, queueing, prompt processing and networking contribute. Measure the bottleneck: avoid treating every delay as model slowness. Reduce avoidable work: bound retrieval, reuse stable prefixes and tune serving policy. Time to first token (TTFT) explains a familiar […]

Artificial Intelligence

AI Product Development: Building Is Cheaper. Judgment and Delivery Are Not.

Quick summary Faster building moves the bottleneck: more code pressures review, testing and operations. A demo is not validation: establish whether a feature solves a user problem. Connect product and delivery: plan for reliability, security and failure handling. Measure useful progress: learn from small experiments and maintain dependable delivery. AI product development has changed the […]

LangGraph

LangGraph Evaluation Tutorial: Test Multi-Agent Workflows

Quick summary Evaluate the whole graph: assess answers, routing, tool use, reliability and cost. Use deliberate test cases: cover ordinary requests, edge cases and safe failures. Compare against a baseline: combine offline tests with production feedback. Apply focused human review: use a consistent rubric where judgement matters. LangGraph evaluation turns a convincing multi-agent demo into […]

LangGraph

LangGraph Persistence Tutorial: Checkpoint and Resume Multi-Agent Workflows

Quick summary Checkpoint state: persistence lets a graph pause, recover and continue. Resume the same thread: reuse its identifier and supply the review decision. Design for replay: repeated execution must not duplicate consequential actions. Use durable storage: production needs an appropriate backend and retention policy. LangGraph persistence is what makes a multi-agent workflow safe to […]

LangGraph

LangGraph Shared State Tutorial: Control Context in Multi-Agent Systems

Quick summary Define a state contract: make field ownership, inputs and updates explicit. Separate context types: shared facts, private material and long-term memory serve different purposes. Return partial updates: use deliberate reducers instead of mutating a shared snapshot. Test data flow: verify merge behaviour and the context each worker receives. LangGraph shared state is where […]

LangGraph

LangGraph Supervisor Tutorial: Build a Multi-Agent System

Quick summary Give coordination a clear owner: a supervisor selects specialists and remains responsible for the final response. Keep workers focused: supply bounded tasks and request concise, structured results. Control the workflow in code: enforce budgets, permissions and stopping conditions outside model instructions. Start simple: introduce specialists only when separate responsibilities make the system easier […]

Artificial Intelligence

GPT-6 Astra Didn’t Break AI. It Revealed What Was Already Broken.

Quick summary Evaluate the entire trajectory: tool calls and state changes matter as much as an agent’s final answer. Budget for the whole task: repeated retrieval, retries and long-running execution change operational cost. Use layered controls: permissions, checkpoints, monitoring and recovery need deliberate ownership. Keep authority bounded: greater model capability does not replace application-level safeguards […]

Artificial Intelligence

Games with Astra: How AI Is Changing Game Development

Quick summary Start with the player experience: choose the architecture around what the user should be able to do. Use AI across a bounded workflow: define constraints, implement changes, run the game and iterate. Make tests repeatable: exercise interactions such as movement, saving and reloading to reveal regressions. Keep engineering ownership: a convincing demo still […]

Subscribe to Our Newsletter

We don’t spam! Read our privacy policy for more info.