Insights

Engineering Insights

Thoughts on AI infrastructure, CTV development, and production engineering.

2026-07-14AI Architecture

Architecture of Hermes: Building a Production AI Agent Framework

How we built an AI agent framework with intent routing, MCP integration, and a 600K+ node knowledge graph - including lessons learned from deploying on Intel Arc GPUs.

2026-07-10CTV Development

Achieving Feature Parity Across 6 CTV Platforms

Challenges and solutions for maintaining feature parity across Roku, FireTV, Android TV, Tizen, webOS, and Vizio - from shared components to platform-specific CI/CD.

2026-07-12GPU Inference

vLLM on Intel Arc Pro B70: Benchmarks, Optimizations, and Gotchas

Deploying vLLM with tensor parallelism across 4 Intel Arc GPUs - prefill benchmarks, KV cache management, NVFP4 quantization results, and the --entrypoint /bin/bash gotcha.