Tag: llm
11 posts
- Hallucinate the tag, then repair it: measuring the baselines
- Sizing the guard model: why auto mode uses Sonnet, not a small classifier
- How I would design an LLM inference API in a system design interview
- Notes on inference architecture: the trade-offs don't transfer
- Reading kimi-k3-in-c: 2.8T parameters in 8GB of RAM
- The schema is the contract: structured output from protobuf to agents
- Why some AI demos resolve text instead of typing it
- The verification loop decides how many agents you can run
- Skills vs. subagents: when to use each in coding agents
- How streaming works in LLM chat and agentic systems
- How agents handle structured I/O