TraceSpec: Understanding and Improving Speculative Decoding for LLM Agents

👥 Jihao Zhao, Shuaishuai Zu, Pengfei Li et al.

#SpeculativeDecoding #AdaptiveDraftTraining #PrefixAwareScoring #AgentTrajectoryReplay

🔗 trendtoknow.com/papers/2610....