[TRTLLM-16186][feat] Define backend contract for KV cache transfers - #20117

[TRTLLM-16186][feat] Define backend contract for KV cache transfers#20117

Shixiaowei02 merged 3 commits into

NVIDIA:mainNVIDIA/TensorRT-LLM:mainfrom

Shixiaowei02:dev/xiaoweis/kv-transfer-backend-contractShixiaowei02/TensorRT-LLM:dev/xiaoweis/kv-transfer-backend-contractCopy head branch name to clipboard