Skip to content

fix prefix caching#307

Open
yao-fengchen wants to merge 11 commits intoDeepLink-org:mainfrom
yao-fengchen:prefix_caching
Open

fix prefix caching#307
yao-fengchen wants to merge 11 commits intoDeepLink-org:mainfrom
yao-fengchen:prefix_caching

Conversation

@yao-fengchen
Copy link
Copy Markdown
Contributor

No description provided.

@jinminxi104
Copy link
Copy Markdown
Collaborator

add a testcase to ci, for testing mixed prefill_with_kvcache and prefill_with_kvcache. (ex: chunked prefill size = 2k; 3 prompts length are 3k,0.2k, 0.2k

@yao-fengchen yao-fengchen force-pushed the prefix_caching branch 3 times, most recently from eaf3f41 to 097bba2 Compare April 3, 2026 07:37
@yao-fengchen yao-fengchen force-pushed the prefix_caching branch 5 times, most recently from 3df11b4 to 5e9d4ca Compare April 7, 2026 02:23
This reverts commit 3e97b81.
@CLAassistant
Copy link
Copy Markdown

CLA assistant check
Thank you for your submission! We really appreciate it. Like many open source projects, we ask that you all sign our Contributor License Agreement before we can accept your contribution.
1 out of 2 committers have signed the CLA.

✅ yao-fengchen
❌ root


root seems not to be a GitHub user. You need a GitHub account to be able to sign the CLA. If you have already a GitHub account, please add the email address used for this commit to your account.
You have signed the CLA already but the status is still pending? Let us recheck it.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants