-
Notifications
You must be signed in to change notification settings - Fork 501
Support multi-turn scenarios in benchmark client #907
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Merged
happyandslow
merged 18 commits into
vllm-project:main
from
happyandslow:lexu/benchmark-multiturn
Apr 7, 2025
Merged
Support multi-turn scenarios in benchmark client #907
happyandslow
merged 18 commits into
vllm-project:main
from
happyandslow:lexu/benchmark-multiturn
Apr 7, 2025
Conversation
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
3ffc5ec to
7f0f2ce
Compare
Signed-off-by: Le Xu <[email protected]>
Signed-off-by: Le Xu <[email protected]>
Signed-off-by: Le Xu <[email protected]>
Signed-off-by: Le Xu <[email protected]>
Signed-off-by: Le Xu <[email protected]>
Signed-off-by: Le Xu <[email protected]>
Signed-off-by: Le Xu <[email protected]>
Signed-off-by: Le Xu <[email protected]>
Signed-off-by: Le Xu <[email protected]>
Signed-off-by: Le Xu <[email protected]>
Signed-off-by: Le Xu <[email protected]>
Signed-off-by: Le Xu <[email protected]>
Signed-off-by: Le Xu <[email protected]>
4fd3bc4 to
2b61014
Compare
Signed-off-by: Le Xu <[email protected]>
Signed-off-by: Le Xu <[email protected]>
Signed-off-by: Le Xu <[email protected]>
Signed-off-by: Le Xu <[email protected]>
varungup90
approved these changes
Apr 4, 2025
Signed-off-by: Le Xu <[email protected]>
gangmuk
pushed a commit
to gangmuk/aibrix-gangmuk
that referenced
this pull request
Jun 21, 2025
* remove redundant file Signed-off-by: Le Xu <[email protected]> * refactor dataset Signed-off-by: Le Xu <[email protected]> * refactoring Signed-off-by: Le Xu <[email protected]> * multiturn prefix dataset with refactoring initial Signed-off-by: Le Xu <[email protected]> * refactoring Signed-off-by: Le Xu <[email protected]> * refactoring Signed-off-by: Le Xu <[email protected]> * refactoring Signed-off-by: Le Xu <[email protected]> * update output format Signed-off-by: Le Xu <[email protected]> * update README Signed-off-by: Le Xu <[email protected]> * load plain prompts and sessioned prompts for workload generator Signed-off-by: Le Xu <[email protected]> * process trace format data Signed-off-by: Le Xu <[email protected]> * sample and update workload generator for sessioned dataset Signed-off-by: Le Xu <[email protected]> * add plotting function to session id Signed-off-by: Le Xu <[email protected]> * adding client with session Signed-off-by: Le Xu <[email protected]> * fix empty dataframe error Signed-off-by: Le Xu <[email protected]> * client bug fix; adding states to client Signed-off-by: Le Xu <[email protected]> * clean up Signed-off-by: Le Xu <[email protected]> * addressing comments Signed-off-by: Le Xu <[email protected]> --------- Signed-off-by: Le Xu <[email protected]> Co-authored-by: Le Xu <[email protected]>
Yaegaki1Erika
pushed a commit
to Yaegaki1Erika/aibrix
that referenced
this pull request
Jul 23, 2025
* remove redundant file Signed-off-by: Le Xu <[email protected]> * refactor dataset Signed-off-by: Le Xu <[email protected]> * refactoring Signed-off-by: Le Xu <[email protected]> * multiturn prefix dataset with refactoring initial Signed-off-by: Le Xu <[email protected]> * refactoring Signed-off-by: Le Xu <[email protected]> * refactoring Signed-off-by: Le Xu <[email protected]> * refactoring Signed-off-by: Le Xu <[email protected]> * update output format Signed-off-by: Le Xu <[email protected]> * update README Signed-off-by: Le Xu <[email protected]> * load plain prompts and sessioned prompts for workload generator Signed-off-by: Le Xu <[email protected]> * process trace format data Signed-off-by: Le Xu <[email protected]> * sample and update workload generator for sessioned dataset Signed-off-by: Le Xu <[email protected]> * add plotting function to session id Signed-off-by: Le Xu <[email protected]> * adding client with session Signed-off-by: Le Xu <[email protected]> * fix empty dataframe error Signed-off-by: Le Xu <[email protected]> * client bug fix; adding states to client Signed-off-by: Le Xu <[email protected]> * clean up Signed-off-by: Le Xu <[email protected]> * addressing comments Signed-off-by: Le Xu <[email protected]> --------- Signed-off-by: Le Xu <[email protected]> Co-authored-by: Le Xu <[email protected]>
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
Pull Request Description
This PR aims to enable multi-turn conversation patterns in workload generator.