Skip to content

Conversation

@happyandslow
Copy link
Collaborator

@happyandslow happyandslow commented Mar 26, 2025

Pull Request Description

This PR aims to enable multi-turn conversation patterns in workload generator.

  • Refactoring
  • Sessioned dataset generation
  • Support workload generator for plain dataset and sessioned datset
  • Support sessioned/states from client
  • Client thread model fix

@happyandslow happyandslow marked this pull request as draft March 26, 2025 22:59
@happyandslow happyandslow force-pushed the lexu/benchmark-multiturn branch 2 times, most recently from 3ffc5ec to 7f0f2ce Compare April 3, 2025 05:16
@happyandslow happyandslow force-pushed the lexu/benchmark-multiturn branch from 4fd3bc4 to 2b61014 Compare April 3, 2025 18:29
@happyandslow happyandslow marked this pull request as ready for review April 4, 2025 21:26
@happyandslow happyandslow requested a review from varungup90 April 4, 2025 21:27
Signed-off-by: Le Xu <[email protected]>
@happyandslow happyandslow merged commit 0499a83 into vllm-project:main Apr 7, 2025
3 checks passed
gangmuk pushed a commit to gangmuk/aibrix-gangmuk that referenced this pull request Jun 21, 2025
* remove redundant file

Signed-off-by: Le Xu <[email protected]>

* refactor dataset

Signed-off-by: Le Xu <[email protected]>

* refactoring

Signed-off-by: Le Xu <[email protected]>

* multiturn prefix dataset with refactoring initial

Signed-off-by: Le Xu <[email protected]>

* refactoring

Signed-off-by: Le Xu <[email protected]>

* refactoring

Signed-off-by: Le Xu <[email protected]>

* refactoring

Signed-off-by: Le Xu <[email protected]>

* update output format

Signed-off-by: Le Xu <[email protected]>

* update README

Signed-off-by: Le Xu <[email protected]>

* load plain prompts and sessioned prompts for workload generator

Signed-off-by: Le Xu <[email protected]>

* process trace format data

Signed-off-by: Le Xu <[email protected]>

* sample and update workload generator for sessioned dataset

Signed-off-by: Le Xu <[email protected]>

* add plotting function to session id

Signed-off-by: Le Xu <[email protected]>

* adding client with session

Signed-off-by: Le Xu <[email protected]>

* fix empty dataframe error

Signed-off-by: Le Xu <[email protected]>

* client bug fix; adding states to client

Signed-off-by: Le Xu <[email protected]>

* clean up

Signed-off-by: Le Xu <[email protected]>

* addressing comments

Signed-off-by: Le Xu <[email protected]>

---------

Signed-off-by: Le Xu <[email protected]>
Co-authored-by: Le Xu <[email protected]>
Yaegaki1Erika pushed a commit to Yaegaki1Erika/aibrix that referenced this pull request Jul 23, 2025
* remove redundant file

Signed-off-by: Le Xu <[email protected]>

* refactor dataset

Signed-off-by: Le Xu <[email protected]>

* refactoring

Signed-off-by: Le Xu <[email protected]>

* multiturn prefix dataset with refactoring initial

Signed-off-by: Le Xu <[email protected]>

* refactoring

Signed-off-by: Le Xu <[email protected]>

* refactoring

Signed-off-by: Le Xu <[email protected]>

* refactoring

Signed-off-by: Le Xu <[email protected]>

* update output format

Signed-off-by: Le Xu <[email protected]>

* update README

Signed-off-by: Le Xu <[email protected]>

* load plain prompts and sessioned prompts for workload generator

Signed-off-by: Le Xu <[email protected]>

* process trace format data

Signed-off-by: Le Xu <[email protected]>

* sample and update workload generator for sessioned dataset

Signed-off-by: Le Xu <[email protected]>

* add plotting function to session id

Signed-off-by: Le Xu <[email protected]>

* adding client with session

Signed-off-by: Le Xu <[email protected]>

* fix empty dataframe error

Signed-off-by: Le Xu <[email protected]>

* client bug fix; adding states to client

Signed-off-by: Le Xu <[email protected]>

* clean up

Signed-off-by: Le Xu <[email protected]>

* addressing comments

Signed-off-by: Le Xu <[email protected]>

---------

Signed-off-by: Le Xu <[email protected]>
Co-authored-by: Le Xu <[email protected]>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants