Error about the Async sglang

[cxxuser]

The error is:
File "verl-async/verl/workers/rollout/sglang_rollout/async_sglang_server.py", line 80, in generate
return await self.master_worker.generate.remote(prompt_ids, sampling_params, request_id)
File "/opt/conda/envs/py310/lib/python3.10/site-packages/ray/actor.py", line 1549, in getattr
raise AttributeError(
AttributeError: 'ActorHandle' object has no attribute 'generate'

which means that the master_worker doesn't have the 'generate' method. the master_worker is based the ActorRolloutRefWorker. I found that this class does not have this function. Is there something wrong with my config script? This script can be run successfully in older versions, in this old version, the generate function is not defined in the AsyncSglangServer class.

[cxxuser]

I don't think the official code will have this error of calling a non-existent function, so I wonder if there is something wrong with my config script

[wuxibin89]

@cxxuser Hi, do you use the latest main branch? sglang async server do have generate method:
https://github.com/volcengine/verl/blob/main/verl/workers/fsdp_workers.py#L1678-L1681

[wuxibin89]

Oh, I see you use megatron backend, it may be a bug.

[cxxuser]

oh, it means that there is indeed a lack of code in verl, right? Do I need to follow fsdp to implement this generate logic for the megatron backend?

[wuxibin89]

oh, it means that there is indeed a lack of code in verl, right? Do I need to follow fsdp to implement this generate logic for the megatron backend?

Fixed in #2365 , please pull the latest main branch.