Skip to content

Add agent based AI tool recommendation#21661

Merged
guerler merged 4 commits intogalaxyproject:devfrom
dannon:agent-based-ai-tool-rec
Jan 27, 2026
Merged

Add agent based AI tool recommendation#21661
guerler merged 4 commits intogalaxyproject:devfrom
dannon:agent-based-ai-tool-rec

Conversation

@dannon
Copy link
Copy Markdown
Member

@dannon dannon commented Jan 26, 2026

Add tool recommendation agent for Galaxy tool discovery

Adds a specialized agent that helps users find appropriate Galaxy tools for their bioinformatics tasks. The router now delegates tool discovery queries ("what tool should I use for X?") to this agent.

This is a fairly naive approach that we'd pulled out of the original branch, and I'm putting it back now to build on and improve. @qchiujunhao and @anuprulez have some focused work that can use this as a base to build on.

Features

  • Tool search integration - Searches Galaxy's toolbox using the existing toolbox_search infrastructure
  • Fast path for exact matches - Bypasses LLM when user asks for a tool by exact name
  • Tool verification - Only recommends tools that are actually installed on the server
  • Detailed tool info - Can fetch input/output formats, version, and requirements for better recommendations
  • Category browsing - Lists available tool panel sections to help users explore

(it'd be fine to get this into 26.0 if we want, or it can wait)

New agent that helps users find appropriate Galaxy tools for their tasks.
Uses Galaxy's toolbox search to find installed tools and provides
recommendations with confidence levels and reasoning.

Features:
- Searches Galaxy toolbox for matching tools
- Fast path for exact tool name matches (bypasses LLM)
- Structured output for models that support it
- Text parsing fallback for DeepSeek and similar models
- Tool existence verification before suggesting actions
The router now delegates tool discovery questions to the
ToolRecommendationAgent, which searches the actual Galaxy toolbox
to find installed tools rather than relying on the LLM's training data.
Added two new tools the LLM can call:
- get_galaxy_tool_details(tool_id) - fetches inputs, outputs, version, requirements
- get_galaxy_tool_categories() - lists available tool panel sections

Also removed unused category parameter from search_tools().
@dannon dannon marked this pull request as ready for review January 26, 2026 18:33
@github-actions github-actions Bot added this to the 26.1 milestone Jan 26, 2026
@dannon dannon force-pushed the agent-based-ai-tool-rec branch from 9b1beec to f47f63a Compare January 26, 2026 19:51
@dannon dannon modified the milestones: 26.1, 26.0 Jan 27, 2026
@guerler guerler merged commit c139bad into galaxyproject:dev Jan 27, 2026
56 of 58 checks passed
@guerler guerler added the highlight Included in user-facing release notes at the top label Jan 27, 2026
@anuprulez
Copy link
Copy Markdown
Member

Thanks @dannon. Junhao and I discussed to improve the tool recommendations. Currently, I have been working to extract help text information for each tool, transforming these text into dense embeddings (using sentence transformers). Computing similarity of tools based on embedded help text can provide alternative tools / recommendations in addition to those procured from GTN tutorials. https://github.com/anuprulez/galaxy-tool-recommendation-agent-benchmark

@dannon
Copy link
Copy Markdown
Member Author

dannon commented Jan 27, 2026

@anuprulez Awesome, looking forward to it!

@ahmedhamidawan ahmedhamidawan changed the title Agent based ai tool rec Add agent based AI tool recommendation Jan 27, 2026
@guerler guerler added the release-testing-26.0 PRs marked for testing for the 26.0 release and issues stemming from release testing label Jan 29, 2026
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

area/backend highlight Included in user-facing release notes at the top kind/feature release-testing-26.0 PRs marked for testing for the 26.0 release and issues stemming from release testing

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants