Site-specific tags are not working during multisite parallel execution

[Preethi-0207]

During multisite execution, when executing the same test suite across different sites (e.g., US, Australia..,), some testcases are only applicable to certain sites. To manage this, tags such as AU, US, and AF are used to include and exclude testcases for each site.

This works as expected during single site execution. However, when running multisite execution using Pabot with argument files, excluding a tag (e.g., AU) excludes it for all sites, rather than just the intended site. This means site-specific tags cannot be used to include or exclude testcases per site, as tags are shared across all sites during parallel execution.

Expectation:

• Site-specific tags should be supported for test case execution so that excluding a tag affects only the intended site, not all sites.
• This would allow more granular and accurate test execution across multiple sites/environments.

Note:

• This issue does not occur during single site execution, only when tests are run in parallel using Pabot with argument files.
• Please clarify if this expected Pabot behavior or a limitation.

Pabot command used:
pabot --argumentfile1 arg1.txt --argumentfile2 arg2.txt --include Smoke --exclude AU ./Tests/Test1.robot

[joonaskuisma]

Hi, try putting the --include and --exclude options inside the argument files. The options inside an argument file are process-specific, whereas the ones given on the command line are general and apply to all processes.