Open
Description
Describe the bug
'ScrapeResponse' object is not subscriptable
Ex:
Error! : 'ScrapeResponse' object is not subscriptable
Content too short or empty for https://www.globenewswire.com/news-release/2025/05/29/3090079/0/en/46-5-Bn-AI-in-Medical-Diagnostics-Market-Opportunities-and-Strategies-to-2034-Machine-Learning-and-Computer-Vision-Set-to-Transform-AI-Diagnostics-Landscape.html
Error! : 'ScrapeResponse' object is not subscriptable
Content too short or empty for https://www.linkedin.com/pulse/voice-biometric-solutions-market-outlook-innovations-pndwc
Error! : 'ScrapeResponse' object is not subscriptable
Content too short or empty for https://www.frontiersin.org/journals/digital-health/articles/10.3389/fdgth.2025.1568159/full
Error! : 'ScrapeResponse' object is not subscriptable
To Reproduce
Use the python package gpt-researcher==0.13.4 (latest release - June 1)
researcher = GPTResearcher(
query=query,
report_type=report_type,
report_source="hybrid",
source_urls=sources,
complement_source_urls=complement_sources
)
researcher.set_verbose(self.verbose)
await researcher.conduct_research()
report = await researcher.write_report()
But on looking at the logs I see a lot of the ScrapeResponse errors as mentioned above.
I have manually verified that these links are able to be scraped by Firecrawl independently.
Desktop (please complete the following information):
- OS: macOS
Metadata
Metadata
Assignees
Labels
No labels