Skip to content

'ScrapeResponse' object is not subscriptable - even after updating to latest Pypi package #1423

Open
@yathaarthmagi

Description

@yathaarthmagi

Describe the bug
'ScrapeResponse' object is not subscriptable

Ex:

Error! : 'ScrapeResponse' object is not subscriptable
Content too short or empty for https://www.globenewswire.com/news-release/2025/05/29/3090079/0/en/46-5-Bn-AI-in-Medical-Diagnostics-Market-Opportunities-and-Strategies-to-2034-Machine-Learning-and-Computer-Vision-Set-to-Transform-AI-Diagnostics-Landscape.html
Error! : 'ScrapeResponse' object is not subscriptable
Content too short or empty for https://www.linkedin.com/pulse/voice-biometric-solutions-market-outlook-innovations-pndwc
Error! : 'ScrapeResponse' object is not subscriptable
Content too short or empty for https://www.frontiersin.org/journals/digital-health/articles/10.3389/fdgth.2025.1568159/full
Error! : 'ScrapeResponse' object is not subscriptable

To Reproduce
Use the python package gpt-researcher==0.13.4 (latest release - June 1)

researcher = GPTResearcher(
            query=query, 
            report_type=report_type,
            report_source="hybrid",
            source_urls=sources, 
            complement_source_urls=complement_sources
        )
        
researcher.set_verbose(self.verbose)
await researcher.conduct_research()
report = await researcher.write_report() 

But on looking at the logs I see a lot of the ScrapeResponse errors as mentioned above.
I have manually verified that these links are able to be scraped by Firecrawl independently.

Desktop (please complete the following information):

  • OS: macOS

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions