Skip to content
Give a Task a URL to read
Public Preview

Web research limits: URLs, page reads, and searches

Reference for the limits that apply to web research in Tasks, covering URL constraints, page read output, search freshness, and site restrictions.

This page covers URL requirements, page read limits, search freshness, site restrictions, and Task-level search and read constraints.

  • URL length and address requirements for page reads.
  • Page size, text, media, interaction, and time limits for one read.
  • Recency of page copies and search results.
  • Domain-based search restrictions and excluded sites.
  • Search and read counts and cookie reuse within a Task.

Summaries were generated by AI.

Plan the URLs, pages, and searches of a Task around these limits.

Give a Task a URL to read

LimitValueWhat happensYour action
URL length2,048 charactersA longer URL is not read.Give a shorter URL for the same page, such as its address without tracking parameters.
AddressAn http or https URL on a public address, with no user name or passwordA read of any other URL, such as an intranet address, ends as Blocked.Give the Task the content another way.
  • Limit
    URL length
    Value
    2,048 characters
    What happens
    A longer URL is not read.
    Your action
    Give a shorter URL for the same page, such as its address without tracking parameters.
  • Limit
    Address
    Value
    An http or https URL on a public address, with no user name or password
    What happens
    A read of any other URL, such as an intranet address, ends as Blocked.

What one page read can return

LimitValueWhat happensYour action
Page or file size20,000,000 bytes (20 MB) for one web page or online documentThe read ends as Blocked and returns no text.Attach the file to the Task, or upload it to a Library.
Text of one read1 MiB of text (1,048,576 bytes in UTF-8)A page or document with more text ends as Blocked and returns no text.Give the URL of one section or chapter, or upload the document to a Library.
Images, video, and audio in a pageNot readThe read returns no text from them, such as text shown inside an image.Upload the file to a Library, which reads text in images.
Page interactionNone: a read does not scroll, click, or fill in a formText that appears only after one of these actions, or long after the page loads, is missing. The read still succeeds.Give the direct URL of the article or document.
Time to read one page or documentFixed by Duale AI. A later Task deadline does not extend it.A page that does not load in time returns no text, and the Task view shows the read as Timed out. An online document that takes too long to convert, such as a long scanned PDF, fails.For a page, name another source. For a document, attach it or upload it to a Library.
  • Limit
    Page or file size
    Value
    20,000,000 bytes (20 MB) for one web page or online document
    What happens
    The read ends as Blocked and returns no text.
    Your action
    Attach the file to the Task, or upload it to a Library.
  • Limit
    Text of one read
    Value
    1 MiB of text (1,048,576 bytes in UTF-8)
    What happens
    A page or document with more text ends as Blocked and returns no text.
    Your action
    Give the URL of one section or chapter, or upload the document to a Library.
  • Limit
    Images, video, and audio in a page
    Value
    Not read
    What happens
    The read returns no text from them, such as text shown inside an image.
    Your action
    Upload the file to a Library, which reads text in images.
  • Limit
    Page interaction
    Value
    None: a read does not scroll, click, or fill in a form
    What happens
    Text that appears only after one of these actions, or long after the page loads, is missing. The read still succeeds.
    Your action
    Give the direct URL of the article or document.
  • Limit
    Time to read one page or document
    Value
    Fixed by Duale AI. A later Task deadline does not extend it.
    What happens
    A page that does not load in time returns no text, and the Task view shows the read as Timed out. An online document that takes too long to convert, such as a long scanned PDF, fails.
    Your action
    For a page, name another source. For a document, attach it or upload it to a Library.

How recent a read or a search is

LimitValueWhat happensYour action
Copy of a pageAny ageA read can return an earlier copy of the page. The read reports the date the page was fetched.State in the instruction how recent each page must be, and ask for the date each page was fetched.
Search resultsCan be a few hours oldA search can miss pages published in the last few hours.For recent events, name the pages to read.
Search date rangeThe past day, week, month, or yearA search cannot use an exact date range, so results can fall outside the range that you need.State the date range in the instruction, and ask for each source’s publication date.
  • Limit
    Copy of a page
    Value
    Any age
    What happens
    A read can return an earlier copy of the page. The read reports the date the page was fetched.
    Your action
    State in the instruction how recent each page must be, and ask for the date each page was fetched.
  • Limit
    Search results
    Value
    Can be a few hours old
    What happens
    A search can miss pages published in the last few hours.
    Your action
    For recent events, name the pages to read.
  • Limit
    Search date range
    Value
    The past day, week, month, or year
    What happens
    A search cannot use an exact date range, so results can fall outside the range that you need.
    Your action
    State the date range in the instruction, and ask for each source’s publication date.

Limit a search to sites

LimitValueWhat happensYour action
Sites a search can be limited toDomain names, each with its subdomainsA search cannot be limited to a path, such as one section of a site, or to an IP address.Name the domain. To use one section of a site, give the URLs of its pages.
Sites left out of search resultsKnown harmful, advertising, and tracking sitesThese sites do not appear in search results.Name another source.
  • Limit
    Sites a search can be limited to
    Value
    Domain names, each with its subdomains
    What happens
    A search cannot be limited to a path, such as one section of a site, or to an IP address.
    Your action
    Name the domain. To use one section of a site, give the URLs of its pages.
  • Limit
    Sites left out of search results
    Value
    Known harmful, advertising, and tracking sites
    What happens
    These sites do not appear in search results.
    Your action
    Name another source.

Searches and reads in one Task

LimitValueWhat happensYour action
Searches and page readsNo fixed number. The Task deadline bounds them.Searches and reads stop near the deadline, so the result can report more gaps.Set a deadline that leaves time to read the pages, or ask a narrower question.
  • Limit
    Searches and page reads
    Value
    No fixed number. The Task deadline bounds them.
    What happens
    Searches and reads stop near the deadline, so the result can report more gaps.
    Your action
    Set a deadline that leaves time to read the pages, or ask a narrower question.

Cookies and site storage

LimitValueWhat happensYour action
Cookies and site storage that pages setReusable for 30 days after their last save, by the Tasks of one continuation chainA later Task in the same chain can reuse them. After 30 days without a save, the next read starts without them.None. The Privacy notice states how long Duale AI keeps them.
  • Limit
    Cookies and site storage that pages set
    Value
    Reusable for 30 days after their last save, by the Tasks of one continuation chain
    What happens
    A later Task in the same chain can reuse them. After 30 days without a save, the next read starts without them.
    Your action
    None. The Privacy notice states how long Duale AI keeps them.