Give a Task a URL to read
- Duale AI
- Documentation
- Web research
- Web research limits
Public Preview
Web research limits: URLs, page reads, and searches
Reference for the limits that apply to web research in Tasks, covering URL constraints, page read output, search freshness, and site restrictions.
This page covers URL requirements, page read limits, search freshness, site restrictions, and Task-level search and read constraints.
- URL length and address requirements for page reads.
- Page size, text, media, interaction, and time limits for one read.
- Recency of page copies and search results.
- Domain-based search restrictions and excluded sites.
- Search and read counts and cookie reuse within a Task.
Summaries were generated by AI.
Plan the URLs, pages, and searches of a Task around these limits.
Give a Task a URL to read
| Limit | Value | What happens | Your action |
|---|---|---|---|
| URL length | 2,048 characters | A longer URL is not read. | Give a shorter URL for the same page, such as its address without tracking parameters. |
| Address | An http or https URL on a public address, with no user name or password | A read of any other URL, such as an intranet address, ends as Blocked. | Give the Task the content another way. |
- Limit
- URL length
- Value
- 2,048 characters
- What happens
- A longer URL is not read.
- Your action
- Give a shorter URL for the same page, such as its address without tracking parameters.
- Limit
- Address
- Value
- An
httporhttpsURL on a public address, with no user name or password - What happens
- A read of any other URL, such as an intranet address, ends as Blocked.
- Your action
- Give the Task the content another way.
What one page read can return
| Limit | Value | What happens | Your action |
|---|---|---|---|
| Page or file size | 20,000,000 bytes (20 MB) for one web page or online document | The read ends as Blocked and returns no text. | Attach the file to the Task, or upload it to a Library. |
| Text of one read | 1 MiB of text (1,048,576 bytes in UTF-8) | A page or document with more text ends as Blocked and returns no text. | Give the URL of one section or chapter, or upload the document to a Library. |
| Images, video, and audio in a page | Not read | The read returns no text from them, such as text shown inside an image. | Upload the file to a Library, which reads text in images. |
| Page interaction | None: a read does not scroll, click, or fill in a form | Text that appears only after one of these actions, or long after the page loads, is missing. The read still succeeds. | Give the direct URL of the article or document. |
| Time to read one page or document | Fixed by Duale AI. A later Task deadline does not extend it. | A page that does not load in time returns no text, and the Task view shows the read as Timed out. An online document that takes too long to convert, such as a long scanned PDF, fails. | For a page, name another source. For a document, attach it or upload it to a Library. |
- Limit
- Page or file size
- Value
- 20,000,000 bytes (20 MB) for one web page or online document
- What happens
- The read ends as Blocked and returns no text.
- Your action
- Attach the file to the Task, or upload it to a Library.
- Limit
- Text of one read
- Value
- 1 MiB of text (1,048,576 bytes in UTF-8)
- What happens
- A page or document with more text ends as Blocked and returns no text.
- Your action
- Give the URL of one section or chapter, or upload the document to a Library.
- Limit
- Images, video, and audio in a page
- Value
- Not read
- What happens
- The read returns no text from them, such as text shown inside an image.
- Your action
- Upload the file to a Library, which reads text in images.
- Limit
- Page interaction
- Value
- None: a read does not scroll, click, or fill in a form
- What happens
- Text that appears only after one of these actions, or long after the page loads, is missing. The read still succeeds.
- Your action
- Give the direct URL of the article or document.
- Limit
- Time to read one page or document
- Value
- Fixed by Duale AI. A later Task deadline does not extend it.
- What happens
- A page that does not load in time returns no text, and the Task view shows the read as Timed out. An online document that takes too long to convert, such as a long scanned PDF, fails.
- Your action
- For a page, name another source. For a document, attach it or upload it to a Library.
How recent a read or a search is
| Limit | Value | What happens | Your action |
|---|---|---|---|
| Copy of a page | Any age | A read can return an earlier copy of the page. The read reports the date the page was fetched. | State in the instruction how recent each page must be, and ask for the date each page was fetched. |
| Search results | Can be a few hours old | A search can miss pages published in the last few hours. | For recent events, name the pages to read. |
| Search date range | The past day, week, month, or year | A search cannot use an exact date range, so results can fall outside the range that you need. | State the date range in the instruction, and ask for each source’s publication date. |
- Limit
- Copy of a page
- Value
- Any age
- What happens
- A read can return an earlier copy of the page. The read reports the date the page was fetched.
- Your action
- State in the instruction how recent each page must be, and ask for the date each page was fetched.
- Limit
- Search results
- Value
- Can be a few hours old
- What happens
- A search can miss pages published in the last few hours.
- Your action
- For recent events, name the pages to read.
- Limit
- Search date range
- Value
- The past day, week, month, or year
- What happens
- A search cannot use an exact date range, so results can fall outside the range that you need.
- Your action
- State the date range in the instruction, and ask for each source’s publication date.
Limit a search to sites
| Limit | Value | What happens | Your action |
|---|---|---|---|
| Sites a search can be limited to | Domain names, each with its subdomains | A search cannot be limited to a path, such as one section of a site, or to an IP address. | Name the domain. To use one section of a site, give the URLs of its pages. |
| Sites left out of search results | Known harmful, advertising, and tracking sites | These sites do not appear in search results. | Name another source. |
- Limit
- Sites a search can be limited to
- Value
- Domain names, each with its subdomains
- What happens
- A search cannot be limited to a path, such as one section of a site, or to an IP address.
- Your action
- Name the domain. To use one section of a site, give the URLs of its pages.
- Limit
- Sites left out of search results
- Value
- Known harmful, advertising, and tracking sites
- What happens
- These sites do not appear in search results.
- Your action
- Name another source.
Searches and reads in one Task
| Limit | Value | What happens | Your action |
|---|---|---|---|
| Searches and page reads | No fixed number. The Task deadline bounds them. | Searches and reads stop near the deadline, so the result can report more gaps. | Set a deadline that leaves time to read the pages, or ask a narrower question. |
- Limit
- Searches and page reads
- Value
- No fixed number. The Task deadline bounds them.
- What happens
- Searches and reads stop near the deadline, so the result can report more gaps.
- Your action
- Set a deadline that leaves time to read the pages, or ask a narrower question.
Cookies and site storage
| Limit | Value | What happens | Your action |
|---|---|---|---|
| Cookies and site storage that pages set | Reusable for 30 days after their last save, by the Tasks of one continuation chain | A later Task in the same chain can reuse them. After 30 days without a save, the next read starts without them. | None. The Privacy notice states how long Duale AI keeps them. |
- Limit
- Cookies and site storage that pages set
- Value
- Reusable for 30 days after their last save, by the Tasks of one continuation chain
- What happens
- A later Task in the same chain can reuse them. After 30 days without a save, the next read starts without them.
- Your action
- None. The Privacy notice states how long Duale AI keeps them.