---
title: "Web research limits: URLs, page reads, and searches"
description: "Reference for the limits that apply to web research in Tasks, covering URL constraints, page read output, search freshness, and site restrictions."
lang: en
status: public-preview
lastUpdated: 2026-11-11
url: https://duale.ai/en/docs/web/limits
---

## AI-generated summary

This page covers URL requirements, page read limits, search freshness, site restrictions, and Task-level search and read constraints.

- URL length and address requirements for page reads.
- Page size, text, media, interaction, and time limits for one read.
- Recency of page copies and search results.
- Domain-based search restrictions and excluded sites.
- Search and read counts and cookie reuse within a Task.

Summaries were generated by AI.

---

Plan the URLs, pages, and searches of a Task around these limits.

## Give a Task a URL to read

| Limit      | Value                                                                       | What happens                                                               | Your action                                                                                                          |
| ---------- | --------------------------------------------------------------------------- | -------------------------------------------------------------------------- | -------------------------------------------------------------------------------------------------------------------- |
| URL length | 2,048 characters                                                            | A longer URL is not read.                                                  | Give a shorter URL for the same page, such as its address without tracking parameters.                               |
| Address    | An `http` or `https` URL on a public address, with no user name or password | A read of any other URL, such as an intranet address, ends as **Blocked**. | [Give the Task the content another way](https://duale.ai/en/docs/web/page-access.md#give-a-task-the-content-of-a-page-it-cannot-read). |

## What one page read can return

| Limit                              | Value                                                        | What happens                                                                                                                                                                                | Your action                                                                                                                             |
| ---------------------------------- | ------------------------------------------------------------ | ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- | --------------------------------------------------------------------------------------------------------------------------------------- |
| Page or file size                  | 20,000,000 bytes (20 MB) for one web page or online document | The read ends as **Blocked** and returns no text.                                                                                                                                           | [Attach the file](https://duale.ai/en/docs/sdk/attachments.md) to the Task, or upload it to a [Library](https://duale.ai/en/docs/libraries/limits.md#what-one-file-can-be). |
| Text of one read                   | 1 MiB of text (1,048,576 bytes in UTF-8)                     | A page or document with more text ends as **Blocked** and returns no text.                                                                                                                  | Give the URL of one section or chapter, or upload the document to a Library.                                                            |
| Images, video, and audio in a page | Not read                                                     | The read returns no text from them, such as text shown inside an image.                                                                                                                     | Upload the file to a [Library](https://duale.ai/en/docs/libraries.md), which reads text in images.                                                        |
| Page interaction                   | None: a read does not scroll, click, or fill in a form       | Text that appears only after one of these actions, or long after the page loads, is missing. The read still succeeds.                                                                       | Give the direct URL of the article or document.                                                                                         |
| Time to read one page or document  | Fixed by Duale AI. A later Task deadline does not extend it. | A page that does not load in time returns no text, and the Task view shows the read as **Timed out**. An online document that takes too long to convert, such as a long scanned PDF, fails. | For a page, name another source. For a document, attach it or upload it to a Library.                                                   |

## How recent a read or a search is

| Limit             | Value                              | What happens                                                                                   | Your action                                                                                        |
| ----------------- | ---------------------------------- | ---------------------------------------------------------------------------------------------- | -------------------------------------------------------------------------------------------------- |
| Copy of a page    | Any age                            | A read can return an earlier copy of the page. The read reports the date the page was fetched. | State in the instruction how recent each page must be, and ask for the date each page was fetched. |
| Search results    | Can be a few hours old             | A search can miss pages published in the last few hours.                                       | For recent events, name the pages to read.                                                         |
| Search date range | The past day, week, month, or year | A search cannot use an exact date range, so results can fall outside the range that you need.  | State the date range in the instruction, and ask for each source's publication date.               |

## Limit a search to sites

| Limit                            | Value                                          | What happens                                                                              | Your action                                                                |
| -------------------------------- | ---------------------------------------------- | ----------------------------------------------------------------------------------------- | -------------------------------------------------------------------------- |
| Sites a search can be limited to | Domain names, each with its subdomains         | A search cannot be limited to a path, such as one section of a site, or to an IP address. | Name the domain. To use one section of a site, give the URLs of its pages. |
| Sites left out of search results | Known harmful, advertising, and tracking sites | These sites do not appear in search results.                                              | Name another source.                                                       |

## Searches and reads in one Task

| Limit                   | Value                                                                                                               | What happens                                                                   | Your action                                                                    |
| ----------------------- | ------------------------------------------------------------------------------------------------------------------- | ------------------------------------------------------------------------------ | ------------------------------------------------------------------------------ |
| Searches and page reads | No fixed number. The [Task deadline](https://duale.ai/en/docs/agent-harness/executors.md#use-one-deadline-for-each-task) bounds them. | Searches and reads stop near the deadline, so the result can report more gaps. | Set a deadline that leaves time to read the pages, or ask a narrower question. |

## Cookies and site storage

| Limit                                   | Value                                                                                                                                                              | What happens                                                                                                    | Your action                                                                                           |
| --------------------------------------- | ------------------------------------------------------------------------------------------------------------------------------------------------------------------ | --------------------------------------------------------------------------------------------------------------- | ----------------------------------------------------------------------------------------------------- |
| Cookies and site storage that pages set | Reusable for 30 days after their last save, by the Tasks of one [continuation chain](https://duale.ai/en/docs/agent-harness/context-continuity.md#what-a-continuation-task-inherits) | A later Task in the same chain can reuse them. After 30 days without a save, the next read starts without them. | None. The [Privacy notice](https://duale.ai/en/legal/privacy.md#retention-periods) states how long Duale AI keeps them. |

## Related content

- [Web research: how Tasks search and read public pages](https://duale.ai/en/docs/web.md)
- [Web research troubleshooting: sources, reads, deadlines](https://duale.ai/en/docs/web/troubleshooting.md)
- [Library limits: uploads, storage, processing, and retention](https://duale.ai/en/docs/libraries/limits.md)
- [What a Task can find in Libraries](https://duale.ai/en/docs/libraries/what-agents-can-do.md)
- [Page access: reading public web pages](https://duale.ai/en/docs/web/page-access.md)
- [Task limits: submission, deadlines, and continuations](https://duale.ai/en/docs/agent-harness/limits.md)

---

## Sitemap

See the full [Markdown sitemap](https://duale.ai/sitemap.md) for all pages.
