ayrisdev/crawl4ai
1
0
Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity

Set memory_wait_timeout default to 10 minutes

Browse Source
This commit is contained in:
UncleCode
2025-06-08 07:52:21 +02:00
parent 8b215e17af
commit c8456d8a01
4 changed files with 46 additions and 13 deletions
Download Patch File Download Diff File Expand all files Collapse all files

2
docs/md_v2/advanced/multi-url-crawling.md
View File

@@ -172,7 +172,7 @@ dispatcher = MemoryAdaptiveDispatcher(
3. **`max_session_permit`** (`int`, default: `10`)
  The maximum number of concurrent crawling tasks allowed. This ensures resource limits are respected while maintaining concurrency.
4. **`memory_wait_timeout`** (`float`, default: `300.0`)
4. **`memory_wait_timeout`** (`float`, default: `600.0`)
  Optional timeout (in seconds). If memory usage exceeds `memory_threshold_percent` for longer than this duration, a `MemoryError` is raised.
5. **`rate_limiter`** (`RateLimiter`, default: `None`)

2
docs/md_v2/assets/llmtxt/crawl4ai_all_reasoning_content.llm.txt
View File

@@ -6732,7 +6732,7 @@ dispatcher = MemoryAdaptiveDispatcher(
3. **`max_session_permit`** (`int`, default: `10`)
  The maximum number of concurrent crawling tasks allowed. This ensures resource limits are respected while maintaining concurrency.
4. **`memory_wait_timeout`** (`float`, default: `300.0`)
4. **`memory_wait_timeout`** (`float`, default: `600.0`)
  Optional timeout (in seconds). If memory usage exceeds `memory_threshold_percent` for longer than this duration, a `MemoryError` is raised.
5. **`rate_limiter`** (`RateLimiter`, default: `None`)