ayrisdev/crawl4ai
1
0
Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity

Set memory_wait_timeout default to 10 minutes (#1193)

Browse Source
This commit is contained in:
UncleCode
2025-06-08 07:53:09 +02:00
parent ef6f4329fa
commit c73a130c50
4 changed files with 7753 additions and 12 deletions
Download Patch File Download Diff File Expand all files Collapse all files

2
docs/md_v2/advanced/multi-url-crawling.md
View File

@@ -172,7 +172,7 @@ dispatcher = MemoryAdaptiveDispatcher(
3. **`max_session_permit`** (`int`, default: `10`)
  The maximum number of concurrent crawling tasks allowed. This ensures resource limits are respected while maintaining concurrency.
4. **`memory_wait_timeout`** (`float`, default: `300.0`)
4. **`memory_wait_timeout`** (`float`, default: `600.0`)
  Optional timeout (in seconds). If memory usage exceeds `memory_threshold_percent` for longer than this duration, a `MemoryError` is raised.
5. **`rate_limiter`** (`RateLimiter`, default: `None`)

7708
docs/md_v2/assets/llmtxt/crawl4ai_all_reasoning_content.llm.txt Normal file
View File

File diff suppressed because it is too large Load Diff