crawl4ai

cloud

Add: Cloud CLI module for profile management

2026-01-25 09:35:48 +00:00

components

feat(monitor): add real-time crawler monitoring system with memory management

2025-03-12 19:05:24 +08:00

crawlers

Update all documentation to import extraction strategies directly from crawl4ai.

2025-06-10 18:08:27 +08:00

deep_crawling

Add cancellation support for deep crawl strategies

2026-01-22 06:08:25 +00:00

html2text

2025 feb alpha 1 (#685 )

2025-02-19 14:13:17 +08:00

js_snippet

fix: Add a nominal wait time for remove overlay elements since it's already controllable through delay_before_return_html

2025-04-14 12:39:05 +05:30

legacy

Squashed commit of the following:

2025-08-04 19:02:01 +08:00

processors/pdf

Release/v0.7.8 (#1662 )

2025-12-11 11:04:52 +01:00

script

Add C4A-Script support and documentation

2025-06-07 23:07:19 +08:00

__init__.py

Release/v0.7.8 (#1662 )

2025-12-11 11:04:52 +01:00

__version__.py

Release v0.8.0: Crash Recovery, Prefetch Mode & Security Fixes (#1712 )

2026-01-17 14:19:15 +01:00

adaptive_crawler copy.py

feat(crawl4ai): Implement adaptive crawling feature

2025-07-04 15:16:53 +08:00

adaptive_crawler.py

Release/v0.7.8 (#1662 )

2025-12-11 11:04:52 +01:00

async_configs.py

Add set_defaults/get_defaults/reset_defaults to config classes

2026-01-31 11:44:07 +00:00

async_crawler_strategy.back.py

Release/v0.7.6 (#1556 )

2025-10-22 20:41:06 +08:00

async_crawler_strategy.py

Improve CDP connection handling

2026-01-31 11:07:26 +00:00

async_database.py

Release v0.8.0: Crash Recovery, Prefetch Mode & Security Fixes (#1712 )

2026-01-17 14:19:15 +01:00

async_dispatcher.py

Release/v0.7.6 (#1556 )

2025-10-22 20:41:06 +08:00

async_logger.py

Merge branch '2025-MAY-2' into next-MAY

2025-07-08 11:46:13 +02:00

async_url_seeder.py

Release v0.8.0: Crash Recovery, Prefetch Mode & Security Fixes (#1712 )

2026-01-17 14:19:15 +01:00

async_webcrawler.py

Fix redirected_url containing raw HTML content for raw: URLs

2026-01-20 00:45:15 +00:00

browser_adapter.py

Release/v0.7.6 (#1556 )

2025-10-22 20:41:06 +08:00

browser_manager.py

Improve CDP connection handling

2026-01-31 11:07:26 +00:00

browser_profiler.py

Fix: Keep storage_state.json in profile shrink

2026-01-26 13:06:31 +00:00

cache_context.py

Apply Ruff Corrections

2025-01-13 19:19:58 +08:00

cache_validator.py

Release v0.8.0: Crash Recovery, Prefetch Mode & Security Fixes (#1712 )

2026-01-17 14:19:15 +01:00

chunking_strategy.py

refactor(core): reorganize project structure and remove legacy code

2025-01-30 19:35:06 +08:00

cli.py

Fix: Disable cookie encryption for portable profiles

2026-01-26 12:57:17 +00:00

config.py

Refactor HTML block delimiter to use config constant

2026-01-24 04:19:50 +00:00

content_filter_strategy.py

Release/v0.7.8 (#1662 )

2025-12-11 11:04:52 +01:00

content_scraping_strategy.py

Release/v0.7.8 (#1662 )

2025-12-11 11:04:52 +01:00

docker_client.py

Release/v0.7.8 (#1662 )

2025-12-11 11:04:52 +01:00

extraction_strategy.py

Fix critical RCE via deserialization and eval() in /crawl endpoint

2026-01-30 08:46:32 +00:00

hub.py

feat(logger): add abstract logger base class and file logger implementation

2025-02-23 21:23:41 +08:00

install.py

feat: add stealth mode and enhance undetected browser support

2025-07-17 16:59:10 +08:00

link_preview.py

refactor(link_extractor): remove link_extractor and rename to link_preview

2025-06-27 21:54:22 +08:00

markdown_generation_strategy.py

feat(markdown): add content source selection for markdown generation

2025-04-17 20:13:53 +08:00

migrations.py

Apply Ruff Corrections

2025-01-13 19:19:58 +08:00

model_loader.py

Apply Ruff Corrections

2025-01-13 19:19:58 +08:00

models.py

Release v0.8.0: Crash Recovery, Prefetch Mode & Security Fixes (#1712 )

2026-01-17 14:19:15 +01:00

prompts.py

feat: add undetected browser support with adapter pattern

2025-07-14 17:29:50 +08:00

proxy_strategy.py

Release v0.8.0: Crash Recovery, Prefetch Mode & Security Fixes (#1712 )

2026-01-17 14:19:15 +01:00

ssl_certificate.py

refactor(proxy): move ProxyConfig to async_configs and improve LLM token handling

2025-04-15 22:27:18 +08:00

table_extraction.py

Release/v0.7.8 (#1662 )

2025-12-11 11:04:52 +01:00

types.py

Squashed commit of the following:

2025-08-04 19:02:01 +08:00

user_agent_generator.py

feat(browser): add BrowserProfiler class for identity-based browsing

2025-03-02 20:32:29 +08:00

utils.py

Release v0.8.0: Crash Recovery, Prefetch Mode & Security Fixes (#1712 )

2026-01-17 14:19:15 +01:00