ayrisdev/crawl4ai
1
0
Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity
Files
21e6c418be4f58c3bf309d0257cb61dbdecca94e
crawl4ai/crawl4ai
History
unclecode 21e6c418be Fix: Keep storage_state.json in profile shrink 
- Add storage_state.json to all KEEP_PATTERNS levels
- This file contains unencrypted cookies in Playwright format
- Critical for cross-machine profile portability (local -> cloud)
2026-01-26 13:06:31 +00:00
..
cloud
Add: Cloud CLI module for profile management
2026-01-25 09:35:48 +00:00
components
feat(monitor): add real-time crawler monitoring system with memory management
2025-03-12 19:05:24 +08:00
crawlers
Update all documentation to import extraction strategies directly from crawl4ai.
2025-06-10 18:08:27 +08:00
deep_crawling
Add cancellation support for deep crawl strategies
2026-01-22 06:08:25 +00:00
html2text
2025 feb alpha 1 (#685)
2025-02-19 14:13:17 +08:00
js_snippet
fix: Add a nominal wait time for remove overlay elements since it's already controllable through delay_before_return_html
2025-04-14 12:39:05 +05:30
legacy
Squashed commit of the following:
2025-08-04 19:02:01 +08:00
processors/pdf
Release/v0.7.8 (#1662)
2025-12-11 11:04:52 +01:00
script
Add C4A-Script support and documentation
2025-06-07 23:07:19 +08:00
__init__.py
Release/v0.7.8 (#1662)
2025-12-11 11:04:52 +01:00
__version__.py
Release v0.8.0: Crash Recovery, Prefetch Mode & Security Fixes (#1712)
2026-01-17 14:19:15 +01:00
adaptive_crawler copy.py
feat(crawl4ai): Implement adaptive crawling feature
2025-07-04 15:16:53 +08:00
adaptive_crawler.py
Release/v0.7.8 (#1662)
2025-12-11 11:04:52 +01:00
async_configs.py
Release v0.8.0: Crash Recovery, Prefetch Mode & Security Fixes (#1712)
2026-01-17 14:19:15 +01:00
async_crawler_strategy.back.py
Release/v0.7.6 (#1556)
2025-10-22 20:41:06 +08:00
async_crawler_strategy.py
Fix redirected_url containing raw HTML content for raw: URLs
2026-01-20 00:45:15 +00:00
async_database.py
Release v0.8.0: Crash Recovery, Prefetch Mode & Security Fixes (#1712)
2026-01-17 14:19:15 +01:00
async_dispatcher.py
Release/v0.7.6 (#1556)
2025-10-22 20:41:06 +08:00
async_logger.py
Merge branch '2025-MAY-2' into next-MAY
2025-07-08 11:46:13 +02:00
async_url_seeder.py
Release v0.8.0: Crash Recovery, Prefetch Mode & Security Fixes (#1712)
2026-01-17 14:19:15 +01:00
async_webcrawler.py
Fix redirected_url containing raw HTML content for raw: URLs
2026-01-20 00:45:15 +00:00
browser_adapter.py
Release/v0.7.6 (#1556)
2025-10-22 20:41:06 +08:00
browser_manager.py
Release v0.8.0: Crash Recovery, Prefetch Mode & Security Fixes (#1712)
2026-01-17 14:19:15 +01:00
browser_profiler.py
Fix: Keep storage_state.json in profile shrink
2026-01-26 13:06:31 +00:00
cache_context.py
Apply Ruff Corrections
2025-01-13 19:19:58 +08:00
cache_validator.py
Release v0.8.0: Crash Recovery, Prefetch Mode & Security Fixes (#1712)
2026-01-17 14:19:15 +01:00
chunking_strategy.py
refactor(core): reorganize project structure and remove legacy code
2025-01-30 19:35:06 +08:00
cli.py
Fix: Disable cookie encryption for portable profiles
2026-01-26 12:57:17 +00:00
config.py
Refactor HTML block delimiter to use config constant
2026-01-24 04:19:50 +00:00
content_filter_strategy.py
Release/v0.7.8 (#1662)
2025-12-11 11:04:52 +01:00
content_scraping_strategy.py
Release/v0.7.8 (#1662)
2025-12-11 11:04:52 +01:00
docker_client.py
Release/v0.7.8 (#1662)
2025-12-11 11:04:52 +01:00
extraction_strategy.py
Refactor HTML block delimiter to use config constant
2026-01-24 04:19:50 +00:00
hub.py
feat(logger): add abstract logger base class and file logger implementation
2025-02-23 21:23:41 +08:00
install.py
feat: add stealth mode and enhance undetected browser support
2025-07-17 16:59:10 +08:00
link_preview.py
refactor(link_extractor): remove link_extractor and rename to link_preview
2025-06-27 21:54:22 +08:00
markdown_generation_strategy.py
feat(markdown): add content source selection for markdown generation
2025-04-17 20:13:53 +08:00
migrations.py
Apply Ruff Corrections
2025-01-13 19:19:58 +08:00
model_loader.py
Apply Ruff Corrections
2025-01-13 19:19:58 +08:00
models.py
Release v0.8.0: Crash Recovery, Prefetch Mode & Security Fixes (#1712)
2026-01-17 14:19:15 +01:00
prompts.py
feat: add undetected browser support with adapter pattern
2025-07-14 17:29:50 +08:00
proxy_strategy.py
Release v0.8.0: Crash Recovery, Prefetch Mode & Security Fixes (#1712)
2026-01-17 14:19:15 +01:00
ssl_certificate.py
refactor(proxy): move ProxyConfig to async_configs and improve LLM token handling
2025-04-15 22:27:18 +08:00
table_extraction.py
Release/v0.7.8 (#1662)
2025-12-11 11:04:52 +01:00
types.py
Squashed commit of the following:
2025-08-04 19:02:01 +08:00
user_agent_generator.py
feat(browser): add BrowserProfiler class for identity-based browsing
2025-03-02 20:32:29 +08:00
utils.py
Release v0.8.0: Crash Recovery, Prefetch Mode & Security Fixes (#1712)
2026-01-17 14:19:15 +01:00