unclecode 6a728cbe5b feat: add stealth mode and enhance undetected browser support ...

- Add playwright-stealth integration with enable_stealth parameter in BrowserConfig
- Merge undetected browser strategy into main async_crawler_strategy.py using adapter pattern
- Add browser adapters (BrowserAdapter, PlaywrightAdapter, UndetectedAdapter) for flexible browser switching
- Update install.py to install both playwright and patchright browsers automatically
- Add comprehensive documentation for anti-bot features (stealth mode + undetected browser)
- Create examples demonstrating stealth mode usage and comparison tests
- Update pyproject.toml and requirements.txt with patchright>=1.49.0 and other dependencies
- Remove duplicate/unused dependencies (alphashape, cssselect, pyperclip, shapely, selenium)
- Add dependency checker tool in tests/check_dependencies.py

Breaking changes: None - all existing functionality preserved

🤖 Generated with [Claude Code](https://claude.ai/code)

Co-Authored-By: Claude <noreply@anthropic.com>

2025-07-17 16:59:10 +08:00

..

adaptive

feat(crawl4ai): Implement adaptive crawling feature

2025-07-04 15:16:53 +08:00

async

Update all documentation to import extraction strategies directly from crawl4ai.

2025-06-10 18:08:27 +08:00

async_assistant

test(async_assistant): add new tests for extract pipeline

2025-06-23 10:44:27 +08:00

browser

feat(browser): implement browser pooling and page pre-warming

2025-03-31 21:55:07 +08:00

cli

feat(cli): add command line interface with comprehensive features

2025-02-10 16:58:52 +08:00

deep_crwaling

#1167 Add PHP MIME types to ContentTypeFilter for better file handling

2025-06-09 11:49:33 +08:00

docker

docs(tests): clarify server URL comments in deep crawl tests

2025-04-15 22:32:27 +08:00

general

Merge branch '2025-JUN-1' into next-MAY

2025-07-09 09:41:03 +02:00

hub

refactor(crawler): improve HTML handling and cleanup codebase

2025-02-07 21:56:27 +08:00

loggers

Release prep (#749)

2025-02-28 19:53:35 +08:00

mcp

feat(docker): update Docker deployment for v0.6.0

2025-04-22 22:35:25 +08:00

memory

feat(mcp): Implement MCP protocol and enhance server capabilities

2025-04-21 22:22:02 +08:00

profiler

feat(browser): improve browser profile management and cleanup

2025-04-29 23:04:32 +08:00

releases

test(releases): Add test cases for release 0.7.0

2025-07-11 22:27:18 +08:00

__init__.py

- Test all methods

2024-05-14 21:27:41 +08:00

check_dependencies.py

feat: add stealth mode and enhance undetected browser support

2025-07-17 16:59:10 +08:00

docker_example.py

Fix: README.md urls list

2025-04-29 16:26:35 +02:00

test_cli_docs.py

Apply Ruff Corrections

2025-01-13 19:19:58 +08:00

test_docker.py

Fix: README.md urls list

2025-04-29 16:26:35 +02:00

test_link_extractor.py

refactor(link_extractor): remove link_extractor and rename to link_preview

2025-06-27 21:54:22 +08:00

test_llmtxt.py

Apply Ruff Corrections

2025-01-13 19:19:58 +08:00

test_main.py

Fix: README.md urls list

2025-04-29 16:26:35 +02:00

test_normalize_url.py

#1103 fix(url): enhance URL normalization to handle invalid schemes and trailing slashes

2025-05-19 13:51:16 +08:00

test_scraping_strategy.py

Release prep (#749)

2025-02-28 19:53:35 +08:00

test_virtual_scroll.py

feat: Add virtual scroll support for modern web scraping

2025-06-29 20:41:37 +08:00

test_web_crawler.py

Update all documentation to import extraction strategies directly from crawl4ai.

2025-06-10 18:08:27 +08:00