UncleCode 5c9c305dbf feat: Add advanced link head extraction with three-layer scoring system (#1) ...

Squashed commit from feature/link-extractor branch implementing comprehensive link analysis:

- Extract HTML head content from discovered links with parallel processing
- Three-layer scoring: Intrinsic (URL quality), Contextual (BM25), and Total scores
- New LinkExtractionConfig class for type-safe configuration
- Pattern-based filtering for internal/external links
- Comprehensive documentation and examples

2025-06-27 20:06:04 +08:00

..

async

Update all documentation to import extraction strategies directly from crawl4ai.

2025-06-10 18:08:27 +08:00

async_assistant

test(async_assistant): add new tests for extract pipeline

2025-06-23 10:44:27 +08:00

browser

feat(browser): implement browser pooling and page pre-warming

2025-03-31 21:55:07 +08:00

cli

feat(cli): add command line interface with comprehensive features

2025-02-10 16:58:52 +08:00

docker

docs(tests): clarify server URL comments in deep crawl tests

2025-04-15 22:32:27 +08:00

general

Update all documentation to import extraction strategies directly from crawl4ai.

2025-06-10 18:08:27 +08:00

hub

refactor(crawler): improve HTML handling and cleanup codebase

2025-02-07 21:56:27 +08:00

loggers

Release prep (#749)

2025-02-28 19:53:35 +08:00

mcp

feat(docker): update Docker deployment for v0.6.0

2025-04-22 22:35:25 +08:00

memory

feat(mcp): Implement MCP protocol and enhance server capabilities

2025-04-21 22:22:02 +08:00

profiler

feat(browser): improve browser profile management and cleanup

2025-04-29 23:04:32 +08:00

__init__.py

- Test all methods

2024-05-14 21:27:41 +08:00

docker_example.py

Apply Ruff Corrections

2025-01-13 19:19:58 +08:00

test_cli_docs.py

Apply Ruff Corrections

2025-01-13 19:19:58 +08:00

test_docker.py

Apply Ruff Corrections

2025-01-13 19:19:58 +08:00

test_link_extractor.py

feat: Add advanced link head extraction with three-layer scoring system (#1)

2025-06-27 20:06:04 +08:00

test_llmtxt.py

Apply Ruff Corrections

2025-01-13 19:19:58 +08:00

test_main.py

Apply Ruff Corrections

2025-01-13 19:19:58 +08:00

test_scraping_strategy.py

Release prep (#749)

2025-02-28 19:53:35 +08:00

test_web_crawler.py

Update all documentation to import extraction strategies directly from crawl4ai.

2025-06-10 18:08:27 +08:00