crawl4ai

ayrisdev/crawl4ai

Fork 0

Commit Graph

Author	SHA1	Message	Date
Soham Kukreti	18ad3ef159	fix: Implement base tag support in link extraction (#1147 ) - Extract base href from <head><base> tag using XPath in _process_element method - Use base URL as the primary URL for link normalization when present - Add error handling with logging for malformed or problematic base tags - Maintain backward compatibility when no base tag is present - Add test to verify the functionality of the base tag extraction.	2025-08-08 20:11:57 +05:30
UncleCode	8ec12d7d68	Apply Ruff Corrections	2025-01-13 19:19:58 +08:00
unclecode	c37614cbc8	Add Async Version, JsonCss Extrator	2024-09-03 01:27:00 +08:00

Author

SHA1

Message

Date

Soham Kukreti

18ad3ef159

fix: Implement base tag support in link extraction (#1147 )

- Extract base href from <head><base> tag using XPath in _process_element method
- Use base URL as the primary URL for link normalization when present
- Add error handling with logging for malformed or problematic base tags
- Maintain backward compatibility when no base tag is present
- Add test to verify the functionality of the base tag extraction.

2025-08-08 20:11:57 +05:30

UncleCode

8ec12d7d68

Apply Ruff Corrections

2025-01-13 19:19:58 +08:00

unclecode

c37614cbc8

Add Async Version, JsonCss Extrator

2024-09-03 01:27:00 +08:00

3 Commits