ayrisdev/crawl4ai
1
0
Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity

feat(crawler): add URL redirection tracking

Browse Source 
Add capability to track and return final URLs after redirects in crawler responses. This enhancement helps users understand the actual destination of crawled URLs after any redirections.

Changes include:
- Added final_url tracking in AsyncPlaywrightCrawlerStrategy
- Added redirected_url field to CrawlResult model
- Updated AsyncWebCrawler to properly handle and store redirect URLs
- Fixed typo in documentation signature
This commit is contained in:
UncleCode
2025-01-19 19:53:38 +08:00
parent 8b6fe6a98f
commit 4b1309cbf2
4 changed files with 9 additions and 2 deletions
Download Patch File Download Diff File Expand all files Collapse all files

2
docs/md_v2/index.md
View File

@@ -132,4 +132,4 @@ Throughout these sections, you’ll find code samples you can **copy-paste** int
Thank you for joining me on this journey. Let’s keep building an **open, democratic** approach to data extraction and AI together.
Happy Crawling!
— *Unclecde, Founder & Maintainer of Crawl4AI*
— *Unclecode, Founder & Maintainer of Crawl4AI*