UncleCode be472c624c Refactored AsyncWebScraper to include comprehensive error handling and progress tracking capabilities. Introduced a ScrapingProgress data class to monitor processed and failed URLs. Enhanced scraping methods to log errors and track stats throughout the scraping process.

2024-11-06 21:09:47 +08:00

..

examples

feat: Enhance crawler flexibility and LLM extraction capabilities

2024-10-14 21:03:28 +08:00

md

Update documents and README

2024-09-25 16:52:11 +08:00

md _sync

Push async version last changes for merge to main branch

2024-09-24 20:52:08 +08:00

scrapper

Refactored AsyncWebScraper to include comprehensive error handling and progress tracking capabilities. Introduced a ScrapingProgress data class to monitor processed and failed URLs. Enhanced scraping methods to log errors and track stats throughout the scraping process.

2024-11-06 21:09:47 +08:00

.DS_Store

Push async version last changes for merge to main branch

2024-09-24 20:52:08 +08:00

chunking_strategies.json

chore: Update NlpSentenceChunking constructor parameters to None

2024-05-17 17:00:43 +08:00

extraction_strategies.json

Update:

2024-05-16 17:31:44 +08:00