Enhance AsyncWebCrawler and related configurations

Browse Source

- Introduced new configuration classes: BrowserConfig and CrawlerRunConfig.
  - Refactored AsyncWebCrawler to leverage the new configuration system for cleaner parameter management.
  - Updated AsyncPlaywrightCrawlerStrategy for better flexibility and reduced legacy parameters.
  - Improved error handling with detailed context extraction during exceptions.
  - Enhanced overall maintainability and usability of the web crawler.

...

This commit is contained in:

UncleCode

2024-12-12 19:35:09 +08:00

parent 5188b7a6a0

commit 0982c639ae

14 changed files with 6373 additions and 2667 deletions

Show all changes Ignore whitespace when comparing lines Ignore changes in amount of whitespace Ignore changes in whitespace at EOL

Download Patch File Download Diff File Expand all files Collapse all files

4214

a.md Normal file

File diff suppressed because it is too large Load Diff