UncleCode 6ec4cb33ca Enhance Markdown generation and external content control ...

- Integrate customized html2text library for flexible Markdown output
- Add options to exclude external links and images
- Improve content scraping efficiency and error handling
- Update AsyncPlaywrightCrawlerStrategy for faster closing
- Enhance CosineStrategy with generic embedding model loading

2024-10-20 18:56:58 +08:00

9.7 KiB

Raw Blame History

View Raw