ayrisdev/crawl4ai
1
0
Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity
470 Commits 150 Branches 42 Tags
d5ed4512990a4baae31b63f11c345b3bbd65753c
Commit Graph

2 Commits

Author SHA1 Message Date
UncleCode
d5ed451299 Enhance crawler capabilities and documentation 
- Add llm.txt generator
  - Added SSL certificate extraction in AsyncWebCrawler.
  - Introduced new content filters and chunking strategies for more robust data extraction.
  - Updated documentation.
 2024-12-25 21:34:31 +08:00
UncleCode
84b311760f Commit Message: 
Enhance Crawl4AI with CLI and documentation updates
  - Implemented Command-Line Interface (CLI) in `crawl4ai/cli.py`
  - Added chunking strategies and their documentation in `llm.txt`
 2024-12-21 14:26:56 +08:00