ayrisdev/crawl4ai
1
0
Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity

chore: update README to include new features and improvements for version 0.3.74

Browse Source
This commit is contained in:
UncleCode
2024-11-22 18:50:12 +08:00
parent e02935dc5b
commit 8dea3f470f
1 changed files with 13 additions and 12 deletions
Download Patch File Download Diff File Expand all files Collapse all files

25
README.md
View File

@@ -13,18 +13,19 @@ Crawl4AI simplifies asynchronous web crawling and data extraction, making it acc
## New in 0.3.74 ✨ ## New in 0.3.74 ✨
🚀 **Blazing Fast Scraping**: Significantly improved scraping speed. - 🚀 **Blazing Fast Scraping**: Significantly improved scraping speed.
📥 **Download Manager**: Integrated file crawling, downloading, and tracking within `CrawlResult`. - 📥 **Download Manager**: Integrated file crawling, downloading, and tracking within `CrawlResult`.
📝 **Markdown Strategy**: Flexible system for custom markdown generation and formats. - 📝 **Markdown Strategy**: Flexible system for custom markdown generation and formats.
🔗 **LLM-Friendly Citations**: Auto-converts links to numbered citations with reference lists. - 🔗 **LLM-Friendly Citations**: Auto-converts links to numbered citations with reference lists.
🔎 **Markdown Filter**: BM25-based content extraction for cleaner, relevant markdown. - 🔎 **Markdown Filter**: BM25-based content extraction for cleaner, relevant markdown.
🖼️ **Image Extraction**: Supports `srcset`, `picture`, and responsive image formats. - 🖼️ **Image Extraction**: Supports `srcset`, `picture`, and responsive image formats.
🗂️ **Local/Raw HTML**: Crawl `file://` paths and raw HTML (`raw:`) directly. - 🗂️ **Local/Raw HTML**: Crawl `file://` paths and raw HTML (`raw:`) directly.
🤖 **Browser Control**: Custom browser setups with stealth integration to bypass bots. - 🤖 **Browser Control**: Custom browser setups with stealth integration to bypass bots.
☁️ **API & Cache Boost**: CORS, static serving, and enhanced filesystem-based caching. - ☁️ **API & Cache Boost**: CORS, static serving, and enhanced filesystem-based caching.
🐳 **API Gateway**: Run as an API service with secure token authentication. - 🐳 **API Gateway**: Run as an API service with secure token authentication.
🛠️ **Database Upgrades**: Optimized for larger content sets with faster caching. - 🛠️ **Database Upgrades**: Optimized for larger content sets with faster caching.
🐛 **Bug Fixes**: Resolved browser context issues, memory leaks, and improved error handling. - 🐛 **Bug Fixes**: Resolved browser context issues, memory leaks, and improved error handling.
## Try it Now! ## Try it Now!