Commit Message:

Enhance Async Crawler with storage state handling - Updated Async Crawler to support storage state management. - Added error handling for URL validation in Async Web Crawler. - Modified README logo and improved .gitignore entries. - Fixed issues in multiple files for better code robustness.
2024-12-09 20:04:59 +08:00
parent c51e901f68
commit 2d31915f0a
7 changed files with 58 additions and 15 deletions
--- a/crawl4ai/utils.py
+++ b/crawl4ai/utils.py
@@ -147,6 +147,7 @@ class CustomHTML2Text(HTML2Text):
    #         self.preserved_content.append(data)
    #         return
    #     super().handle_data(data, entity_char)
+
 class InvalidCSSSelectorError(Exception):
    pass