feat: Comprehensive deep crawl streaming functionality restoration
🚀 Major Achievements: - ✅ ORJSON Serialization System: Complete implementation with custom handlers - ✅ Global Deprecated Properties System: DeprecatedPropertiesMixin for automatic exclusion - ✅ Deep Crawl Streaming: Fully restored with proper CrawlResultContainer handling - ✅ Docker Client Streaming: Fixed async generator patterns and result type checking - ✅ Server API Improvements: Correct method selection logic and streaming responses - ✅ Type Safety: Dict-as-logger detection to prevent crashes 📊 Test Results: 100% success rate on comprehensive test suite (10/10 tests passing) 🔧 Files Modified: - crawl4ai/models.py: ORJSON + DeprecatedPropertiesMixin implementation - deploy/docker/api.py: Streaming endpoint fixes + CrawlResultContainer handling - deploy/docker/server.py: Production imports + ORJSON response handling - crawl4ai/docker_client.py: Async generator streaming fixes - crawl4ai/deep_crawling/bfs_strategy.py: Logger type safety - .gitignore: Development environment cleanup - tests/test_comprehensive_fixes.py: Rich-based comprehensive test suite 🎯 Impact: Production-ready deep crawl streaming functionality with comprehensive testing coverage
This commit is contained in:
10
.gitignore
vendored
10
.gitignore
vendored
@@ -1,6 +1,11 @@
|
||||
# Scripts folder (private tools)
|
||||
.scripts/
|
||||
|
||||
# Local development CLI (private)
|
||||
local_dev.py
|
||||
dev
|
||||
DEV_CLI_README.md
|
||||
|
||||
# Byte-compiled / optimized / DLL files
|
||||
__pycache__/
|
||||
*.py[cod]
|
||||
@@ -270,4 +275,7 @@ docs/**/data
|
||||
.codecat/
|
||||
|
||||
docs/apps/linkdin/debug*/
|
||||
docs/apps/linkdin/samples/insights/*
|
||||
docs/apps/linkdin/samples/insights/*
|
||||
|
||||
# Production checklist (local, not for version control)
|
||||
PRODUCTION_CHECKLIST.md
|
||||
Reference in New Issue
Block a user