ayrisdev/crawl4ai
1
0
Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity

feat(demo): uncomment feature demos and add fake-useragent dependency

Browse Source 
Uncomments demonstration code for memory dispatcher, streaming support,
content scraping, JSON schema generation, LLM markdown, and robots compliance
in the v0.4.3b2 features demo file. Also adds fake-useragent package as a
project dependency.

This change makes all feature demonstrations active by default and ensures
proper user agent handling capabilities.
This commit is contained in:
UncleCode
2025-01-25 21:56:08 +08:00
parent 97796f39d2
commit 09ac7ed008
2 changed files with 7 additions and 6 deletions
Download Patch File Download Diff File Expand all files Collapse all files

12
docs/examples/v0_4_3b2_features_demo.py
View File

@@ -333,18 +333,18 @@ async def main():
# Efficiency & Speed Demos # Efficiency & Speed Demos
print("\n🚀 EFFICIENCY & SPEED DEMOS") print("\n🚀 EFFICIENCY & SPEED DEMOS")
# await demo_memory_dispatcher() await demo_memory_dispatcher()
# await demo_streaming_support() await demo_streaming_support()
# await demo_content_scraping() await demo_content_scraping()
# # LLM Integration Demos # # LLM Integration Demos
print("\n🤖 LLM INTEGRATION DEMOS") print("\n🤖 LLM INTEGRATION DEMOS")
# await demo_json_schema_generation() await demo_json_schema_generation()
# await demo_llm_markdown() await demo_llm_markdown()
# # Core Improvements # # Core Improvements
print("\n🔧 CORE IMPROVEMENT DEMOS") print("\n🔧 CORE IMPROVEMENT DEMOS")
# await demo_robots_compliance() await demo_robots_compliance()
await demo_proxy_rotation() await demo_proxy_rotation()
if __name__ == "__main__": if __name__ == "__main__":

1
pyproject.toml
View File

@@ -37,6 +37,7 @@ dependencies = [
"rich>=13.9.4", "rich>=13.9.4",
"cssselect>=1.2.0", "cssselect>=1.2.0",
"httpx==0.27.2", "httpx==0.27.2",
"fake-useragent>=2.0.3"
] ]
classifiers = [ classifiers = [
"Development Status :: 4 - Beta", "Development Status :: 4 - Beta",