ayrisdev/crawl4ai
1
0
Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity

Refactor: Removed all scheduling logic from scraper. From now scraper expects arun_many to handle all scheduling. Scraper will only do traversal, validations, compliance checks, URL filtering and scoring etc. Reformatted some of the scraper files with Black code formatter

Browse Source
This commit is contained in:
Aravind Karnam
2025-01-21 18:44:43 +05:30
parent 67fa06c09b
commit 6e78c56dda
1 changed files with 2 additions and 2 deletions
Download Patch File Download Diff File Expand all files Collapse all files

4
docs/scraper/scraper_quickstart.py
View File

@@ -183,5 +183,5 @@ if __name__ == "__main__":
asyncio.run(basic_scraper_example())
# Run advanced example
# print("\nRunning advanced scraper example...")
# asyncio.run(advanced_scraper_example())
print("\nRunning advanced scraper example...")
asyncio.run(advanced_scraper_example())