a9415aaaf6
Split deep crawling code into separate strategy files for better organization and maintainability. Added new BFF (Best First) and DFS crawling strategies. Introduced base strategy class and common types. BREAKING CHANGE: Deep crawling implementation has been split into multiple files. Import paths for deep crawling strategies have changed.
14 lines
472 B
Python
14 lines
472 B
Python
from typing import TYPE_CHECKING, Union
|
|
|
|
AsyncWebCrawler = Union['AsyncWebCrawlerType'] # Note the string literal
|
|
CrawlerRunConfig = Union['CrawlerRunConfigType']
|
|
CrawlResult = Union['CrawlResultType']
|
|
RunManyReturn = Union['RunManyReturnType']
|
|
|
|
if TYPE_CHECKING:
|
|
from . import (
|
|
AsyncWebCrawler as AsyncWebCrawlerType,
|
|
CrawlerRunConfig as CrawlerRunConfigType,
|
|
CrawlResult as CrawlResultType,
|
|
RunManyReturn as RunManyReturnType,
|
|
) |