This website requires JavaScript.
Explore
Help
Register
Sign In
ayrisdev
/
crawl4ai
Watch
1
Star
0
Fork
0
You've already forked crawl4ai
Code
Issues
Pull Requests
Actions
Packages
Projects
Releases
Wiki
Activity
Files
a0555d5fa6afed43ccc6ff2ca16650d5b79ec563
crawl4ai
/
crawl4ai
/
deep_crawling
History
Aravind Karnam
e01d1e73e1
fix: link normalisation in BestFirstStrategy
2025-03-21 17:34:13 +05:30
..
__init__.py
Release prep (
#749
)
2025-02-28 19:53:35 +08:00
base_strategy.py
feat(profiles): add CLI command for crawling with browser profiles
2025-03-02 21:33:33 +08:00
bff_strategy.py
fix: link normalisation in BestFirstStrategy
2025-03-21 17:34:13 +05:30
bfs_strategy.py
fix: Move adding of visited urls to the 'visited' set, when queueing the URLs instead of after dequeuing, this is to prevent duplicate crawls.
https://github.com/unclecode/crawl4ai/issues/843
2025-03-21 13:44:57 +05:30
crazy.py
refactor(config): enhance serialization and config handling
2025-02-19 17:23:25 +08:00
dfs_strategy.py
refactor(deep-crawl): add max_pages limit and improve crawl control
2025-03-03 21:51:11 +08:00
filters.py
feat(filters): add reverse option to URLPatternFilter
2025-03-08 18:54:41 +08:00
scorers.py
2025 feb alpha 1 (
#685
)
2025-02-19 14:13:17 +08:00