UncleCode 0094cac675 refactor(browser): improve parallel crawling and browser management ...

Remove PagePoolConfig in favor of direct page management in browser strategies.
Add get_pages() method for efficient parallel page creation.
Improve storage state handling and persistence.
Add comprehensive parallel crawling tests and performance analysis.

BREAKING CHANGE: Removed PagePoolConfig class and related functionality.

2025-03-23 18:53:24 +08:00

38 KiB

Raw Permalink Blame History

View Raw