refactor(scraper): optimize URL validation and filter performance

- Replace validators library with built-in urlparse for URL validation
- Optimize filter statistics update logic for better performance
- Add performance benchmarking suite for filters
- Add execution time tracking to scraper examples
- Update gitignore with windsurfrules

BREAKING CHANGE: Removed dependency on validators library for URL validation
This commit is contained in:
UncleCode
2025-01-22 19:45:56 +08:00
parent 6e78c56dda
commit e6ef8d91ba
6 changed files with 1140 additions and 13 deletions

5
.gitignore vendored
View File

@@ -227,4 +227,7 @@ tree.md
.do
/plans
.codeiumignore
todo/
todo/
# windsurf rules
.windsurfrules