feat(requirements): update requirements.txt to include snowballstemmer fix(version_manager): correct version parsing to use __version__.__version__ feat(main): introduce chunking strategy and content filter in CrawlRequest model feat(content_filter): enhance BM25 algorithm with priority tag scoring for improved content relevance feat(logger): implement new async logger engine replacing print statements throughout library fix(database): resolve version-related deadlock and circular lock issues in database operations docs(docker): expand Docker deployment documentation with usage instructions for Docker Compose
16 lines
269 B
Plaintext
16 lines
269 B
Plaintext
aiosqlite~=0.20
|
|
html2text~=2024.2
|
|
lxml~=5.3
|
|
litellm~=1.48
|
|
numpy>=1.26.0,<3
|
|
pillow~=10.4
|
|
playwright>=1.47,<1.48
|
|
python-dotenv~=1.0
|
|
requests~=2.26
|
|
beautifulsoup4~=4.12
|
|
tf-playwright-stealth~=1.0
|
|
xxhash~=3.4
|
|
rank-bm25~=0.2
|
|
aiofiles~=24.0
|
|
colorama~=0.4
|
|
snowballstemmer~=2.2 |