9546773a07
- Moved sentence-transformers from core to optional dependencies in pyproject.toml - Removed sentence-transformers from requirements.txt - Added proper ImportError handling with helpful installation message - This prevents ~2.5GB of NVIDIA CUDA libraries from being installed by default - Users who need embedding features can install with: pip install 'crawl4ai[transformer]'
32 lines
616 B
Plaintext
32 lines
616 B
Plaintext
# Note: These requirements are also specified in pyproject.toml
|
|
# This file is kept for development environment setup and compatibility
|
|
aiosqlite~=0.20
|
|
lxml~=5.3
|
|
litellm>=1.53.1
|
|
numpy>=1.26.0,<3
|
|
pillow>=10.4
|
|
playwright>=1.49.0
|
|
python-dotenv~=1.0
|
|
requests~=2.26
|
|
beautifulsoup4~=4.12
|
|
tf-playwright-stealth>=1.1.0
|
|
xxhash~=3.4
|
|
rank-bm25~=0.2
|
|
aiofiles>=24.1.0
|
|
colorama~=0.4
|
|
snowballstemmer~=2.2
|
|
pydantic>=2.10
|
|
pyOpenSSL>=24.3.0
|
|
psutil>=6.1.1
|
|
nltk>=3.9.1
|
|
rich>=13.9.4
|
|
cssselect>=1.2.0
|
|
chardet>=5.2.0
|
|
brotli>=1.1.0
|
|
httpx[http2]>=0.27.2
|
|
alphashape>=1.3.1
|
|
shapely>=2.0.0
|
|
|
|
fake-useragent>=2.2.0
|
|
pdf2image>=1.17.0
|
|
PyPDF2>=3.0.1 |