ayrisdev/crawl4ai
1
0
Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity

chore: Update pip installation command and requirements for Crawl4AI

Browse Source
This commit is contained in:
unclecode
2024-05-16 20:36:29 +08:00
parent 4006f5f4e2
commit 5bb0b0b378
3 changed files with 9 additions and 3 deletions
Download Patch File Download Diff File Expand all files Collapse all files

3
README.md
View File

@@ -119,8 +119,8 @@ To install Crawl4AI as a library, follow these steps:
```bash ```bash
virtualenv venv virtualenv venv
source venv/bin/activate source venv/bin/activate
pip install transformers torch chromedriver_autoinstaller
pip install git+https://github.com/unclecode/crawl4ai.git pip install git+https://github.com/unclecode/crawl4ai.git
python docs/examples/quickstart.py
``` ```
2. Alternatively, you can clone the repository and install the package locally: 2. Alternatively, you can clone the repository and install the package locally:
@@ -129,6 +129,7 @@ virtualenv venv
source venv/bin/activate source venv/bin/activate
git clone https://github.com/unclecode/crawl4ai.git git clone https://github.com/unclecode/crawl4ai.git
cd crawl4ai cd crawl4ai
pip install transformers torch chromedriver_autoinstaller
pip install -e . pip install -e .
``` ```

2
crawl4ai/model_loader.py
View File

@@ -43,7 +43,7 @@ def load_spacy_model():
model_folder = os.path.join(home_folder, name) model_folder = os.path.join(home_folder, name)
# Check if the model directory already exists # Check if the model directory already exists
if True or not (Path(model_folder).exists() and any(Path(model_folder).iterdir())): if not (Path(model_folder).exists() and any(Path(model_folder).iterdir())):
repo_url = "https://github.com/unclecode/crawl4ai.git" repo_url = "https://github.com/unclecode/crawl4ai.git"
# branch = "main" # branch = "main"
branch = MODEL_REPO_BRANCH branch = MODEL_REPO_BRANCH

7
pages/partial/installation.html
View File

@@ -27,7 +27,11 @@
Install the package from GitHub: Install the package from GitHub:
<pre <pre
class="bg-zinc-800 p-4 rounded mt-2 text-zinc-100" class="bg-zinc-800 p-4 rounded mt-2 text-zinc-100"
><code>pip install git+https://github.com/unclecode/crawl4ai.git</code></pre> ><code>virtualenv venv
source venv/bin/activate
pip install git+https://github.com/unclecode/crawl4ai.git
pip install transformers torch chromedriver_autoinstaller
</code></pre>
</li> </li>
<li class="mb-4"> <li class="mb-4">
Alternatively, you can clone the repository and install the package locally: Alternatively, you can clone the repository and install the package locally:
@@ -37,6 +41,7 @@
source venv/bin/activate source venv/bin/activate
git clone https://github.com/unclecode/crawl4ai.git git clone https://github.com/unclecode/crawl4ai.git
cd crawl4ai cd crawl4ai
pip install transformers torch chromedriver_autoinstaller
pip install -e . pip install -e .
</code></pre> </code></pre>
</li> </li>