Installation 💻

There are three ways to use Crawl4AI:

  1. As a library
  2. As a local server (Docker)
  3. As a Google Colab notebook. Open In Colab
  4. To install Crawl4AI as a library, follow these steps:

    1. Install the package from GitHub:
      virtualenv venv
      source venv/bin/activate
      pip install "crawl4ai[all] @ git+https://github.com/unclecode/crawl4ai.git"
                  
    2. Run the following command to load the required models. This is optional, but it will boost the performance and speed of the crawler. You need to do this only once.
      crawl4ai-download-models
    3. Alternatively, you can clone the repository and install the package locally:
      virtualenv venv
      source venv/bin/activate
      git clone https://github.com/unclecode/crawl4ai.git
      cd crawl4ai
      pip install -e .[all]
      
    4. Use docker to run the local server:
      docker build -t crawl4ai . 
      # docker build --platform linux/amd64 -t crawl4ai . For Mac users
      docker run -d -p 8000:80 crawl4ai

    For more information about how to run Crawl4AI as a local server, please refer to the GitHub repository.