Depends on the selected model, it may take up to 1 or 2 minutes to process the request. Loading...
In recent times, we've witnessed a surge of startups emerging, riding the AI hype wave and charging for services that should rightfully be accessible to everyone. ππΈ One such example is scraping and crawling web pages and transforming them into a format suitable for Large Language Models (LLMs). πΈοΈπ€ We believe that building a business around this is not the right approach; instead, it should definitely be open-source. ππ So, if you possess the skills to build such tools and share our philosophy, we invite you to join our "Robinhood" band and help set these products free for the benefit of all. π€πͺ
To install and run Crawl4AI locally or on your own service, the best way is to use Docker. π³ Follow these steps:
git clone https://github.com/unclecode/crawl4ai.git
cd crawl4aidocker build -t crawl4ai . On Mac, follow: π
docker build --platform linux/amd64 -t crawl4ai .
docker run -p 8000:80 crawl4aiFor more detailed instructions and advanced configuration options, please refer to the π GitHub repository.