Depends on the selected model, it may take up to 1 or 2 minutes to process the request. Loading...
In recent times, we've witnessed a surge of startups emerging, riding the AI hype wave and charging for services that should rightfully be accessible to everyone. 🌍💸 One such example is scraping and crawling web pages and transforming them into a format suitable for Large Language Models (LLMs). 🕸️🤖 We believe that building a business around this is not the right approach; instead, it should definitely be open-source. 🆓🌟 So, if you possess the skills to build such tools and share our philosophy, we invite you to join our "Robinhood" band and help set these products free for the benefit of all. 🤝💪
To install and run Crawl4AI as a library or a local server, please refer to the 📚 GitHub repository.