chore: Update .gitignore and README.md

.gitignore

@@ -162,4 +162,5 @@ cython_debug/
 #.idea/
 
 Crawl4AI.egg-info/
-Crawl4AI.egg-info/*
+Crawl4AI.egg-info/*
+crawler_data.db

README.md

@@ -55,10 +55,7 @@ git clone https://github.com/unclecode/crawl4ai.git
 cd crawl4ai
 ```
 
-3. Create a `.env` file in the root folder and set your Groq API token:
-```
-GROQ_API_TOKEN=your_groq_api_token
-```
+3. Open `crawler/config.py` and set your favorite LLM provider and API token:
 
 4. Build the Docker image:
 ```
@@ -71,7 +68,7 @@ docker build --platform linux/amd64 -t crawl4ai .
 
 5. Run the Docker container:
 ```
-docker run -p 8000:80 crawl4ai
+docker run -d -p 8000:80 crawl4ai
 ```
 
 6. Access the application at `http://localhost:8000`.

pages/index.html

@@ -196,23 +196,7 @@
             <div class="container mx-auto px-4">
                 <h2 class="text-2xl font-bold mb-4">⚙️ Installation</h2>
                 <p class="mb-4">
-                    To install and run Crawl4AI locally or on your own service, the best way is to use Docker. 🐳 Follow
-                    these steps:
-                </p>
-                <ol class="list-decimal list-inside mb-4">
-                    <li>
-                        Clone the GitHub repository: 📥
-                        <code>git clone https://github.com/unclecode/crawl4ai.git</code>
-                    </li>
-                    <li>Navigate to the project directory: 📂 <code>cd crawl4ai</code></li>
-                    <li>
-                        Build the Docker image: 🛠️ <code>docker build -t crawl4ai .</code> On Mac, follow: 🍎
-                        <code>docker build --platform linux/amd64 -t crawl4ai .</code>
-                    </li>
-                    <li>Run the Docker container: ▶️ <code>docker run -p 8000:80 crawl4ai</code></li>
-                </ol>
-                <p>
-                    For more detailed instructions and advanced configuration options, please refer to the 📚
+                    To install and run Crawl4AI as a library or a local server, please refer to the 📚
                     <a href="https://github.com/unclecode/crawl4ai" class="text-blue-400">GitHub repository</a>.
                 </p>
             </div>