Files
unclecode 408ad1b750 feat(marketplace): Add Crawl4AI marketplace with secure configuration
- Implement marketplace frontend and admin dashboard
- Add FastAPI backend with environment-based configuration
- Use .env file for secrets management
- Include data generation scripts
- Add proper CORS configuration
- Remove hardcoded password from admin login
- Update gitignore for security
2025-10-02 16:41:11 +08:00

1.6 KiB

Crawl4AI Marketplace

A terminal-themed marketplace for tools, integrations, and resources related to Crawl4AI.

Setup

Backend

  1. Install dependencies:
cd backend
pip install -r requirements.txt
  1. Generate dummy data:
python dummy_data.py
  1. Run the server:
python server.py

The API will be available at http://localhost:8100

Frontend

  1. Open frontend/index.html in your browser
  2. Or serve via MkDocs as part of the documentation site

Database Schema

The marketplace uses SQLite with automatic migration from schema.yaml. Tables include:

  • apps: Tools and integrations
  • articles: Reviews, tutorials, and news
  • categories: App categories
  • sponsors: Sponsored content

API Endpoints

  • GET /api/apps - List apps with filters
  • GET /api/articles - List articles
  • GET /api/categories - Get all categories
  • GET /api/sponsors - Get active sponsors
  • GET /api/search?q=query - Search across content
  • GET /api/stats - Marketplace statistics

Features

  • Smart caching: LocalStorage with TTL (1 hour)
  • Terminal theme: Consistent with Crawl4AI branding
  • Responsive design: Works on all devices
  • Fast search: Debounced with 300ms delay
  • CORS protected: Only crawl4ai.com and localhost

Admin Panel

Coming soon - for now, edit the database directly or modify dummy_data.py

Deployment

For production deployment on EC2:

  1. Update API_BASE in marketplace.js to production URL
  2. Run FastAPI with proper production settings (use gunicorn/uvicorn)
  3. Set up nginx proxy if needed