UncleCode 1630fbdafe feat(monitor): add real-time crawler monitoring system with memory management ...

Implements a comprehensive monitoring and visualization system for tracking web crawler operations in real-time. The system includes:
- Terminal-based dashboard with rich UI for displaying task statuses
- Memory pressure monitoring and adaptive dispatch control
- Queue statistics and performance metrics tracking
- Detailed task progress visualization
- Stress testing framework for memory management

This addition helps operators track crawler performance and manage memory usage more effectively.

2025-03-12 19:05:24 +08:00

18 KiB

Raw Blame History

View Raw