unclecode ff3524d9b1 feat(v0.3.6): Add screenshot capture, delayed content, and custom timeouts ...

- Implement screenshot capture functionality
- Add delayed content retrieval method
- Introduce custom page timeout parameter
- Enhance LLM support with multiple providers
- Improve database schema auto-updates
- Optimize image processing in WebScrappingStrategy
- Update error handling and logging
- Expand examples in quickstart_async.py

2024-10-12 13:42:42 +08:00

..

models/onnx

- Add ONNX embedding model for CPU devices, Update the similarithy threshold, improve the embedding speed.

2024-05-19 22:30:10 +08:00

__init__.py

feat(v0.3.6): Add screenshot capture, delayed content, and custom timeouts

2024-10-12 13:42:42 +08:00

async_crawler_strategy.py

feat(v0.3.6): Add screenshot capture, delayed content, and custom timeouts

2024-10-12 13:42:42 +08:00

async_database.py

feat(v0.3.6): Add screenshot capture, delayed content, and custom timeouts

2024-10-12 13:42:42 +08:00

async_webcrawler.py

feat(v0.3.6): Add screenshot capture, delayed content, and custom timeouts

2024-10-12 13:42:42 +08:00

chunking_strategy.py

chore: Fix typo in chunking_strategy.py and crawler_strategy.py

2024-07-19 17:40:31 +08:00

config.py

refactor: Update image description minimum word threshold in get_content_of_website_optimized

2024-08-02 14:53:11 +08:00

content_scrapping_strategy.py

feat(v0.3.6): Add screenshot capture, delayed content, and custom timeouts

2024-10-12 13:42:42 +08:00

crawler_strategy.py

Push async version last changes for merge to main branch

2024-09-24 20:52:08 +08:00

database.py

## [v0.2.74] - 2024-07-08

2024-07-08 16:33:25 +08:00

extraction_strategy.py

chore: Update crawl4ai package with AsyncWebCrawler and JsonCssExtractionStrategy

2024-09-03 23:32:27 +08:00

model_loader.py

Push async version last changes for merge to main branch

2024-09-24 20:52:08 +08:00

models.py

Enhance AsyncWebCrawler with smart waiting and screenshot capabilities

2024-10-02 17:34:56 +08:00

prompts.py

fix spelling mistake

2024-08-26 15:29:23 +08:00

train.py

Remove dependency on Spacy model.

2024-05-17 15:08:03 +08:00

utils.py

Remove dependency on psutil, PyYaml, and extend requests version range

2024-09-29 17:07:06 +08:00

web_crawler.back.py

vital: Right now, only raw html is retrived from datbase, therefore, css selector and other filter will be executed every time.

2024-06-08 18:37:40 +08:00

web_crawler.py

Push async version last changes for merge to main branch

2024-09-24 20:52:08 +08:00