unclecode 68e9144ce3 feat: Enhance crawling control and LLM extraction flexibility ...

- Add before_retrieve_html hook and delay_before_return_html option
- Implement flexible page_timeout for smart_wait function
- Support extra_args and custom headers in LLM extraction
- Allow arbitrary kwargs in AsyncWebCrawler initialization
- Improve perform_completion_with_backoff for custom API calls
- Update examples with new features and diverse LLM providers

2024-10-12 14:48:22 +08:00

..

assets

- User agent

2024-06-08 17:59:42 +08:00

tmp

Push async version last changes for merge to main branch

2024-09-24 20:52:08 +08:00

async_webcrawler_multiple_urls_example.py

Enhance AsyncWebCrawler with smart waiting and screenshot capabilities

2024-10-02 17:34:56 +08:00

chainlit.md

Add research assistant example using Chainlit

2024-06-04 22:43:09 +08:00

crawlai_vs_firecrawl.py

chore: Update crawl4ai package with AsyncWebCrawler and JsonCssExtractionStrategy

2024-09-03 23:32:27 +08:00

language_support_example.py

Enhance AsyncWebCrawler with smart waiting and screenshot capabilities

2024-10-02 17:34:56 +08:00

llm_extraction_openai_pricing.py

refactor: Update image description minimum word threshold in get_content_of_website_optimized

2024-08-02 15:55:32 +08:00

quickstart_async.py

feat: Enhance crawling control and LLM extraction flexibility

2024-10-12 14:48:22 +08:00

quickstart_sync.py

Create series of quickstart files.

2024-09-04 15:33:24 +08:00

quickstart.ipynb

Update quickstart_async.py to improve performance and add Firecrawl simulation

2024-09-28 00:11:39 +08:00

research_assistant.py

Push async version last changes for merge to main branch

2024-09-24 20:52:08 +08:00

rest_call.py

- User agent

2024-06-08 17:59:42 +08:00

sample_ecommerce.html

Push async version last changes for merge to main branch

2024-09-24 20:52:08 +08:00

summarize_page.py

## [v0.2.74] - 2024-07-08

2024-07-08 16:33:25 +08:00