unclecode ea2f83ac10 feat: Add delay after fetching URL in crawler hooks ...

This commit adds a delay of 5 seconds after fetching the URL in the `after_get_url` hook of the crawler hooks. The delay is implemented using the `time.sleep()` function. This change ensures that the entire page is fetched before proceeding with further actions.

2024-07-08 15:59:59 +08:00

..

assets

- User agent

2024-06-08 17:59:42 +08:00

tmp

ADD MKDocs

2024-06-21 17:56:54 +08:00

chainlit.md

Add research assistant example using Chainlit

2024-06-04 22:43:09 +08:00

llm_extraction_openai_pricing.py

chore: Update configuration values for chunk token threshold, overlap rate, and minimum word threshold. Create a new example for LLMExtraction Strategy, update Dockerfile, and README

2024-06-19 18:32:20 +08:00

quickstart.py

feat: Add delay after fetching URL in crawler hooks

2024-07-08 15:59:59 +08:00

research_assistant.py

ADD MKDocs

2024-06-21 17:56:54 +08:00

rest_call.py

- User agent

2024-06-08 17:59:42 +08:00

summarize_page.py

Update LLMExtractionStrategy to disable chunking if specified, Add example of summarization for a web page.

2024-06-19 19:03:35 +08:00