Update simple-crawling.md
Fixing wrong documentation about th fit_markdown to assume its a direct parameter of CrawlerRunConfig, while it is NOT.
This commit is contained in:
@@ -31,9 +31,16 @@ if __name__ == "__main__":
|
|||||||
The `arun()` method returns a `CrawlResult` object with several useful properties. Here's a quick overview (see [CrawlResult](../api/crawl-result.md) for complete details):
|
The `arun()` method returns a `CrawlResult` object with several useful properties. Here's a quick overview (see [CrawlResult](../api/crawl-result.md) for complete details):
|
||||||
|
|
||||||
```python
|
```python
|
||||||
|
config = CrawlerRunConfig(
|
||||||
|
markdown_generator=DefaultMarkdownGenerator(
|
||||||
|
content_filter=PruningContentFilter(threshold=0.6),
|
||||||
|
options={"ignore_links": True}
|
||||||
|
)
|
||||||
|
)
|
||||||
|
|
||||||
result = await crawler.arun(
|
result = await crawler.arun(
|
||||||
url="https://example.com",
|
url="https://example.com",
|
||||||
config=CrawlerRunConfig(fit_markdown=True)
|
config=config
|
||||||
)
|
)
|
||||||
|
|
||||||
# Different content formats
|
# Different content formats
|
||||||
|
|||||||
Reference in New Issue
Block a user