unclecode 911bbce8b1 Fix agenerate_schema() JSON parsing for Anthropic models ...

Strip markdown code fences (```json ... ```) from LLM responses before
json.loads() in agenerate_schema(). Anthropic models wrap JSON output
in markdown fences when litellm silently drops the unsupported
response_format parameter, causing json.loads("") parse failures.

- Add _strip_markdown_fences() helper to extraction_strategy.py
- Apply fence stripping + empty response check in agenerate_schema()
- Separate JSONDecodeError for clearer error messages
- Add 34 tests: unit, real API integration (Anthropic/OpenAI/Groq
  against quotes.toscrape.com), and regression parametrized

2026-01-29 11:38:53 +00:00

..

generate_dummy_site.py

refactor(proxy): move ProxyConfig to async_configs and improve LLM token handling

2025-04-15 22:27:18 +08:00

test_acyn_crawl_wuth_http_crawler_strategy.py

feat(crawler): add network request and console message capturing

2025-04-10 16:03:48 +08:00

test_advanced_deep_crawl.py

feat(crawler): add network request and console message capturing

2025-04-10 16:03:48 +08:00

test_async_crawler_strategy.py

fix: remove_overlay_elements functionality by calling injected JS function. ref: #1396

2025-09-29 20:40:08 +05:30

test_async_markdown_generator.py

feat(crawler): add network request and console message capturing

2025-04-10 16:03:48 +08:00

test_async_url_seeder_bm25.py

feat: Add AsyncUrlSeeder for intelligent URL discovery and filtering

2025-06-03 23:27:12 +08:00

test_async_webcrawler.py

Fix: Use correct URL variable for raw HTML extraction (#1116)

2025-09-01 23:15:56 +03:00

test_bff_scoring.py

fix(deep-crawl): BestFirst priority inversion; remove pre-scoring truncation. ref #1253

2025-08-11 18:16:57 +08:00

test_cache_context.py

feat(crawler): add network request and console message capturing

2025-04-10 16:03:48 +08:00

test_content_source_parameter.py

feat(markdown): add content source selection for markdown generation

2025-04-17 20:13:53 +08:00

test_crawlers.py

feat(crawler): add network request and console message capturing

2025-04-10 16:03:48 +08:00

test_deep_crawl_filters.py

feat(crawler): add network request and console message capturing

2025-04-10 16:03:48 +08:00

test_deep_crawl_scorers.py

feat(crawler): add network request and console message capturing

2025-04-10 16:03:48 +08:00

test_deep_crawl.py

feat(crawler): add network request and console message capturing

2025-04-10 16:03:48 +08:00

test_download_file.py

fix: Update JavaScript execution in AsyncPlaywrightCrawlerStrategy to handle script errors and add basic download test case. ref #1215

2025-06-12 12:21:40 +02:00

test_http_crawler_strategy.py

feat(crawler): add network request and console message capturing

2025-04-10 16:03:48 +08:00

test_llm_filter.py

feat(crawler): add network request and console message capturing

2025-04-10 16:03:48 +08:00

test_max_scroll.py

feat: Implement max_scroll_steps parameter for full page scanning. ref: #1168

2025-06-05 16:40:34 +02:00

test_mhtml.py

feat(crawler): add network request and console message capturing

2025-04-10 16:03:48 +08:00

test_network_console_capture.py

feat(crawler): add network request and console message capturing

2025-04-10 16:03:48 +08:00

test_persistent_context.py

fix(browser_manager): serialize new_page on persistent context to avoid races ref #1198

2025-08-11 18:55:43 +08:00

test_robot_parser.py

feat(crawler): add network request and console message capturing

2025-04-10 16:03:48 +08:00

test_schema_builder.py

Update all documentation to import extraction strategies directly from crawl4ai.

2025-06-10 18:08:27 +08:00

test_stream_dispatch.py

feat(crawler): add network request and console message capturing

2025-04-10 16:03:48 +08:00

test_stream.py

feat(crawler): add network request and console message capturing

2025-04-10 16:03:48 +08:00

test_strip_markdown_fences.py

Fix agenerate_schema() JSON parsing for Anthropic models

2026-01-29 11:38:53 +00:00

test_url_pattern.py

fix: Enhance URLPatternFilter to enforce path boundary checks for prefix matching. ref #1003

2025-06-10 11:19:18 +02:00

tets_robot.py

feat(crawler): add network request and console message capturing

2025-04-10 16:03:48 +08:00