Intelligent-Web-Information-Retrieval

A web retrieval agent that navigates links and GET forms, renders JavaScript with Scrapling, reads tables and PDFs, resolves conflicting evidence, and answers with verified citations. The latest agent workflow uses the local Qwen model from checkpoint 5 through a resident Transformers server. No ChatGPT login or hosted LLM API is needed. The model is Qwen/Qwen3-4B-Instruct-2507 with Transformers 5.20.2, BF16 weights, SDPA attention, deterministic generation and a 128-token output cap. These match the checkpoint's model configuration. The HTTP server keeps the model loaded between CLI queries; the agent's planning, extraction and review prompts are from the newer project. Features: - Navigate on the starting website, follow relevant links and submit discovered GET search forms. - Extract structured text from HTML and tables; render sparse JavaScript pages with Scrapling Chromium. - Read selectable-text PDFs and cite their page numbers. - Validate source passages, review meaning, handle competing claims and abstain when evidence is insufficient. - Run 33 local and public-site evaluation cases with traces and reports.