Website Content Scanning

Reading Time: 3 minutes
Download Markdown

Overview

Scan Website (WPiko Chatbot Pro) turns your pages into AI-written questions and answers and adds them to your chatbot’s knowledge base. Q&A pairs help the chatbot find precise answers, so replies are sharper than with plain page text. There’s no limit on how many pages you can scan.

Scan Website vs. Quick Learn

Quick learn (free)Scan Website (Pro)
How it worksCopies the page textAI writes questions & answers
QualityGood starting pointSharper, more accurate replies
Speed and costReady in seconds, no AI costUses AI tokens per page
PagesUp to 10Any number

You can use both. When you scan a page, it’s automatically removed from Quick learn, so nothing is stored twice. Quick learn marks those pages as “Covered by Scan Website”. If you delete a scanned page’s file, Quick learn shows the page as available again.

Requirements

Scanning a Page

  1. Go to WPiko Chatbot → Setup & AI → AI Configuration and click Scan Website in the Train AI Assistant section.
  2. In Search Page, type at least 3 letters and select a page from the results. Published, private, draft and pending pages can be scanned (non-published pages are labelled).
  3. Click Generate Q&A.
  4. Wait for the status to go from “Generating Q&A content…” to “Uploading to the knowledge base…” and “File uploaded successfully”.

Q&A is generated with GPT-6.1 Sol, whatever model your chatbot uses.

Large Pages

Large pages are split into parts automatically, so you don’t need to break them up yourself. If any part fails, the whole result is discarded instead of saving incomplete Q&A. Just try again. Developers can tune the splitting with the wpiko_chatbot_qa_chunk_threshold, wpiko_chatbot_qa_chunk_size and wpiko_chatbot_qa_chunk_overlap filters.

Q&A Download Option

Tick Enable Q&A Download and click Save Setting to download a text copy of the generated Q&A for each page you scan. This is useful for reviewing what the chatbot learned.

Managing Scanned Pages

The Website Pages List shows every page you’ve scanned. Delete a page’s file to remove it from the chatbot’s knowledge. Rescan a page after you change it so the chatbot learns the new content.

License

If your license shows as expired (for example when a free trial ends), you can still view and manage existing scanned pages, but you can’t scan new ones until you activate a lifetime license. Licenses bought on wpiko.com never expire.

Troubleshooting

  • Generation failed: try again. Check Manage & Tools → Debug Log for the OpenAI error, for example no credit or a rate limit.
  • Page not found in search: enter at least 3 letters of the page title. Only Pages (not posts) can be scanned.
  • Upload failed: check the OpenAI connection with Test connection on the API Key screen, then retry.
  • Chatbot still gives old answers: rescan the page and delete the old file from the Website Pages List.
Have a Question?