Enhance Your AI with Website Content: Using URL Sources in Knowledge Base
Introduction: The URL Sources section of your Knowledge Base allows you to add specific website pages to train your AI to deliver accurate, brand-specific answers during customer conversations. While your AI automatically crawls your entire website and product catalog, URL Sources gives you control over which additional pages or external resources your AI should
reference when answering customer questions.
How URL Sources Works: URL Sources enables you to
Add specific web pages that contain important information for your customers Enhance your AI's knowledge with blog posts, FAQs, guides, or other content Ensure your AI references your most current and accurate information Track which URLs are being used in customer conversations Website Pre-Scanning: Your AI is already trained on your entire website content through our
automatic pre-scanning process. This means
Most of your website pages are already indexed and available to your AI The URL Sources feature is primarily for adding specific pages you want to emphasize or external resources Adding URLs to the Knowledge Base ensures those specific pages are prioritized when answering related questions If you've recently added new pages to your website, you can add them here to make them
immediately available to your AI
How to Add URLs
- Navigate to AI Training → Knowledge Base in your dashboard
Select the URL Sources tab
- Type a valid URL in the text field
- Click the Add URL button
- The URL will be processed, indexed, and made available for your AI to reference
- URL Guidelines: For best results, follow these guidelines when adding URLs:
Add pages with clear, relevant content that answers common customer questions Focus on pages with detailed product information, sizing guides, care instructions, or FAQs Ensure URLs are publicly accessible (not password-protected) Use fully-qualified URLs (including https:// prefix) Add each important page individually rather than just your homepage
Managing Your URLs
- Use the search bar to quickly find specific URLs in your list
View all added URLs in the list below the input field Each entry shows the URL, last scanned date, and times used in conversations Monitor the "Times used" column to see which URLs are most valuable to customers Note that the "Times used" counter updates periodically, so recently added URLs or recent
conversations may not be reflected immediately Handling Dynamic Content: Some websites use JavaScript to generate content dynamically,
which can present challenges
Content that is loaded via JavaScript after the page loads may not be fully captured during indexing Complex single-page applications (SPAs) might not have all their content properly indexed If you notice your AI is not answering questions about content on dynamic pages correctly,
try these solutions
- Create static versions of important content pages if possible
- Break down complex dynamic pages into simpler, content-focused pages
- For critical information on dynamic pages, consider adding it to Custom FAQs or File
Sources instead
Troubleshooting Common Issues
- Invalid URL Error: Ensure your URL is properly formatted and includes the https:// prefix
URL Not Found Error: Make sure the page exists and is publicly accessible Page Size Limit Error: Very large pages may exceed the maximum size limit Times Used Shows 0: This counter updates periodically, so recently added URLs or recent conversations may not be reflected immediately Dynamic Content Not Recognized: If your page uses JavaScript to load content, the AI may
not be able to access all information. Consider creating static versions of important content.
Best Practices
Add URLs for policy pages, sizing guides, and FAQ pages that customers frequently ask about Include URLs for important blog posts or articles that explain your products in detail Consider adding external resources that provide valuable information about your products Regularly review your URL list and remove outdated or unused pages
Test your AI's knowledge using the Test & Train feature after adding new URLs For dynamic content pages, verify the AI's knowledge by testing questions about that content
How Your AI Uses URL Sources: When customers ask questions, your AI will
Search through indexed content from your added URLs for relevant information Use this information to provide accurate, brand-specific answers Reference the appropriate URL when answering questions based on that content Always use the most up-to-date version of the content (pages are regularly re-indexed)
Comments
0 comments
Please sign in to leave a comment.