AI Chatbot: Train your assistant using webpage URLs 🚀

Training your AI Chatbot widgets just got even easier, since now you can create a knowledge base for your assistant using any public link :tada:

The widget lets you add up to 200 URLs, and our system will automatically process and format the content for your chatbot. This speeds up training and makes your chatbot smarter and more accurate by pulling information from those pages, just like it does with Files, QA, and Text Blocks.

Watch this video to see the feature in action:


Guys, have you had a chance to test it yet? Did you like the results? Share your feedback in the comments — we’re all ears :wink:


Back to Changelog →

7 Likes

Great at that this has finally arrived!

Two questions:

  1. Will the system train on the first 200 URL’s it comes across or is there a way to “guide” in in which ones to skip?
  2. Does the system run scans/updates on the trained URL’s so that if you make changes to a page it will automatically do a refresh run (say every 24 hours) to access the updated data?

Great work, team! Loving the progressions!

3 Likes

Thanks, a good start ! But it would be nice to be able to directly add a sitemap, because it’s a bit tedious and not “very automated” to have to paste the URL of each page.

Will it automatically crawl the destination pages of the links within a page?

4 Likes

Hi there, @fcweesp.nl :waving_hand:

Thank you for your questions!

  1. Just to clarify, each widget can include up to a maximum of 200 URLs. If you don’t want the chatbot to use information from a specific page, the best approach is to remove that link from your knowledge base.

  2. Currently, any changes made on a page won’t update automatically in the widget. However, you can manually refresh the content by clicking the “Retrain” button:

However, I agree that the automatic update would be more convenient and I’ve added this idea to the Wishlist on your behalf - Automatically update the knowledge base after any changes made on the page (training with URLs option)

3 Likes

Hi there, @Dune :waving_hand:

Thank you so much for the feedback!

While we are currently working on the sitemap training, it won’t automatically crawl all pages within a website.

However, I completely understand your point, and I’ve added this suggestion to the Wishlist on your behalf - Automatically crawl all pages within a website to a knowledge base

If more users upvote this idea, it might be considered in the future :slightly_smiling_face:

3 Likes

I have used an AI script I created to scrape my product sitemap to a text file, cleaned up extra lines and punctuations the uploaded the text file to the bot. Yes, when you have a couple of hundred product pages, you want a scrape solution.

2 Likes

3 posts were split to a new topic: Product links don’t work in AI Chatbot