URL-based data scraping to create a knowledge base for AI Assistant

We’d like to provide a website URL, and the assistant will scrape the content to create knowledge base.

4 Likes

This would be great. I was also proposing to be able to provide the URL to a sitemap, so that the assistant could scrape the content of all the URLs listed in the sitemap:

Training AI Chat Bot with sitemap

1 Like

It would be great if this could be done dynamically when initializing the bot. In our case we have a car rental website and we get a lot of questions regarding the terms and conditions, insurance included, etc. This differs from car to car, so we are not able to load the chatbot with just one single file explaining this.

It would be great if at initialization we could load the chatbot with the terms and conditions for the car the user is looking at, so any answer is specific to that car.

Cheers,

1 Like

Hi there and welcome to the Community, @user18897 :wave:

Thank you so much for sharing your use case with us! We’ll have it in mind when considering this idea :slightly_smiling_face:

Thank you for this tool. Wouldn’t it be possible for the tool to read the content directly from the website instead of having to manually upload all the FAQs, for example?

1 Like

Hi @Matteo :wave:

Right now, it’s impossible to do, but we already have a similar idea on the Wishlist. I’ve moved your comment to the related thread, where we’ll keep you in the loop :slightly_smiling_face:

1 Like