Enable Batch Web Scraping from Multiple Seed URLs in Knowledge Base

Currently, when adding data sources to the Knowledge Base via Web Scraping, I can only scrape from one “seed” URL per folder at a time. If I add multiple URLs to the “Configure” dialog, only the first one is actually scraped.

It would be extremely helpful to allow batch web scraping from multiple seed URLs—so that all specified URLs are scraped in one go, each following their own internal links up to the page limit. This would save significant time, especially when needing to cover multiple specific documentation sections or subdomains, without having to create a separate folder/source for each seed URL.

Use case:
– Building a comprehensive internal knowledge base from several distinct pages or subsections
– Keeping content organized and minimizing manual setup effort
– Faster onboarding for teams importing multiple sources at once

Thank you for considering this improvement!