Add Support for Website Data Source for Minds

[tmichaeldb]

This PR adds a new WebConfig subclass of DataSourceConfig. Specifically:

• Updated agent.add_webpages to support crawl_depth and regex based URL filters
• Added WebConfig class that configures web crawling a list of URLs for Minds

Part of ML-96

[github-actions[bot]]

Coverage Report

File	Stmts	Miss	Cover	Missing
mindsdb_sdk
agents.py	207	52	75%	33, 101, 104, 112, 120, 138, 156, 166, 169, 173, 175, 177, 179, 181, 183, 245, 258, 262–277, 289, 298–302, 309–310, 356, 368–369, 419, 468–469, 472, 479, 500–502, 506–510
databases.py	45	2	96%	109, 137
handlers.py	39	1	97%	77
jobs.py	97	7	93%	41, 53, 81, 85, 147–150
knowledge_bases.py	126	15	88%	58–61, 155, 159–166, 171–175, 254–257, 326, 343
ml_engines.py	42	3	93%	94, 126, 128
models.py	210	19	91%	109, 140–141, 222, 231, 233, 303, 339, 348, 372, 397, 491, 499, 518, 534, 542, 567, 571, 584
projects.py	64	1	98%	160
query.py	13	1	92%	14
skills.py	53	3	94%	43, 45, 49
tables.py	130	15	88%	140–142, 145, 165, 192, 203–204, 209, 224, 227, 321, 342–347, 356, 376
views.py	37	2	95%	105, 138
mindsdb_sdk/connectors
rest_api.py	225	42	81%	19–29, 35–36, 51, 54–55, 75–77, 98, 101, 108–111, 144–152, 173–174, 209–212, 226–227, 281–286
mindsdb_sdk/utils
mind.py	41	41	0%	1–119
openai.py	85	30	65%	37–40, 83–85, 107, 148–158, 215–216, 234–240, 258–276
table_schema.py	21	21	0%	1–54
TOTAL	1522	255	83%

Tests	Skipped	Failures	Errors	Time
23	0 :zzz:	0 :x:	0 :fire:	10.293s :stopwatch: