you need a web crawler and scraper.
The web crawler looks at all or a filtered list of sites to determine if they are suitable for scraping
based on the subject 'Travel' (an indexer)
They can both be in the same module, but it makes sense to separate into two separate modules.
Scrapy is a common: https://scrapy.org/ web crawler/scraper - I haven't used it as I prefer to write my own, but it is popular.
Here's a site to help with scrapy: https://www.datacamp.com/community/tutor...apy-python
You can write your own as well
find packages here: https://pypi.org/search/?q=%22web+crawler%22&o=
for blogs, google 'web crawler python 3'
web scraper - Suggest tutorials on this forum
web scraping part 1
web scraping part 2
The web crawler looks at all or a filtered list of sites to determine if they are suitable for scraping
based on the subject 'Travel' (an indexer)
They can both be in the same module, but it makes sense to separate into two separate modules.
Scrapy is a common: https://scrapy.org/ web crawler/scraper - I haven't used it as I prefer to write my own, but it is popular.
Here's a site to help with scrapy: https://www.datacamp.com/community/tutor...apy-python
You can write your own as well
find packages here: https://pypi.org/search/?q=%22web+crawler%22&o=
for blogs, google 'web crawler python 3'
web scraper - Suggest tutorials on this forum
web scraping part 1
web scraping part 2