In this Dev&Chill project, we're creating a URL crawler. These can be used, for instance, to fetch data from public APIs or crawl a website for content. Here, I'll use it to obtain and keep track of view changes in my DigitalOcean tutorials.
This is part 4 out of 4.
This stream has no voice over; just music, coding, and captions.
In this episode, we finish our work on the Minicrawler application. We include the article URLS we want to monitor in the application config file, so that we can loop through all of the articles and obtain their views. We then set a crontab entry to execute the command every day.