NEW Search Engine Stuff: CBP & USAO Press Releases and Fast Access to CBP Tweeted Images
Every day three (3) tasks require overnight attention Update the Search Engine results (DAILY: DL 15m/Process 1+hr) Scrape 70+ CBP Twitter accounts for text, pictures and videos (DAILY: DL 1+hr/Process 2+hr) Download CBP Weekday Press releases (WEEKDAYS: DL 15m/Process 1-3hr) This does not include maintenance of in-house software used, random tweets added, and 8-12 hours of videos and podcast playing in the background. Four (4) NEW THINGS Soon we will restart processing USAO (United States Attorneys' Offices) press releases. Details as the process restarts. Soon our search engine website will have a "dedicated" webpage for links to CBP press releases. Details as the process rolls into place. In a few days, we will describe - in detail - how our search engine works and how you can help. On the near horizon is access to CBP Tweeted Images. Details below TL;DR (Too Long; Didn't Read) Daily, #BorderObserver will scrap 70+ CBP twitter accounts for the text, images and vid...