This project involves development of a custom site crawler for a well structured site. It will be comprised of two seperate tools:
1) A tool which will perform a site search (taking a search parameter as input (essentially calling something like [login to view URL]) and output 5 needed fields for each search result. For a single search there will be many results per page, as well as pagination. We will take all the results and output them as a list of dictionaries in JSON format.
2) As input take a a URL of a given record and as output produce a JSON file which provides a set of out of 4 types of parsed out elements.