Start Scraper to populate Test Server with Books we like

User Story

• As a: stakholder,
• I want: an automatic way of gathering books
• so that: the site can display detailed information about each book and those books be used in the machine learning algorithm.

Functional Requirements

• List of books that will be searched in amazon to find the book (requires author and title)
• Automated python script to search amazon for each book and extract relevant information
• store all information into the ece651 database on localhost
  • Store Book Information
  • Store Author Information
  • Store Category Information
  • Store Amazon Details information
  • Link data above using the linking tables: AuthorBooks, Book_Category
• Script should check the database first to see if the book was already filled in before searching for more information
• Export data into a sql script so we have some dummy data to test with and to deploy with
  • This is important as we don't want to hammer the amazon servers every time we need to get this information again for our local machines and when running automated testing
• Update the SQL to include the GRANT USAGE on the public schema for all users
• Update the SQL and Schema diagram to include the number of reviews from Amazon

Description

This is the automatic scraper, but in the minimum viable product form. More issues can be added on to this in later sprints.