C&C Analysis: Determine weight of words across identified sites

[gracieama]

Dependencies

• C&C Analysis: Paid Internship placement #84
• C&C Analysis: Unpaid Internship placement #106

Overview

We need to determine the weight of words across identified sites to determine what words and how often we should use them, on our website, to be competitive.

Action Items

• Guesstimate the size and replace the size missing label with size label.
• Discuss the feasibility of providing an analysis of
  • most prevalent words across both groups of sites
  • how the two groups of sites differ in their weighting of words.
  • average number of appearance of a word per page
  • words most often used in connection with each other
  • word weight separated by sales vs about or other non-sales information pages
• Make a list of sites from the two spreadsheets
• Build a scraping script to grab all the words from their pages
  • Have script remove any garbage words (and, for, the, etc.)
• Perform Analysis and provide presentation of results.

Resources/Instructions

• TWE: Paid Internship placement spreadsheet
• TWE: Unpaid Internship RA