When you sit at a computer you have the entire world at your finger-tips. It takes a lot of skill and a lot of practice to strain the HTML Soup. With this application we hope to Strain the Soup from sevral pages in order to collect population statistics for Blizzards World of Warcraft.

##INSTALL

you will need to have a few modules installed to use this

easy_install progressbar
easy_install prettytable
# or
pip install progressbar
pip install prettytable

Pretty simple little program. IceMelt.py is Stage 1 data scraper building a database based off the wowprogress export data Depending on CPU Core speed this might take some time however running on a Dell Poweredge 2850 yeilds a complete guild table in roughly 25 minutes Stage 2 is the Cold-air-funnel.py This will pull guilds/region_ids/realms from the guild table look up each roster on blizzard formatting the URL: "http://us.battle.net/wow/REGION/guild/REALM/GUILD/roster" This will give us a Guild Roster with toon names in it Cold-air-funnel.py will parse that roster and "Funnel" the data into the Chars table at last check run time is looking to be roughly 11 Days. Stage 3 has not been implimented as of yet how ever future design plans include a full cross refrance system for every field of data

#NOTE:

before running this you should probably set the config/ice.conf settings according to your database envirnmonet. Also if youd like to use the AHBot scripts you will need to provide your own API Key from Blizzard. https://dev.battle.net/ later on an installer will set this for you but for right now this is a per user requirment