deepnews_final

deepnews project finalized scripts

Description of Files (in sequence)

Data Extraction:

Processing:

process_small2.py :: File to splitting data to Train, Dev, Test sets (input: directories of low/high quality news; output: directories of train, dev, test)
word2int_cbow.py :: File for converting text to integers for embedding look up and taking average over words for cbow (intput: directories from process_smal2.py output saved as pickles)
SamplePOS.py :: generates sample POS tagged text

Models & Testing:

feedforward_cbow_prints.py :: File for running the CBOW feedforward model (input, 100 dimensional averaged vectors per doc; output: generates a print_files directories with logs)
centroids.py :: File to binary classify based on averaged centroids as comparison (input: pickles from word2int_cbow.py)

Description:

Name		Name	Last commit message	Last commit date
Latest commit History 12 Commits
DevRNN_classifier_withff.py		DevRNN_classifier_withff.py
LM_classifier_feedforward.py		LM_classifier_feedforward.py
LM_revised_POS_dev_good_bad.py		LM_revised_POS_dev_good_bad.py
POSgen_batch.py		POSgen_batch.py
POSgen_dev.py		POSgen_dev.py
README.md		README.md
SamplePOS.py		SamplePOS.py
Stopwords.txt		Stopwords.txt
centroids.py		centroids.py
feedforward_cbow_prints.py		feedforward_cbow_prints.py
get_content.py		get_content.py
get_content_hp.py		get_content_hp.py
glove2dict.py		glove2dict.py
glove2matrix.py		glove2matrix.py
newer_DevRNN_classifier.py		newer_DevRNN_classifier.py
numpy2pickle.py		numpy2pickle.py
pickle2numpy.py		pickle2numpy.py
plot_dev_cost.py		plot_dev_cost.py
process_small2.py		process_small2.py
readInput.py		readInput.py
revived_LM_POS.py		revived_LM_POS.py
two_layer_RNN.py		two_layer_RNN.py
word2int_cbow.py		word2int_cbow.py

Provide feedback