Skip to content

A Neural Network based generative model for captioning images using Tensorflow

License

Notifications You must be signed in to change notification settings

metalaman/image-caption-generator

 
 

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

35 Commits
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 

Repository files navigation

Image Caption Generator

Work in Progress

A Neural Network based generative model for captioning images.

##Pre-Requisites:

  1. Tensorflow
  2. NLTK
  3. pandas
  4. skimage
  5. Download Flickr30K Dataset: Images and results_20130124.token
  6. Download Pre-Trained InceptionV4 Tensorflow graph from DeepDetect available here

##Procedure to Run:

  1. Clone the Repository to preserve Directory Structure
  2. Put results_20130124.token and Flickr30K images in Dataset Folder.
  3. Put inception_v4.pb in CNNs folder
  4. Run train.py with parameter resume = 0, to start fresh training procedure. resume = 1 restores training process from latest saved model.
  5. Run test.py with path=IMAGE_PATH/URL to generate captions OR follow test.ipynb

##Reference: Show and Tell: A Neural Image Caption Generator

-Oriol Vinyals, Alexander Toshev, Samy Bengio, Dumitru Erhan

##License: Protected Under BSD-3 Clause License.

About

A Neural Network based generative model for captioning images using Tensorflow

Resources

License

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published

Languages

  • Jupyter Notebook 99.0%
  • Other 1.0%