Skip to content
This repository has been archived by the owner on Oct 14, 2022. It is now read-only.

A lookup tool for data from LAHD. Repository has been archived 2022-10-13.

License

Notifications You must be signed in to change notification settings

CityOfLosAngeles/hcid-lookup-tool

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 

Repository files navigation

HCID - Lookup Tool (no longer used by the City of Los Angeles)

About

Single Lookup Tool - The Department maintains over 8 different database and data sources (Excel & Access files) containing information about different rental properties. The Department often needs to lookup and attribute different programs to these units. This tool would consider of an unified ETL pipeline and deduplication service that allows staff to lookup properties and see which programs have been used, along with alternate addresses, etc.

Sponsors

Rushmore Cervantes, Laura Guglielmo & Luz Santiago

Partners

UCLA Extension - The Coding Bootcamp

Demo Videos

File processing demo | Upload demo | Search demo

City Team

Grace Benedicto Donya Plazo (Code) Stephen Lew Rollin Nelson Emmanuel Yuen Bryan Kirkness (Code) Franklin Campos Rent Compliance Neighborhood Development

Development Team

Phase 1

Andrey Orlov Ryan House Matt Whitcomb

Developed backend server that provides a response to a single query of relations of various databases.

Phase 2

Ben Chang Charlotte Anongos Daniel Yeh

Developed frontend sever using react with redux with a clean visual of the query results.

Goals

  1. Single query of multiple data sources to provide all information on a single (and related) property i.e. Property Information Sheet/Snapshot
  2. Minimize need to search using multiple platforms.
  3. Ensure non-duplication of data
  4. Long-term goal: Additional query options. Generate a report that produces results from the search of the multiple data sources based on shared common criteria. Criteria search vs. Property Search. i.e. properties that have a land use covenant, financed new construction that are now in the Rent Escrow Program.

Deliverables

Lookup Tool - a website with an automated ETL process on the data exports and a search and lookup functionality.

Load Script

To load the data, you'll need a database called hcid-disp running in postgres. You'll also need the data files stored in the data directory, which is ignored from git in the .gitignore.

Additionally, you'll need to install csvkit. Run pip install csvkit to install the package.

Run etl/load.sh from the project root dir and it should create the data tables and run the join query for the APN master table.

Tested using ZSH on Ubuntu and OSX.

Data Sources

HIMS BIMS CCRIS Rent Preservation Properties - Historical Access Database Land Use Neighborhood Development Homeownership Other Non-City Tax Credits and Financed

We've pulled these togehter into a single SQL Server database backup, called datalake.bak. The Database name is DataLake.

Local Deployment Instructions

There are two servers running for this application. *Backend server using node & express in root folder *Frontend server using react in "app" folder

  1. Install dependencies for root and app folder
npm install
  1. Install postgreSQL
  2. Create user for prostgres named "username"
  3. Start backend & frontend servers for root and app folder
npm start

Resources

LA City Geohub Parcel | LA County APN Change File | LA County Parcel Data

Technology / Node Packages

Node v6.x Postgres v9.6 Sequelize ORM Babel BlueBird npm Parse-address npm Fast-csv npm Multer npm React React-Redux Google Autocomplete

About

A lookup tool for data from LAHD. Repository has been archived 2022-10-13.

Resources

License

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published