Skip to content

Latest commit

 

History

History
191 lines (143 loc) · 12.7 KB

CHANGELOG.md

File metadata and controls

191 lines (143 loc) · 12.7 KB
Raw

Changelog

9.5.1 (2024-06-10)

🐛 Bug Fixes

  • add support for data with global id fields that does not use change detection (e4ce1a6)
  • set update status for global id datasets (10dd9d0)

9.4.0 (2021-09-08)

Features

  • add sendgrid email option to config and messaging (345)

Bug Fixes

  • include global id fields in hashing (344)
  • preserve global id's in output (342)
  • ignore the forklift hash field if it already exists (343)

9.3.0

Features

  • add ability to send lift report to slack (9123575)
  • add --profile switch to build command (7dbbf3d)
  • add Pallet.process_on_fail (6354f54)
  • add ability to ignore changes in requires processing (0488862)
  • add build cli command (c66bbce)
  • add changeDetectionTables config value and associated docs (6cd30c9)
  • add check for Pro license and email on error (b13ee91), closes #312
  • add machine name to global error email (1dc7560)
  • add pallet arg to gift-wrap and tweak signature (be80b99), closes #307
  • add server start/stop errors to ship reports (4ce1bd8), closes #279
  • allow configuration of the standalone logging level (1aa61f8)
  • add change detection implementation (6644df8)
  • log (debug) message when data is not found during build (fcee3e0)
  • post shipping report to slack (f947f96)
  • raise custom exception rather than return None (a0e6ecf)

Bug Fixes

  • allow for UNC pallet paths (f2c69e4)
  • create safe access middle man (6526091)
  • don't fix every source name (2f6b32c)
  • explicitly specify no test for change detection append (b435f11)
  • fix bug preventing the detection of casing schema changes (70be5a5), closes #277
  • fix mocked method name (7ff5f87)
  • handle errors posting report to slack (fb7af5a)
  • handle mis-matching crates between pallet and packing list (f8d853b)
  • handle missing changeDetectionTables config value (50913ba)
  • handle more database sources name formats (663fcc0)
  • fix int string concat (e3158da)
  • log actual services being shut down during gift-wrap ship (dcabf4d)
  • make sure text is actually text (d284f27)
  • method syntax (c8bc253)
  • prevent change detection from skipping initial data import (14d7421)
  • stringify exception for crate exception message (24f118e)
  • perf: remove unnecessary call to exists (85919f4)
  • make append more flexible with differing schemas (3d76902), closes /github.com/agrc/forklift/blob/d442f7b7d866527ab886fbd2db82e1afa7af7072/src/forklift/core.py#L90
  • fix missing imports (eb8fa51)
  • remove duplicate check for pallet success (3f8a5cd)
  • remove the creation of "gift-wrapped" subfolder (733af00)
  • show message and set default (d4ca151)
  • smarter skipping of shape, shape length and oid fields during compare (552f04c)
  • tweak slack ship report for server start/stop errors (89abc68)
  • use geographic transformation environment in change detection (d442f7b)
  • slack: appended fields need to to_text (987b97f)
  • use correct prop name for pallet result and message (e91ed19)

9.2.1

bug fixes

  • use status color for pallet message in ship report
  • update ship report with correct pallet status

9.2.0

features

  • allow shipping of pallets that did not lift all crates successfully #294
  • replace flake8 and pep8 with pylint
  • add init_standalone to allow pallets to be run more easily outside of forklift
  • add packing slip to report email
  • add forklift version to email

bug fixes

  • disable ssl cert validation to gis servers
  • show pallet import errors in report
  • show git update errors in report
  • apply create results to packing slip for use in ship
  • show post_copy_process and ship times in ship report

9.1.0

  • feat: allow for non github repos
  • feat: create cli option for gift-wrapping data
  • feat: implement special-delivery command lift
  • docs: location for user install
  • docs: markdown lint fixes
  • fix: CVE-2018-18074 More information
  • fix: return unhandled crate exceptions as strings
  • fix: update version of pytest-cov
  • fix: url creation based on shorthand
  • fix: use PAT, dict syntax, and log repo name without token

9.0.1

  • Better requests to ArcGIS Server and handling of errors.
  • Docs: Better getting started steps.
  • Removed multiprocess for git-update. Forklift was randomly hanging on git-update.
  • Make default warehouse location consistent with other default paths.
  • Account for ERROR result in crate report.
  • Allow pallets that don't have any crates to copy data to dropoff by overriding requires_processing.

9.0.0

  • Added --send-emails override option for both lift and ship commands.
  • Added ERROR as a possible result type for crates.
  • Removed unused crate property, source_primary_key
  • BREAKING CHANGE: Split up lift and ship to be independent commands.
    • Replaced arcgis server env variables with config.json properties to allow for managing a silo'd architecture or multiple machines not in a cluster
    • Replaced env variables with config.json properties for consistency.
    • Ship now shuts down the entire ArcGIS Server machine rather than specific services. It also now does this one machine at time to minimize downtime.
    • Removed static data processing since it can now be accomplished by dropping the data into the dropoff folder.
  • Removed tox because it's incompatible with conda.
  • Enhanced the remove repo command to also delete the repository folder from disk (#134).
  • Removed the check for python version 3.
  • Switched from nose to pytest for running tests.

8.5.0

  • Add support for m & z values in the destination geometry (#223).
  • Add new crate warning type (UPDATED_OR_CREATED_WITH_WARNINGS) to address the issue of processing crates with warnings. Now WARNING means there was a warning and the data was not updated and UPDATED_OR_CREATED_WITH_WARNINGS means there was a warning and the data was updated (or created).
  • Add Crate.was_updated() method to save code in pallets when you want to check to see if the data for a crate was updated.

8.4.2

  • Fix unicode bug with -h help CLI option.
  • Fix bug in timeout code.
  • Increase timeout value.
  • Try to enforce running only on python 3.

8.4.1

  • Add a timeout on http requests to avoid infinite hanging requests.

8.4.0

  • Better management of parallel processes.
  • Add process time per pallet to report (#215).
  • Implement --skip-copy parameter to lift allowing the user to skip copying data to copyDestinations.

8.3.1

8.3.0

  • Parallelize the starting & stopping of ArcGIS Server services (#118).
  • Parallelize git_update (#204).
  • Fix the thin red line showing up at the top of successful report emails.
  • Add warning to reports for duplicate features (#185) and empty destinations (#197).
  • Give static copy errors their own line on the report.
  • Add hostname to report email subject and body (#182).

8.2.0

8.1.1

  • Fixed bug that prevented pallets that through errors during pallet.build() from showing up in the report.
  • Update tests and associated data for Pro 2.0.

8.1.0

  • Pallet.build is now called on all pallets even when only a single pallet is run #186
  • *.lock files are ignored when copying from staging to copy_data destinations.
  • Removed the deletion of the scratch GDB from the end of the forklift process. ArcGIS Pro was having issues with this and it's already being removed at the beginning of the process.

8.0.0