Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

36 make pandasstandardscaler for hugs #38

Merged
merged 14 commits into from
Nov 4, 2024

Commits on Apr 26, 2024

  1. Create pandas_standard_scaler.py

    Inital upload of a standard scaler that supports pandas dataframes as input. Maybe it should be renamed to DataFrame scaler to match the parser_to_dataframe.py file...
    sgoldenCS committed Apr 26, 2024
    Configuration menu
    Copy the full SHA
    676d640 View commit details
    Browse the repository at this point in the history
  2. Configuration menu
    Copy the full SHA
    574d0ac View commit details
    Browse the repository at this point in the history
  3. Started implementation of PandasStandardScaler

    Using scikit-learn's StandardScaler as a base. Saving and loading is a bit tricky as the internal state of the scikit-learn implementation isn't easily saved. It looks like you can save it's internal __dict__ and then set the attributes on load, but I'm not sure if this is robust...
    sgoldenCS committed Apr 26, 2024
    Configuration menu
    Copy the full SHA
    ca21fcf View commit details
    Browse the repository at this point in the history

Commits on Apr 29, 2024

  1. Full implementation of scaler with unittests

    The implementation avoids using scikit-learn entirely for a number of reasons including no option for axis changes and no option for changing the epsilon value when dealing with small variances.
    sgoldenCS committed Apr 29, 2024
    Configuration menu
    Copy the full SHA
    79566d2 View commit details
    Browse the repository at this point in the history
  2. Configuration menu
    Copy the full SHA
    a3f758f View commit details
    Browse the repository at this point in the history

Commits on May 2, 2024

  1. Configuration menu
    Copy the full SHA
    83f019f View commit details
    Browse the repository at this point in the history

Commits on May 8, 2024

  1. Simplify save/load config

    Saving and loading configurations are now done by utility functions in the utils folder. This simplifies the modules and allows for unit testing on the config I/O functions outside of any module.
    Utility functions try to properly handle FileNotFound and FileExists errors.
    sgoldenCS committed May 8, 2024
    Configuration menu
    Copy the full SHA
    a001284 View commit details
    Browse the repository at this point in the history

Commits on May 9, 2024

  1. Rename IO functions for yaml configurations

    [save/load]_config --> [save/load]_yaml_config to avoid confusion if we want another version for JSON or something else.
    sgoldenCS committed May 9, 2024
    Configuration menu
    Copy the full SHA
    de25bd6 View commit details
    Browse the repository at this point in the history
  2. Update pandas_standard_scaler.py

    Adding lots of additional documentation. Some functions aren't fully documented, but this is a very good start.
    sgoldenCS committed May 9, 2024
    Configuration menu
    Copy the full SHA
    1a46420 View commit details
    Browse the repository at this point in the history
  3. Configuration menu
    Copy the full SHA
    447a444 View commit details
    Browse the repository at this point in the history
  4. Configuration menu
    Copy the full SHA
    dac7a31 View commit details
    Browse the repository at this point in the history
  5. Format pandas_standard_scaler using black

    Unittests still work and changes seem to mostly be single quotes to double and removing spaces.
    sgoldenCS committed May 9, 2024
    Configuration menu
    Copy the full SHA
    7ff070a View commit details
    Browse the repository at this point in the history

Commits on Jun 5, 2024

  1. Dummy upload

    sgoldenCS committed Jun 5, 2024
    Configuration menu
    Copy the full SHA
    f759eba View commit details
    Browse the repository at this point in the history
  2. Revert "Dummy upload"

    This reverts commit f759eba.
    sgoldenCS committed Jun 5, 2024
    Configuration menu
    Copy the full SHA
    1ebc35d View commit details
    Browse the repository at this point in the history