v0.1.20

Key Highlights

• Support to request anonymization on a per-SafeLoader invocation
• Pebblo TextLoader support
• Updated Entity Classifier
  • Added support for Azure Client Secret
  • Added support for email-address
  • Improved credit-card matching
• Sqlite state storage is now a supported and preferred option

Deprecation Notice

• File-based state storage will be deprecated in the next release, v0.1.21. It is recommended to switch to type: db in the pebblo configuration. See https://daxa-ai.github.io/pebblo/config#storage for more details.

Configuration

For a custom configuration file, please refer to https://daxa-ai.github.io/pebblo/config#default-configuration for the supported fields

What's Changed

• Revert docker_release.yml changes by @srics in #551
• Add Ruff sort imports command to the format_diff target by @Raj725 in #549
• added changes for documentation 0.19 by @gr8nishan in #556
• added multi-arch build for docker. by @rajburnwal07 in #553
• New field added client-secret for Azure client secret ID. by @dristysrivastava in #555
• Samples: text loader sample using PebbloTextLoader by @Raj725 in #539
• Adding anonymize_snippet as a input filed in /loader/doc API by @dristysrivastava in #558
• Adding deprecation message for db storage type as file in config by @dristysrivastava in #559
• Added Pebblo Docs Version - 0.1.19 by @rutujaac in #563
• docs: update README.md by @eltociear in #562
• Added the last released versions of langchain-community to run tests by @Rohan-sss1 in #561
• added sonarscan workflow. by @rajburnwal07 in #566
• Adding anonymizeSnippets in reports config by @dristysrivastava in #569
• Returning default value if no config path is passed by @dristysrivastava in #571
• samples: Added readme file, metadata to Text loader sample by @Raj725 in #565
• Update env var for Sonarscan workflow by @rajburnwal07 in #570
• Add LinkedIn shield button by @srics in #572
• Updated anonymizeSnippets location from classifier to reports in config.yaml by @dristysrivastava in #573
• Updating file deprecation msg by @dristysrivastava in #574
• Update LinkedIn URL by @sridhar-daxa in #576
• Update pebblo version to 0.1.20rc1 by @srics in #577
• DB query optimization and reducing sqlalchemy logs by @shreyas-damle in #575
• Added changes for Email Address and Credit Card Number by @gr8nishan in #580
• Docs: table for Pebblo Safe loader args/parameters description by @Raj725 in #568
• added changes for email address documentation by @gr8nishan in #582
• Update pebblo version to 0.1.20 by @shreyas-damle in #583

New Contributors

• @Rohan-sss1 made their first contribution in #561

Full Changelog: v0.1.19...v0.1.20