Skip to content

Commit

Permalink
Merge pull request #1831 from treasure-data/td_partial_delete
Browse files Browse the repository at this point in the history
Deprecate td_partial_delete operator
  • Loading branch information
aamine authored Aug 27, 2024
2 parents eae89b0 + 44da46a commit e323470
Show file tree
Hide file tree
Showing 3 changed files with 80 additions and 72 deletions.
71 changes: 0 additions & 71 deletions digdag-docs/src/operators/td_partial_delete.md

This file was deleted.

79 changes: 79 additions & 0 deletions digdag-docs/src/operators/td_partial_delete.rst
Original file line number Diff line number Diff line change
@@ -0,0 +1,79 @@
td_partial_delete>: Delete range of Treasure Data table
======================================================

**td_partial_delete>** operator deletes records from a Treasure Data table.

.. warning::

This operator is deprecated. Use DELETE function in Trino/Presto by td operator instead.

Please be aware that records imported using streaming import can't be deleted for several hours using td_partial_delete. Records imported by INSERT INTO, Data Connector, and bulk imports can be deleted immediately.

Time range needs to be hourly. Setting non-zero values to minutes or seconds will be rejected.

.. code-block:: yaml
+step1:
td_partial_delete>: my_table
database: mydb
from: 2016-01-01T00:00:00+08:00
to: 2016-02-01T00:00:00+08:00
Secrets
-------

When you set those parameters, use `digdag secrets command <https://docs.digdag.io/command_reference.html#secrets>`.

- **td.apikey**: API_KEY
The Treasure Data API key to use when running Treasure Data queries.

Parameters
----------

- **td_partial_delete>**: NAME

Name of the table.

Examples:

.. code-block:: yaml
td_partial_delete>: my_table
- **database**: NAME

Name of the database.

Examples:

.. code-block:: yaml
database: my_database
- **from**: yyyy-MM-ddTHH:mm:ss[Z]

Delete records from this time (inclusive). Actual time range is ``[from, to)``. Value should be a UNIX timestamp integer (seconds) or string in ISO-8601 (yyyy-MM-ddTHH:mm:ss[Z]) format.

Examples:

.. code-block:: yaml
from: 2016-01-01T00:00:00+08:00
- **to**: yyyy-MM-ddTHH:mm:ss[Z]

Delete records to this time (exclusive). Actual time range is ``[from, to)``. Value should be a UNIX timestamp integer (seconds) or string in ISO-8601 (yyyy-MM-ddTHH:mm:ss[Z]) format.

Examples:

.. code-block:: yaml
to: 2016-02-01T00:00:00+08:00
- **endpoint**: ADDRESS

API endpoint (default: api.treasuredata.com)

- **use_ssl**: BOOLEAN

Enable SSL (https) to access to the endpoint (default: true)
2 changes: 1 addition & 1 deletion digdag-docs/src/operators/treasure_data.rst
Original file line number Diff line number Diff line change
Expand Up @@ -11,7 +11,7 @@ Treasure Data operators
td_for_each.md
td_wait.md
td_wait_table.md
td_partial_delete.md
td_partial_delete.rst
td_table_export.md
td_result_export.md

0 comments on commit e323470

Please sign in to comment.