Helps perform the following operations on delta tables.
- Register table in catalog
- Vaccum table
- Optimize table
- Restore table
- Delete from table
- Drop table
- FSCK Repair table
|Database name||Database name||False|
|Table name||Table name||False|
|File path||File path for delta table||False|
|Action||Action to perform on the table||True|
At lease one value from table name or file path needs to be provided.
Register table in catalog
This will register the data at mentioned file path as a table in catalog.
Recursively vacuum directories associated with the Delta table. VACUUM removes all files from the table directory that are not managed by Delta, as well as data files that are no longer in the latest state of the transaction log for the table and are older than a retention threshold. The default threshold is 7 days.
To know more about vaccum click here.
|Retention hours||Retention threshold||False|
Optimizes the layout of Delta Lake data. Optionally optimize a subset of data or colocate data by column. If colocation is not specified, bin-packing optimization is performed by default.
To know more about optimize click here.
|Where clause||Optimize the subset of rows matching the given partition predicate. Only filters involving partition key attributes are supported.||False|
|ZOrder By||List of columns to perform ZOrder on||False|
Restores a Delta table to an earlier state. Restoring to an earlier version number or a timestamp is supported.
|Restore via||Restore the table via timestamp or version||False|
|Value||Value to restore on||False|
Delete from table
Delete removes the data from the latest version of the Delta table as per the condition specified below. Please note that delete does not remove it from the physical storage until the older versions are explicitly vacuumed.
|Where clause||Condition which needs to be satisfied to delete a row||True|
This will drop the table from catalog and remove the files.
FSCK Repair table
Removes the file entries from the transaction log of a Delta table that can no longer be found in the underlying file system. This can happen when these files have been manually deleted.
To know more about fsck repair click here.