iceberg_meta

Name

SinceVersion 1.2

iceberg_meta

description

iceberg_meta表函数（table-valued-function,tvf），可以用于读取iceberg表的各类元数据信息，如操作历史、生成的快照、文件元数据等。

syntax

1. iceberg_meta(
2. "table" = "ctl.db.tbl",
3. "query_type" = "snapshots"
4. ...
5. );

参数说明

iceberg_meta表函数 tvf中的每一个参数都是一个 "key"="value" 对。 相关参数：

• table： (必填) 完整的表名，需要按照目录名.库名.表名的格式，填写需要查看的iceberg表名。
• query_type： (必填) 想要查看的元数据类型，目前仅支持snapshots。

Example

读取并访问iceberg表格式的snapshots元数据。

1. select * from iceberg_meta("table" = "ctl.db.tbl", "query_type" = "snapshots");

可以配合desc function使用

1. desc function iceberg_meta("table" = "ctl.db.tbl", "query_type" = "snapshots");

Keywords

1. iceberg_meta, table-valued-function, tvf

Best Prac

查看iceberg表的snapshots

1. select * from iceberg_meta("table" = "iceberg_ctl.test_db.test_tbl", "query_type" = "snapshots");
2. +------------------------+----------------+---------------+-----------+-------------------+------------------------------+
3. |      committed_at      |  snapshot_id   |   parent_id   | operation |   manifest_list   |            summary           |
4. +------------------------+----------------+---------------+-----------+-------------------+------------------------------+
5. |  2022-09-20 11:14:29   |  64123452344   |       -1      |  append   | hdfs:/path/to/m1  | {"flink.job-id":"xxm1", ...} |
6. |  2022-09-21 10:36:35   |  98865735822   |  64123452344  | overwrite | hdfs:/path/to/m2  | {"flink.job-id":"xxm2", ...} |
7. |  2022-09-21 21:44:11   |  51232845315   |  98865735822  | overwrite | hdfs:/path/to/m3  | {"flink.job-id":"xxm3", ...} |
8. +------------------------+----------------+---------------+-----------+-------------------+------------------------------+

根据snapshot_id字段筛选

1. select * from iceberg_meta("table" = "iceberg_ctl.test_db.test_tbl", "query_type" = "snapshots")
2. where snapshot_id = 98865735822;
3. +------------------------+----------------+---------------+-----------+-------------------+------------------------------+
4. |      committed_at      |  snapshot_id   |   parent_id   | operation |   manifest_list   |            summary           |
5. +------------------------+----------------+---------------+-----------+-------------------+------------------------------+
6. |  2022-09-21 10:36:35   |  98865735822   |  64123452344  | overwrite | hdfs:/path/to/m2  | {"flink.job-id":"xxm2", ...} |
7. +------------------------+----------------+---------------+-----------+-------------------+------------------------------+