SHOW-LOAD-PROFILE

Name

SHOW LOAD PROFILE

Description

该语句是用来查看导入操作的Profile信息，该功能需要用户打开 Profile 设置，0.15 之前版本执行下面的设置：

1. SET is_report_success=true;

0.15 及之后的版本执行下面的设置：

1. SET [GLOBAL] enable_profile=true;

语法：

1. show load profile "/";

3. show load profile "/[queryId]"

5. show load profile "/[queryId]/[TaskId]"

7. show load profile "/[queryId]/[TaskId]/[FragmentId]/"

9. show load profile "/[queryId]/[TaskId]/[FragmentId]/[InstanceId]"

这个命令会列出当前保存的所有导入 Profile。每行对应一个导入。其中 QueryId 列为导入作业的 ID。这个 ID 也可以通过 SHOW LOAD 语句查看拿到。我们可以选择我们想看的 Profile 对应的 QueryId，查看具体情况

Example

  1. 列出所有的 Load Profile

1. mysql> show load profile "/"\G 2. *************************** 1. row *************************** 3. JobId: 20010 4. QueryId: 980014623046410a-af5d36f23381017f 5. User: root 6. DefaultDb: default_cluster:test 7. SQL: LOAD LABEL xxx 8. QueryType: Load 9. StartTime: 2023-03-07 19:48:24 10. EndTime: 2023-03-07 19:50:45 11. TotalTime: 2m21s 12. QueryState: N/A 13. TraceId: 14. AnalysisTime: NULL 15. PlanTime: NULL 16. ScheduleTime: NULL 17. FetchResultTime: NULL 18. WriteResultTime: NULL 19. WaitAndFetchResultTime: NULL 20. *************************** 2. row *************************** 21. JobId: N/A 22. QueryId: 7cc2d0282a7a4391-8dd75030185134d8 23. User: root 24. DefaultDb: default_cluster:test 25. SQL: insert into xxx 26. QueryType: Load 27. StartTime: 2023-03-07 19:49:15 28. EndTime: 2023-03-07 19:49:15 29. TotalTime: 102ms 30. QueryState: OK 31. TraceId: 32. AnalysisTime: 825.277us 33. PlanTime: 4.126ms 34. ScheduleTime: N/A 35. FetchResultTime: 0ns 36. WriteResultTime: 0ns 37. WaitAndFetchResultTime: N/A 2. 查看有导入作业的子任务概况：

1. mysql> show load profile "/980014623046410a-af5d36f23381017f"; 2. +-----------------------------------+------------+ 3. | TaskId | ActiveTime | 4. +-----------------------------------+------------+ 5. | 980014623046410a-af5d36f23381017f | 3m14s | 6. +-----------------------------------+------------+ 3. 查看子任务的执行树：

``` 1. show load profile "/980014623046410a-af5d36f23381017f/980014623046410a-af5d36f23381017f";

  1. ┌───────────────────────┐
  2. │[-1: OlapTableSink] │
  3. │Fragment: 0 │
  4. │MaxActiveTime: 86.541ms│
  5. └───────────────────────┘
  6. │
  7. │
  8. ┌───────────────────┐
  9. │[1: VEXCHANGE_NODE]│
  10. │Fragment: 0 │
  11. └───────────────────┘
  12. ┌─────────────────────────┴───────┐
  13. │ │
  14. ┌─────────────┐ ┌───────────────────────┐
  15. │[MemoryUsage]│ │[1: VDataStreamSender] │
  16. │Fragment: 0 │ │Fragment: 1 │
  17. └─────────────┘ │MaxActiveTime: 34.882ms│
  18. └───────────────────────┘
  19. │
  20. │
  21. ┌───────────────────────────┐
  22. │[0: VNewOlapScanNode(tbl1)]│
  23. │Fragment: 1 │
  24. └───────────────────────────┘
  25. ┌─────────────────┴───────┐
  26. │ │
  27. ┌─────────────┐ ┌───────────┐
  28. │[MemoryUsage]│ │[VScanner] │
  29. │Fragment: 1 │ │Fragment: 1│
  30. └─────────────┘ └───────────┘
  31. ┌───────┴─────────┐
  32. │ │
  33. ┌─────────────────┐ ┌─────────────┐
  34. │[SegmentIterator]│ │[MemoryUsage]│
  35. │Fragment: 1 │ │Fragment: 1 │

  36. └─────────────────┘ └─────────────┘

  37. ```sql

  38. 这一层会显示子任务的查询树，其中标注了 Fragment id。 ```

  39. 查看指定Fragment 的 Instance 概况

1. mysql> show load profile "/980014623046410a-af5d36f23381017f/980014623046410a-af5d36f23381017f/1"; 2. +-----------------------------------+------------------+------------+ 3. | Instances | Host | ActiveTime | 4. +-----------------------------------+------------------+------------+ 5. | 980014623046410a-88e260f0c43031f2 | 10.81.85.89:9067 | 3m7s | 6. | 980014623046410a-88e260f0c43031f3 | 10.81.85.89:9067 | 3m6s | 7. | 980014623046410a-88e260f0c43031f4 | 10.81.85.89:9067 | 3m10s | 8. | 980014623046410a-88e260f0c43031f5 | 10.81.85.89:9067 | 3m14s | 9. +-----------------------------------+------------------+------------+ 5. 继续查看某一个具体的 Instance 上各个算子的详细 Profile

``` 1. mysql> show load profile "/980014623046410a-af5d36f23381017f/980014623046410a-af5d36f23381017f/1/980014623046410a-88e260f0c43031f5"\G

  1. ***** 1. row *******

  2. Instance:

  3. ┌-----------------------------------------┐

  4. │[-1: OlapTableSink] │
  5. │(Active: 2m17s, non-child: 70.91) │
  6. │ - Counters: │
  7. │ - CloseWaitTime: 1m53s │
  8. │ - ConvertBatchTime: 0ns │
  9. │ - MaxAddBatchExecTime: 1m46s │
  10. │ - NonBlockingSendTime: 3m11s │
  11. │ - NumberBatchAdded: 782 │
  12. │ - NumberNodeChannels: 1 │
  13. │ - OpenTime: 743.822us │
  14. │ - RowsFiltered: 0 │
  15. │ - RowsRead: 1.599729M (1599729) │
  16. │ - RowsReturned: 1.599729M (1599729)│
  17. │ - SendDataTime: 11s761ms │
  18. │ - TotalAddBatchExecTime: 1m46s │
  19. │ - ValidateDataTime: 9s802ms │
  20. └-----------------------------------------┘
  21. │
  22. ┌-----------------------------------------------------┐
  23. │[0: BROKER_SCAN_NODE] │
  24. │(Active: 56s537ms, non-child: 29.06) │
  25. │ - Counters: │
  26. │ - BytesDecompressed: 0.00 │
  27. │ - BytesRead: 5.77 GB │
  28. │ - DecompressTime: 0ns │
  29. │ - FileReadTime: 34s263ms │
  30. │ - MaterializeTupleTime(*): 45s54ms │
  31. │ - NumDiskAccess: 0 │
  32. │ - PeakMemoryUsage: 33.03 MB │
  33. │ - RowsRead: 1.599729M (1599729) │
  34. │ - RowsReturned: 1.599729M (1599729) │
  35. │ - RowsReturnedRate: 28.295K sec │
  36. │ - TotalRawReadTime(*): 1m20s │
  37. │ - TotalReadThroughput: 30.39858627319336 MB/sec│
  38. │ - WaitScannerTime: 56s528ms │
  39. └-----------------------------------------------------┘ ```

Keywords

1. SHOW, LOAD, PROFILE

Best Practice