mirror-linux/tools/perf/tests/shell
Namhyung Kim 4d60e83dfc perf test: Skip metrics w/o event name in stat STD output linter
This test checks if the output of perf stat to match event names and
metrics.  So it wants the output lines to have both event name and
metric.  Otherwise it should skip the line.

On AMD machines, the instruction event has two metrics and they are printed
in separate lines.  It makes the line without event name like below:

  # perf stat -a sleep 1

   Performance counter stats for 'system wide':

           64,383.34 msec cpu-clock                  #   64.048 CPUs utilized
              14,526      context-switches           #  225.617 /sec
                 112      cpu-migrations             #    1.740 /sec
                 190      page-faults                #    2.951 /sec
         807,558,652      cycles                     #    0.013 GHz                         (83.30%)
          69,809,799      stalled-cycles-frontend    #    8.64% frontend cycles idle        (83.30%)
         196,983,266      stalled-cycles-backend     #   24.39% backend cycles idle         (83.30%)
         424,876,008      instructions               #    0.53  insn per cycle
 (here) --->                                  #    0.46  stalled cycles per insn     (83.30%)
          97,788,321      branches                   #    1.519 M/sec                       (83.34%)
           4,147,377      branch-misses              #    4.24% of all branches             (83.46%)

         1.005241409 seconds time elapsed

Also modern Intel machines have TopDown metrics which also don't have
event names.

  # perf stat -a sleep 1

   Performance counter stats for 'system wide':

            8,015.39 msec cpu-clock                        #    7.996 CPUs utilized
               5,823      context-switches                 #  726.477 /sec
                 189      cpu-migrations                   #   23.580 /sec
                 139      page-faults                      #   17.342 /sec
         435,139,308      cycles                           #    0.054 GHz
         193,891,345      instructions                     #    0.45  insn per cycle
          42,773,028      branches                         #    5.336 M/sec
           2,298,113      branch-misses                    #    5.37% of all branches
                          TopdownL1                 #     25.5 %  tma_backend_bound
              /-->                                  #      7.9 %  tma_bad_speculation
    (here) --+                                      #     55.7 %  tma_frontend_bound
              \-->                                  #     10.9 %  tma_retiring

         1.002395924 seconds time elapsed

There is a check to skip TopdownL1 and TopdownL2 specifically but it
does not cover every affected lines.

So there is another check to skip the line if it has nothing on the left
side of # sign.  Well.. it seems ok but that's not enough too.

When aggregation mode (like --per-socket or --per-thread) is used, it
adds some prefix (e.g. CPU socket, task name and PID) in the output
line.  So the test code ignores them to normalize result.

A problem can happen for per-thread mode when task name contains one or
more spaces.  It'd only ignore the first part of the task name, and it
thinks there's something more in the line so it would not skip.

  # perf stat -a --perf-thread sleep 1
  ...
            perf-21276                  #     70.2 %  tma_backend_bound
            perf-21276                  #      3.9 %  tma_bad_speculation
            perf-21276                  #     10.5 %  tma_frontend_bound
            perf-21276                  #     15.3 %  tma_retiring
	    ^^^^^^^^^^
	    (ignored)

         my task-21328                  #     70.2 %  tma_backend_bound
         my task-21328                  #      3.9 %  tma_bad_speculation
         my task-21328                  #     10.5 %  tma_frontend_bound
         my task-21328                  #     15.3 %  tma_retiring
	 ^^
     (ignored)

So I think it should look at the metric names instead.  Add skip_metric
to hold the list of names to skip.  It would contain 'stalled cycles per
insn' and metrics started by 'tma_'.

Fixes: 99a04a48f2 ("perf test: Add test case for the standard 'perf stat' output")
Acked-by: Ian Rogers <irogers@google.com>
Cc: Kan Liang <kan.liang@linux.intel.com>
Cc: Peter Zijlstra <peterz@infradead.org>
Cc: Adrian Hunter <adrian.hunter@intel.com>
Cc: Arnaldo Carvalho de Melo <acme@kernel.org>
Cc: Jiri Olsa <jolsa@kernel.org>
Cc: Ingo Molnar <mingo@kernel.org>
Link: https://lore.kernel.org/r/20230623230139.985594-2-namhyung@kernel.org
Signed-off-by: Namhyung Kim <namhyung@kernel.org>
2023-06-23 21:35:45 -07:00
..
coresight perf test coresight: Add unroll thread test shell script 2022-10-06 14:50:55 -03:00
lib perf test: Reorder event name checks in stat STD output linter 2023-06-23 21:35:45 -07:00
buildid.sh perf tests shell: Fixed shellcheck warnings 2023-06-13 23:40:34 -03:00
daemon.sh perf tests daemon: Address shellcheck warnings 2023-06-13 23:40:33 -03:00
lock_contention.sh perf tests lock_contention: Fix shellscript errors 2023-06-13 23:40:33 -03:00
pipe_test.sh perf test: Replace pipe test workload with noploop 2022-11-20 11:32:23 -03:00
probe_vfs_getname.sh
record+probe_libc_inet_pton.sh perf test record+probe_libc_inet_pton.sh: Use "grep -F" instead of obsolescent "fgrep" 2023-06-16 11:02:01 -03:00
record+script_probe_vfs_getname.sh perf tests shell: Fixed shellcheck warnings 2023-06-13 23:40:34 -03:00
record+zstd_comp_decomp.sh perf tests: Remove bash construct from record+zstd_comp_decomp.sh 2021-11-13 18:11:51 -03:00
record.sh perf test: Fix record test on KVM guests 2022-11-23 10:35:45 -03:00
record_offcpu.sh Revert "perf build: Make BUILD_BPF_SKEL default, rename to NO_BPF_SKEL" 2023-05-06 18:07:37 -03:00
stat+csv_output.sh perf test: Move all the check functions of stat CSV output to lib 2023-06-16 09:58:32 -03:00
stat+csv_summary.sh
stat+json_output.sh perf tests stat+json_output: Address shellcheck warnings 2023-06-13 23:40:33 -03:00
stat+shadow_stat.sh perf tests stat+shadow_stat.sh: Fix all POSIX sh warnings found using shellcheck 2023-06-13 23:40:34 -03:00
stat+std_output.sh perf test: Skip metrics w/o event name in stat STD output linter 2023-06-23 21:35:45 -07:00
stat.sh perf test: Add cputype testing to perf stat 2023-05-15 09:18:43 -03:00
stat_all_metricgroups.sh perf test: Enable system wide for metricgroups test 2022-01-11 18:46:23 -03:00
stat_all_metrics.sh perf tests stat_all_metrics: Fix shellcheck warning SC2076 2023-06-13 23:40:33 -03:00
stat_all_pfm.sh perf test: Add test of libpfm4 events 2023-06-12 15:57:53 -03:00
stat_all_pmu.sh perf test: Fix "all PMU test" to skip parametrized events 2022-12-21 14:52:40 -03:00
stat_bpf_counters.sh
stat_bpf_counters_cgrp.sh perf test: Add a new test for perf stat cgroup BPF counter 2022-09-21 10:30:55 -03:00
stat_metrics_values.sh perf test: Add metric value validation test 2023-06-21 22:23:32 -07:00
test_arm_callgraph_fp.sh perf tests: Fix test_arm_callgraph_fp variable expansion 2023-06-22 22:03:17 -07:00
test_arm_coresight.sh perf tests test_arm_coresight: Shellcheck fixes 2023-06-13 23:40:33 -03:00
test_arm_spe.sh perf tests test_arm_spe: Address shellcheck warnings about signal name case 2023-06-13 23:40:33 -03:00
test_arm_spe_fork.sh perf tools: Use "grep -E" instead of "egrep" 2022-12-14 15:28:19 -03:00
test_brstack.sh perf tests test_brstack.sh: Fix all POSIX sh warnings 2023-06-13 23:40:34 -03:00
test_data_symbol.sh perf tools: Use "grep -E" instead of "egrep" 2022-12-14 15:28:19 -03:00
test_intel_pt.sh perf test test_intel_pt.sh: Test sample mode with event with PMU name 2023-05-10 14:19:20 -03:00
test_java_symbol.sh perf test java symbol: Remove needless debuginfod queries 2023-05-10 12:54:53 -03:00
test_perf_data_converter_json.sh perf test: Add test validating JSON generated by 'perf data convert --to-json' 2023-05-22 15:47:48 -03:00
test_task_analyzer.sh perf test: Set PERF_EXEC_PATH for script execution 2023-06-22 22:11:13 -07:00
trace+probe_vfs_getname.sh perf tools: Use "grep -E" instead of "egrep" 2022-12-14 15:28:19 -03:00