Basic iprof trace seems broken on the next-eval queue on Sunspot. It works fine on the workq queue. The main differences I know about are SP7 vs SP4. (This includes newer gcc as well, from 13.4 to 14.3.)
> module load thapi
> iprof -t -- echo "f"
f
THAPI: Trace location: /home/bertoni/thapi-traces/thapi--2026-04-10T17:52:12+00:00
/opt/aurora/26.26.0/spack/unified/1.1.1/install/linux-x86_64/ruby-ffi-1.17.2-bqi5poi/gems/ffi-1.17.2/lib/ffi/types.rb:94:in `find_type': unable to resolve type 'ze_rtas_geometry_aabbs_cb_ext_t' (TypeError)
raise TypeError, "unable to resolve type '#{name}'"
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
from /opt/aurora/26.26.0/spack/unified/1.1.1/install/linux-x86_64/ruby-ffi-1.17.2-bqi5poi/gems/ffi-1.17.2/lib/ffi/library.rb:415:in `find_type'
from /opt/aurora/26.26.0/spack/unified/1.1.1/install/linux-x86_64/ruby-ffi-1.17.2-bqi5poi/gems/ffi-1.17.2/lib/ffi/struct.rb:278:in `find_type'
from /opt/aurora/26.26.0/spack/unified/1.1.1/install/linux-x86_64/ruby-ffi-1.17.2-bqi5poi/gems/ffi-1.17.2/lib/ffi/struct.rb:272:in `find_field_type'
from /opt/aurora/26.26.0/spack/unified/1.1.1/install/linux-x86_64/ruby-ffi-1.17.2-bqi5poi/gems/ffi-1.17.2/lib/ffi/struct.rb:312:in `array_layout'
from /opt/aurora/26.26.0/spack/unified/1.1.1/install/linux-x86_64/ruby-ffi-1.17.2-bqi5poi/gems/ffi-1.17.2/lib/ffi/struct.rb:218:in `layout'
from /opt/aurora/26.26.0/spack/unified/1.1.1/install/linux-x86_64/thapi-0.0.13-4eqatuy/share/ze_library.rb:3898:in `<class:ZERtasBuilderProceduralGeometryInfoExt>'
from /opt/aurora/26.26.0/spack/unified/1.1.1/install/linux-x86_64/thapi-0.0.13-4eqatuy/share/ze_library.rb:3897:in `<module:ZE>'
from /opt/aurora/26.26.0/spack/unified/1.1.1/install/linux-x86_64/thapi-0.0.13-4eqatuy/share/ze_library.rb:77:in `<top (required)>'
from /opt/aurora/26.26.0/spack/unified/1.1.1/install/linux-x86_64/thapi-0.0.13-4eqatuy/share/babeltrace_ze_lib.rb:1:in `require_relative'
from /opt/aurora/26.26.0/spack/unified/1.1.1/install/linux-x86_64/thapi-0.0.13-4eqatuy/share/babeltrace_ze_lib.rb:1:in `<top (required)>'
from <internal:/opt/aurora/26.26.0/spack/unified/1.1.1/install/linux-x86_64/ruby-3.3.5-7ok6iht/lib/ruby/3.3.0/rubygems/core_ext/kernel_require.rb>:136:in `require'
from <internal:/opt/aurora/26.26.0/spack/unified/1.1.1/install/linux-x86_64/ruby-3.3.5-7ok6iht/lib/ruby/3.3.0/rubygems/core_ext/kernel_require.rb>:136:in `require'
from /opt/aurora/26.26.0/spack/unified/1.1.1/install/linux-x86_64/thapi-0.0.13-4eqatuy/bin/babeltrace_thapi:158:in `block in get_components'
from /opt/aurora/26.26.0/spack/unified/1.1.1/install/linux-x86_64/thapi-0.0.13-4eqatuy/bin/babeltrace_thapi:148:in `each'
from /opt/aurora/26.26.0/spack/unified/1.1.1/install/linux-x86_64/thapi-0.0.13-4eqatuy/bin/babeltrace_thapi:148:in `flat_map'
from /opt/aurora/26.26.0/spack/unified/1.1.1/install/linux-x86_64/thapi-0.0.13-4eqatuy/bin/babeltrace_thapi:148:in `get_components'
from /opt/aurora/26.26.0/spack/unified/1.1.1/install/linux-x86_64/thapi-0.0.13-4eqatuy/bin/babeltrace_thapi:193:in `get_and_add_components'
from /opt/aurora/26.26.0/spack/unified/1.1.1/install/linux-x86_64/thapi-0.0.13-4eqatuy/bin/babeltrace_thapi:348:in `no_gc'
from /opt/aurora/26.26.0/spack/unified/1.1.1/install/linux-x86_64/thapi-0.0.13-4eqatuy/bin/babeltrace_thapi:363:in `create_and_run_graph'
from /opt/aurora/26.26.0/spack/unified/1.1.1/install/linux-x86_64/thapi-0.0.13-4eqatuy/bin/babeltrace_thapi:503:in `<main>'
/opt/aurora/26.26.0/spack/unified/1.1.1/install/linux-x86_64/thapi-0.0.13-4eqatuy/bin/iprof:126:in `block in exec_store_in_file': ["/opt/aurora/26.26.0/spack/unified/1.1.1/install/linux-x86_64/thapi-0.0.13-4eqatuy/bin/babeltrace_thapi\
", "trace", "--restrict", "--context", "--backends", "mpi:3,omp:2,cl:1,ze:1,cuda:1,hip:1,cxi:4,itt:5", "--", "/home/bertoni/thapi-traces/thapi--2026-04-10T17:52:12+00:00"] failed with status 1 (RuntimeError)
from /opt/aurora/26.26.0/spack/unified/1.1.1/install/linux-x86_64/thapi-0.0.13-4eqatuy/bin/iprof:117:in `popen'
from /opt/aurora/26.26.0/spack/unified/1.1.1/install/linux-x86_64/thapi-0.0.13-4eqatuy/bin/iprof:117:in `exec_store_in_file'
from /opt/aurora/26.26.0/spack/unified/1.1.1/install/linux-x86_64/thapi-0.0.13-4eqatuy/bin/iprof:889:in `block in processing'
from /opt/aurora/26.26.0/spack/unified/1.1.1/install/linux-x86_64/thapi-0.0.13-4eqatuy/bin/iprof:47:in `with_info_block'
from /opt/aurora/26.26.0/spack/unified/1.1.1/install/linux-x86_64/thapi-0.0.13-4eqatuy/bin/iprof:888:in `processing'
from /opt/aurora/26.26.0/spack/unified/1.1.1/install/linux-x86_64/thapi-0.0.13-4eqatuy/bin/iprof:1150:in `<main>'
Basic iprof trace seems broken on the next-eval queue on Sunspot. It works fine on the workq queue. The main differences I know about are SP7 vs SP4. (This includes newer gcc as well, from 13.4 to 14.3.)