Swaymsg desktop commands (focus, switch workspace) not considered activity

I'm using keymapper to run `swaymsg` directly to switch workspaces and stuff.  I have a very short idle time (60s) and sometimes when I'm actively switching between workspaces for a minute the screen goes blank.  I think that swayidle probably only monitors input and not ipc-initiated events, and keymapper is intercepting the inputs before sway/swayidle.