The threats, drama, and uncertainty around tariffs has led to risks of a different kind: slowing growth and rising inflation.