Statistics for Power, but not at any cost