We cannot enable rack attack during the tests as it interferes with features spec. So we add a flag to enable it during the runtime.