Quarkus Tests are not dynamically added/removed in dev mode

I am running a sample project from quarkus.io/ with only quarkus-rest-jaxb and tests dependencies.