Repository navigation
How to execute custom test cases or specified test cases rather than all tests on gitbug-java? #46
Description
I am going to evaluate my own fault localization approach on GitBug-Java. To do this, I need to do the following steps:
- Inject extra test cases into the test suite.
- Compile the project.
- Execute the tests.
I tried like this:
- I checked out one of the bugs and modified one of the
.javaFiles of the Test Classes. It looks like this:
public class Gt06ProtocolDecoderTest extends ProtocolTest {
@Test
public void tryTestInjection() throws Exception {
int a=1;
int b=0;
assertEquals(a,b); // This is the custom test case, and it always fails.
}
@Test
public void testDecode() throws Exception {
... // This is the original Failed Test Case
}
}
- I execute
gitbug-java run checkout --act-cache=act-cacheand get:
Expected executed tests: 479
Executed tests: 480
Passing tests: 478
Skipped tests: 23
Failing tests: 2
Failed tests:
- org.traccar.protocol.Gt06ProtocolDecoderTest#tryTestInjectsion()
- org.traccar.protocol.Gt06ProtocolDecoderTest#testDecode()
It turns out that my custom test case is compiled and executed. But to speed up, is it possible to execute single test case rather than all tests?
How can I do?
Activity
cc32 commentedon Aug 21, 2025
I have tried to set the parameter
keep_containers=Truewhen I execute thegitbug-java run checkout --act-cache=act-cache, so that I can get the container in which the required dependencies are packaged (I guess). But when I entered the container, I failed to build the project, like this:Nfsaavedra commentedon Aug 21, 2025
For that, you might want to modify the GitHub Actions workflows in the checked out repository so that only the tests that you want to run are executed. For instance, for
traccar-traccar-95fdfd770130you have a single workflow defined in the folder.github/workflows. If you change the./gradlew buildthere to something such as./gradlew test --no-daemon --warning-mode=fail --tests 'Gt06ProtocolDecoderTest'and then you run it withgitbug-java run, only those tests will be executed. We call this instrumentation in gitbugactions. You can take a look on how it's done there to generalize it for other samples (we don't filter the tests but we do similar things).For that sample you should use
./gradlewinstead ofgradleas it is defined in the workflow.