Because of the way native class libraries are handled, if you are running the JNI tests in this configuration, you cannot create a new classloader for each test and must use the system class loader.
When you are doing your certification runs, you should run the JNI tests in a separate configuration that does not create new class loaders for each test, the other tests should be run in another configuration that creates new class loaders for each test.