java.lang.Object
de.learnlib.testsupport.it.util.LearnerITUtil
Utility class for integration tests for a learning algorithm (or "learner").
A learner integration test tests the functionality of a learning algorithm against a well-defined set of example setups.
-
Method Summary
Modifier and TypeMethodDescriptionstatic <I,O> List<MMLTLearnerITCase<I, O>> createExampleITCases(LearningExample.MMLTLearningExample<I, O> example, LearnerVariantListImpl.MMLTLearnerVariantListImpl<I, O> variants, MMLTLockableOracle<I, O> lockableOracle, EquivalenceOracle<MMLT<?, I, ?, O>, TimedInput<I>, Word<TimedOutput<O>>> eqOracle) Creates a list of per-example test cases for all learner variants.static <I> List<OneSEVPALearnerITCase<I>>createExampleITCases(LearningExample.OneSEVPALearningExample<I> example, LearnerVariantListImpl.OneSEVPALearnerVariantListImpl<I> variants, SEVPALockableOracle<I> lockableOracle, EquivalenceOracle<OneSEVPA<?, I>, I, Boolean> eqOracle) Creates a list of per-example test cases for all learner variants.static <I> List<SBALearnerITCase<I>>createExampleITCases(LearningExample.SBALearningExample<I> example, LearnerVariantListImpl.SBALearnerVariantListImpl<I> variants, SBALockableOracle<I> lockableOracle, EquivalenceOracle<SBA<?, I>, I, Boolean> eqOracle) Creates a list of per-example test cases for all learner variants.static <I> List<SPALearnerITCase<I>>createExampleITCases(LearningExample.SPALearningExample<I> example, LearnerVariantListImpl.SPALearnerVariantListImpl<I> variants, SPALockableOracle<I> lockableOracle, EquivalenceOracle<SPA<?, I>, I, Boolean> eqOracle) Creates a list of per-example test cases for all learner variants.static <I,O> List<SPMMLearnerITCase<I, O>> createExampleITCases(LearningExample.SPMMLearningExample<I, O> example, LearnerVariantListImpl.SPMMLearnerVariantListImpl<I, O> variants, SPMMLockableOracle<I, O> lockableOracle, EquivalenceOracle<SPMM<?, I, ?, O>, I, Word<O>> eqOracle) Creates a list of per-example test cases for all learner variants.static <I,D, A extends UniversalDeterministicAutomaton.RegularAutomaton<?, I, ?, ?, ?> & Output<I, D>>
List<UniversalDeterministicLearnerITCase<I,D, A>> createExampleITCases(LearningExample.UniversalDeterministicLearningExample<I, ? extends A> example, LearnerVariantListImpl<A, I, D> variants, LockableOracle<I, D> lockableOracle, EquivalenceOracle<? super A, I, D> eqOracle) Creates a list of per-example test cases for all learner variants.static <I,D, A extends SuffixOutput<I, D>>
List<PassiveLearnerVariantITCase<I,D, A>> createPassiveExampleITCases(PassiveLearningExample<I, D> example, PassiveLearnerVariantListImpl<A, I, D> variants) Creates a list of per-example test cases for all learner variants (passive version).static <I,D, M extends UniversalAutomaton<?, I, ?, ?, ?> & SuffixOutput<I, D>>
Collection<DefaultQuery<I,D>> generateSamples(Alphabet<I> alphabet, M reference)
-
Method Details
-
createExampleITCases
public static <I,D, List<UniversalDeterministicLearnerITCase<I,A extends UniversalDeterministicAutomaton.RegularAutomaton<?, I, ?, ?, ?> & Output<I, D>> D, createExampleITCasesA>> (LearningExample.UniversalDeterministicLearningExample<I, ? extends A> example, LearnerVariantListImpl<A, I, D> variants, LockableOracle<I, D> lockableOracle, EquivalenceOracle<? super A, I, D> eqOracle) Creates a list of per-example test cases for all learner variants.- Type Parameters:
I- input symbol typeD- output domain typeA- automaton type- Parameters:
example- the example systemvariants- the list containing the various learner variantslockableOracle- the lockable oracle to check stable hypothesis constructioneqOracle- the equivalence oracle to use by the learning process- Returns:
- the list of test cases, one for each example
-
createExampleITCases
public static <I,O> List<MMLTLearnerITCase<I,O>> createExampleITCases(LearningExample.MMLTLearningExample<I, O> example, LearnerVariantListImpl.MMLTLearnerVariantListImpl<I, O> variants, MMLTLockableOracle<I, O> lockableOracle, EquivalenceOracle<MMLT<?, I, ?, O>, TimedInput<I>, Word<TimedOutput<O>>> eqOracle) Creates a list of per-example test cases for all learner variants.- Type Parameters:
I- input symbol type (of non-delaying inputs)O- output symbol type- Parameters:
example- the example systemvariants- the list containing the various learner variantslockableOracle- the lockable oracle to check stable hypothesis constructioneqOracle- the equivalence oracle to use by the learning process- Returns:
- the list of test cases, one for each example
-
createExampleITCases
public static <I> List<SPALearnerITCase<I>> createExampleITCases(LearningExample.SPALearningExample<I> example, LearnerVariantListImpl.SPALearnerVariantListImpl<I> variants, SPALockableOracle<I> lockableOracle, EquivalenceOracle<SPA<?, I>, I, Boolean> eqOracle) Creates a list of per-example test cases for all learner variants.- Type Parameters:
I- input symbol type- Parameters:
example- the example systemvariants- the list containing the various learner variantslockableOracle- the lockable oracle to check stable hypothesis constructioneqOracle- the equivalence oracle to use by the learning process- Returns:
- the list of test cases, one for each example
-
createExampleITCases
public static <I> List<SBALearnerITCase<I>> createExampleITCases(LearningExample.SBALearningExample<I> example, LearnerVariantListImpl.SBALearnerVariantListImpl<I> variants, SBALockableOracle<I> lockableOracle, EquivalenceOracle<SBA<?, I>, I, Boolean> eqOracle) Creates a list of per-example test cases for all learner variants.- Type Parameters:
I- input symbol type- Parameters:
example- the example systemvariants- the list containing the various learner variantslockableOracle- the lockable oracle to check stable hypothesis constructioneqOracle- the equivalence oracle to use by the learning process- Returns:
- the list of test cases, one for each example
-
createExampleITCases
public static <I,O> List<SPMMLearnerITCase<I,O>> createExampleITCases(LearningExample.SPMMLearningExample<I, O> example, LearnerVariantListImpl.SPMMLearnerVariantListImpl<I, O> variants, SPMMLockableOracle<I, O> lockableOracle, EquivalenceOracle<SPMM<?, I, ?, O>, I, Word<O>> eqOracle) Creates a list of per-example test cases for all learner variants.- Type Parameters:
I- input symbol typeO- output symbol type- Parameters:
example- the example systemvariants- the list containing the various learner variantslockableOracle- the lockable oracle to check stable hypothesis constructioneqOracle- the equivalence oracle to use by the learning process- Returns:
- the list of test cases, one for each example
-
createExampleITCases
public static <I> List<OneSEVPALearnerITCase<I>> createExampleITCases(LearningExample.OneSEVPALearningExample<I> example, LearnerVariantListImpl.OneSEVPALearnerVariantListImpl<I> variants, SEVPALockableOracle<I> lockableOracle, EquivalenceOracle<OneSEVPA<?, I>, I, Boolean> eqOracle) Creates a list of per-example test cases for all learner variants.- Type Parameters:
I- input symbol type- Parameters:
example- the example systemvariants- the list containing the various learner variantslockableOracle- the lockable oracle to check stable hypothesis constructioneqOracle- the equivalence oracle to use by the learning process- Returns:
- the list of test cases, one for each example
-
createPassiveExampleITCases
public static <I,D, List<PassiveLearnerVariantITCase<I,A extends SuffixOutput<I, D>> D, createPassiveExampleITCasesA>> (PassiveLearningExample<I, D> example, PassiveLearnerVariantListImpl<A, I, D> variants) Creates a list of per-example test cases for all learner variants (passive version).- Type Parameters:
I- input symbol typeD- output domain typeA- automaton type- Parameters:
example- the example systemvariants- the list containing the various learner variants- Returns:
- the list of test cases, one for each example
-
generateSamples
public static <I,D, Collection<DefaultQuery<I,M extends UniversalAutomaton<?, I, ?, ?, ?> & SuffixOutput<I, D>> D>> generateSamples(Alphabet<I> alphabet, M reference)
-