Package weka.classifiers.meta
Class MultiBoostAB
- All Implemented Interfaces:
Serializable,Cloneable,Sourcable,CapabilitiesHandler,OptionHandler,Randomizable,RevisionHandler,TechnicalInformationHandler,WeightedInstancesHandler
Class for boosting a classifier using the MultiBoosting method.
MultiBoosting is an extension to the highly successful AdaBoost technique for forming decision committees. MultiBoosting can be viewed as combining AdaBoost with wagging. It is able to harness both AdaBoost's high bias and variance reduction with wagging's superior variance reduction. Using C4.5 as the base learning algorithm, Multi-boosting is demonstrated to produce decision committees with lower error than either AdaBoost or wagging significantly more often than the reverse over a large representative cross-section of UCI data sets. It offers the further advantage over AdaBoost of suiting parallel execution.
For more information, see
Geoffrey I. Webb (2000). MultiBoosting: A Technique for Combining Boosting and Wagging. Machine Learning. Vol.40(No.2). BibTeX:
MultiBoosting is an extension to the highly successful AdaBoost technique for forming decision committees. MultiBoosting can be viewed as combining AdaBoost with wagging. It is able to harness both AdaBoost's high bias and variance reduction with wagging's superior variance reduction. Using C4.5 as the base learning algorithm, Multi-boosting is demonstrated to produce decision committees with lower error than either AdaBoost or wagging significantly more often than the reverse over a large representative cross-section of UCI data sets. It offers the further advantage over AdaBoost of suiting parallel execution.
For more information, see
Geoffrey I. Webb (2000). MultiBoosting: A Technique for Combining Boosting and Wagging. Machine Learning. Vol.40(No.2). BibTeX:
@article{Webb2000,
address = {Boston},
author = {Geoffrey I. Webb},
journal = {Machine Learning},
number = {No.2},
publisher = {Kluwer Academic Publishers},
title = {MultiBoosting: A Technique for Combining Boosting and Wagging},
volume = {Vol.40},
year = {2000}
}
Valid options are:
-C <num> Number of sub-committees. (Default 3)
-P <num> Percentage of weight mass to base training on. (default 100, reduce to around 90 speed up)
-Q Use resampling for boosting.
-S <num> Random number seed. (default 1)
-I <num> Number of iterations. (default 10)
-D If set, classifier is run in debug mode and may output additional info to the console
-W Full name of base classifier. (default: weka.classifiers.trees.DecisionStump)
Options specific to classifier weka.classifiers.trees.DecisionStump:
-D If set, classifier is run in debug mode and may output additional info to the consoleOptions after -- are passed to the designated classifier.
- Version:
- $Revision: 1.16 $
- Author:
- Shane Butler (sbutle@deakin.edu.au), Eibe Frank (eibe@cs.waikato.ac.nz), Len Trigg (trigg@cs.waikato.ac.nz)
- See Also:
-
Constructor Summary
Constructors -
Method Summary
Modifier and TypeMethodDescriptionvoidbuildClassifier(Instances training) Method for building this classifier.intGet the number of sub committees to useString[]Gets the current settings of the Classifier.Returns the revision string.Returns an instance of a TechnicalInformation object, containing detailed information about the technical background of this class, e.g., paper reference or book this class is based on.Returns a string describing classifierReturns an enumeration describing the available optionsstatic voidMain method for testing this class.Returns the tip text for this propertyvoidsetNumSubCmtys(int subc) Set the number of sub committees to usevoidsetOptions(String[] options) Parses a given list of options.toString()Returns description of the boosted classifier.Methods inherited from class weka.classifiers.meta.AdaBoostM1
distributionForInstance, getCapabilities, getUseResampling, getWeightThreshold, setUseResampling, setWeightThreshold, toSource, useResamplingTipText, weightThresholdTipTextMethods inherited from class weka.classifiers.RandomizableIteratedSingleClassifierEnhancer
getSeed, seedTipText, setSeedMethods inherited from class weka.classifiers.IteratedSingleClassifierEnhancer
getNumIterations, numIterationsTipText, setNumIterationsMethods inherited from class weka.classifiers.SingleClassifierEnhancer
classifierTipText, getClassifier, setClassifierMethods inherited from class weka.classifiers.Classifier
classifyInstance, debugTipText, forName, getDebug, makeCopies, makeCopy, setDebug
-
Constructor Details
-
MultiBoostAB
public MultiBoostAB()
-
-
Method Details
-
globalInfo
Returns a string describing classifier- Overrides:
globalInfoin classAdaBoostM1- Returns:
- a description suitable for displaying in the explorer/experimenter gui
-
getTechnicalInformation
Returns an instance of a TechnicalInformation object, containing detailed information about the technical background of this class, e.g., paper reference or book this class is based on.- Specified by:
getTechnicalInformationin interfaceTechnicalInformationHandler- Overrides:
getTechnicalInformationin classAdaBoostM1- Returns:
- the technical information about this class
-
listOptions
Returns an enumeration describing the available options- Specified by:
listOptionsin interfaceOptionHandler- Overrides:
listOptionsin classAdaBoostM1- Returns:
- an enumeration of all the available options
-
setOptions
Parses a given list of options. Valid options are:-C <num> Number of sub-committees. (Default 3)
-P <num> Percentage of weight mass to base training on. (default 100, reduce to around 90 speed up)
-Q Use resampling for boosting.
-S <num> Random number seed. (default 1)
-I <num> Number of iterations. (default 10)
-D If set, classifier is run in debug mode and may output additional info to the console
-W Full name of base classifier. (default: weka.classifiers.trees.DecisionStump)
Options specific to classifier weka.classifiers.trees.DecisionStump:
-D If set, classifier is run in debug mode and may output additional info to the console
Options after -- are passed to the designated classifier.- Specified by:
setOptionsin interfaceOptionHandler- Overrides:
setOptionsin classAdaBoostM1- Parameters:
options- the list of options as an array of strings- Throws:
Exception- if an option is not supported
-
getOptions
Gets the current settings of the Classifier.- Specified by:
getOptionsin interfaceOptionHandler- Overrides:
getOptionsin classAdaBoostM1- Returns:
- an array of strings suitable for passing to setOptions
-
numSubCmtysTipText
Returns the tip text for this property- Returns:
- tip text for this property suitable for displaying in the explorer/experimenter gui
-
setNumSubCmtys
public void setNumSubCmtys(int subc) Set the number of sub committees to use- Parameters:
subc- the number of sub committees
-
getNumSubCmtys
public int getNumSubCmtys()Get the number of sub committees to use- Returns:
- the seed for resampling
-
buildClassifier
Method for building this classifier.- Overrides:
buildClassifierin classAdaBoostM1- Parameters:
training- the data to train with- Throws:
Exception- if the training fails
-
toString
Returns description of the boosted classifier.- Overrides:
toStringin classAdaBoostM1- Returns:
- description of the boosted classifier as a string
-
getRevision
Returns the revision string.- Specified by:
getRevisionin interfaceRevisionHandler- Overrides:
getRevisionin classAdaBoostM1- Returns:
- the revision
-
main
Main method for testing this class.- Parameters:
argv- the options
-