Operator ToolboxOperator Toolbox

This extension couples some useful additional operators together.

This extension adds a bunch of new operators to RapidMiner. They range from utility operators to improve the flexibility and usability of the process design, over additional outlier detection algorithm and additional performance criteria to advanced analysis methods like Local Interpretation or the SMOTE algorithm.

Currently the extension provides the following Operators:

  • Blending

    • Table

      • Append (Superset)

      • Collect and Persist

      • Group Into Collection

      • Merge Attributes

      • Sample Collection (improved and bugfix in 2.3.0)

    • Attribute Generation

      • Calculate Overlaps

      • Generate Levenshtein Distance

      • Generate Phonetic Encoding

      • Generate Session ID 

    • Extract Statistics
    • Filter Attributes with Missing Values

    • Filter Examples with Missing Values

    • Generate Partial Dependency Plot Data

    • Replace Rare Values

    • SMOTE Upsampling (bugfix in 2.3.0)

    • Weight of Evidence

    • Get Holidays (new in 2.3.0)

  • Data Access:

    • Read Excel Sheet Names

    • SFTP Download File

    • SFTP Upload File

  • Macros:

    • Extract Macro (Format)

    • Extract Last Modifying Operator

    • Set Macros from ExampleSet

    • Set Macro (Real)

  • Models:

    • Check Model Conformance

    • Get Decision Tree Path

    • GLM Contribution

    • Local Interpretation (LIME)

    • Optimize Threshold

    • Optimize Threshold (Subprocess)

    • Random Forest Encoder

  • Outliers:

    • Tukey Test

  • Parameters:

    • Get Parameters

    • Set Parameters from ExampleSet

  • Performance

    • Performance (AUPRC)

  • Text Processing:

    • Apply Model (Documents) 

    • Extract Sentiment

    • Dictionary-Based Sentiment

    • Extract Topics from Data (LDA)

    • Extract Topics from Documents (LDA)

    • Filter Tokens Using ExampleSet

    • Split Document into Collection

    • Stem Tokens Using ExampleSet

  • Utility (new in 2.3.0)

    • Subprocess (Caching) (new in 2.3.0)

Version 2.3.0 (2019-12-18)

  • New operator: Get Holidays
    • Returns every holiday (national and state holidays) in a given country for given days
  • New operator: Subprocess (Caching)
    • A drop in replacement for the 'Subprocess' operator which allows to cache results during design time. This allows for faster process prototyping
  • Enhancements
    • Sample (Collection): samplesize does not need be be smaller than collection size anymore for bootstrapping. This allows to oversample.
    • Extract Macro (Format) allows now to extract the number of items in a collection.
    • Optimize Threshold and Optimize Threshold (Subprocess) are now logging their respective performance values.
  • Bugfixes:
    • Fixed a bug in 'Smote Upsampling' which considered dates as nominal attributes and caused crashes. Dates are now treated like any other numerical attribute.
    • Fixed a bug, that Sample (Collection) was taking mostly items from the beginning of a collection in Boostrap mode

Version 2.2.0 (2019-09-11)

  • New operator: GLM Contribution
    • calculates the influence of individual attribute values to a GLM prediction
  • New operator: Generate Partial Dependency Plot Data
    • generates Partial Dependency Plot Data for all numeric attributes used in a model. This is a useful technique to understand the influence of an attribute to the overall prediction of the model
  • New operator: Sample Collection
    • takes an input collection and sample it to a given sample size
  • Enhancement: Apply Model (Documents)
    • Improved meta data propagation when applied on new documents

Version 2.1.0 (2019-06-27)

  • New operator: Optimize Threshold (Subprocess):
    • works like Optimize Threshold, but lets you define the performance measure manually
  • Improvements of Read Excel Sheet Names operator:
    • added throughput port for the input file object
    • changed the "id" attribute to be called "Sheet Number", to have an id role and to start counting at 1 (as the Read Excel operator also starts with 1), operator is not compatible with earlier processes anymore!
    • added the parameter "file name", similar to the ReadExcel operator
  • Improvements of the Replace Rare Values operator
    • Operator now cleans the mapping of the selected attributes
    • Removed "create view" parameter (which have had no effect)
    • Added proper Meta Data handling
  • Enhancements
    • Added appropriate aylien and meaning cloud icons
    • Fixed a "unknown error message" in Apply Model (Documents)
    • Added new UserError to Tukey Test Preprocessing model, in case the attribute type is wrong.

Version 2.0.1 (2019-04-23)

  • Enhancements:
    • Extract Sentiment has now the option to use custom words in dictionary based methods and scores for dictionary based methods are now normalized. The max(abs(score)) is defined as 1.
  • Bugfixes:
    • Extract Sentiment: Fixed a bug in SentiWordNet where Positivity and Negativity was wrongly calculated

    • Append (Superset): BugFix when matching attributes of mismatched types (Real and Integer) they were always converted to polynominal.

Version 2.0.0 (2019-03-26)

  • New operator: Optimize Thresholds
    • automatically determines the best threshold for a binominal classification problem
  • New operator: Extract Macro (Format)
    • same functionality as Extract Macro, but you can specify the format of numbers and dates
  • New operator: Extract Sentiment
    • extracting sentiment from text inputs using dictionary and API based methods (Vader, Sentinet, Aylien, MeaningCloud)
  • New operator: Append (Superset)
    • same functionality as Append, but you can append ExampleSets with different attributes
  • Enhancements:
    • Restructured the blending operator folder
      • added subfolders 'Tables' and 'Attribute Generation'
      • changed the color of the operators in these subfolders
    • Added several tags for Replace Rare Values
    • Merge operator:
      • Corrected Meta Data
      • Changed that in case attributes or annotations are renamed, that the first occuring attribute/annotation is also renamed
    • Bugfix in Phonetic Encoding and Extract Statistics in rare cases of attribute selection

Version 1.8.0 (2019-02-08)

  • Get Decision Tree Path now also works for regression trees
  • Bugfix for SMOTE operator when not using normalized distances
  • Create ExampleSet is now deprecated cause it is in RM Studio Core since 9.2.0
  • Moved t-SNE operator and Parameteric Probability Estimator to the separate Smile Extension (available on Marketplace)
    • Removed all functionality from the two operators
    • Only ProcessSetupError occurs when operators are inserted and a UserError is thrown when operator is executed
    • Both operators are deprecated now
    • Smile library dependency is removed

Version 1.7.0 (2018-11-26)

  • LDA changes:
    • New operator Extract Topics from Data (LDA), able to run LDA on ExampleSets
    • Renamed Extract Topics from Document (LDA), to Extract Topics from Documents (LDA)
    • Updated default optimization interval of the hyperparameters in both LDA operators from 50 to 10
    • Added AlphaSum, Beta and BetaSum to the performance vector output.
    • Bugfix in case numerical meta data element is missing
    • Bugfix that causes the LDA to not respect preprocessing step like Filter Stopwords
  • Bugfix TSNE operator: fixed a bug in handling special attributes
  • Bugfix in Check Model Conformance, that nominal attributes were checked if fail on error is true, even if check nominals is false

Version 1.6.0 (2018-11-12)

  • New operator Check Model Conformance
  • New operator Filter Attributes with Missing Values
  • New operator Filter Examples with Missing Values

Version 1.5.0 (2018-09-14)

  • Improvement of Dictionary-Based Sentiment
    • Added a symmetric negation window option. If selected the negation also look backwards
    • Added the negation token to the result string
    • Fixed a bug in case double (or more negations) occur
  • Improvement of SMOTE Upsampling
    • SMOTE is now throwing a UserError if the wrong label types (Numeric or None) are used.
    • Bugfix for label attributes which contains comparison characters.
  • Local Interpretation (LIME)
    • Renamed operator to Local Interpretation (LIME)
    • Improved Meta Data Handling
  • General:
    • Improved parameter descriptions for several operators
    • Improved expert and mandatory parameters settings and removed unused encoding parameters.
    • Added a progress bar for several operators

Product Details

Version 2.3.0
File size 14 MB
Downloads 89775 (92 Today)89775 downloads
Vendor RapidMiner Labs
Category Operators
Released 12/18/19
Last Update 12/18/19 9:28 AM
License AGPL
Product web site
Rating 0.0 stars(0)