HoldOut

class dpeeg.exps.HoldOut(trainer: BaseClassifier, out_folder: str | None = None, timestamp: bool = True, verbose: int | str = 'INFO')

Holdout cross validation experiment.

Validate the performance of the model on unseen data using holdout cross validation. Only one training and testing is required, so it is fast and suitable for large-scale datasets and fast model evaluation.

Parameters:

• trainer (Trainer) – Trainer used for training module on dataset.

• out_folder (str, optional) – Store all experimental results in a folder named with the model class name in the specified folder (‘~/dpeeg/out/model/exp/dataset/timestamp’).

• timestamp (bool) – Output folders are timestamped.