Plotters
A group of trainer callbacks that accumulate model predictions
over the validation and test splits and render diagnostic plots to the run’s output
directory. Each is registered with a CallbackSpec like any other callback, and
they accept optional keyword arguments (such as a map of class indices to display
names for the classification plots).
Regression plots:
Parity (
ParityPlotter): predicted value against true value, where points on the diagonal are perfect predictions.Bias (
BiasPlotter): prediction residual as a function of the true value, revealing systematic over- or under-prediction.
Classification plots:
Confusion Matrix (
CMPlotter): counts of predicted versus true classes.P(true) (
PTruePlotter): distribution of the probability the model assigns to the correct class.P(positive) (
BinaryPPositivePlotter): distribution of the predicted positive-class probability for binary tasks.ROC (
ROCPlotter): receiver operating characteristic curve.Precision-Recall (
PrecisionRecallPlotter): precision against recall across thresholds.
from icegraph.trainer.callbacks import CallbackSpec, ParityPlotter, ROCPlotter
trainer.register_callback(CallbackSpec(callback=ParityPlotter, kwargs={}))
trainer.register_callback(CallbackSpec(callback=ROCPlotter, kwargs={}))