About
Get Started
Guides
Developer Framework
Get Started
Supported Models
TESTING
Run Tests & Test Suites
Test Descriptions
Test sandbox (BETA)
CODE SAMPLES
All Code Samples ·
LLM
·
NLP
·
Time Series
·
Etc.
Download Code Samples ·
notebooks.zip
Try it on Jupyter Hub
REFERENCE
ValidMind Developer Framework
FAQ
Support
validmind.com
Test descriptions
Model Validation
Ragas
AspectCritique
Developer Framework
MODEL DOCUMENTATION
Quickstart for model documentation
Introduction for model developers
Supported models
Generate model documentation
Install and initialize the developer framework
Store project credentials in
.env
files
MODEL TESTING
Run tests & test suites
Configure dataset features
Document multiple results for the same test
Explore test suites
Explore tests
Load dataset predictions
Run individual documentation sections
Run documentation tests with custom configurations
Run tests with multiple datasets
Run unit metrics
Introduction to ValidMind Dataset and Model Objects
Run Tests
Run dataset based tests
Test descriptions
Data Validation
ACFandPACFPlot
ADF
ANOVAOneWayTable
AutoAR
AutoMA
AutoSeasonality
AutoStationarity
BivariateFeaturesBarPlots
BivariateHistograms
BivariateScatterPlots
ChiSquaredFeaturesTable
ClassImbalance
DatasetDescription
DatasetSplit
DescriptiveStatistics
DFGLSArch
Duplicates
EngleGrangerCoint
FeatureTargetCorrelationPlot
HeatmapFeatureCorrelations
HighCardinality
HighPearsonCorrelation
IQROutliersBarPlot
IQROutliersTable
IsolationForestOutliers
KPSS
LaggedCorrelationHeatmap
MissingValues
MissingValuesBarPlot
MissingValuesRisk
PearsonCorrelationMatrix
PhillipsPerronArch
RollingStatsPlot
ScatterPlot
SeasonalDecompose
Skewness
SpreadPlot
TabularCategoricalBarPlots
TabularDateTimeHistograms
TabularDescriptionTables
TabularNumericalHistograms
TargetRateBarPlots
TimeSeriesDescription
TimeSeriesDescriptiveStatistics
TimeSeriesFrequency
TimeSeriesHistogram
TimeSeriesLinePlot
TimeSeriesMissingValues
TimeSeriesOutliers
TooManyZeroValues
UniqueRows
WOEBinPlots
WOEBinTable
ZivotAndrewsArch
Nlp
CommonWords
Hashtags
LanguageDetection
Mentions
PolarityAndSubjectivity
Punctuations
Sentiment
StopWords
TextDescription
Toxicity
Model Validation
BertScore
BleuScore
ClusterSizeDistribution
ContextualRecall
FeaturesAUC
MeteorScore
ModelMetadata
ModelMetadataComparison
ModelPredictionResiduals
RegardScore
RegressionResidualsPlot
RougeScore
TimeSeriesPredictionsPlot
TimeSeriesPredictionWithCI
TimeSeriesR2SquareBySegments
TokenDisparity
ToxicityScore
Embeddings
ClusterDistribution
CosineSimilarityComparison
CosineSimilarityDistribution
CosineSimilarityHeatmap
DescriptiveAnalytics
EmbeddingsVisualization2D
EuclideanDistanceComparison
EuclideanDistanceHeatmap
PCAComponentsPairwisePlots
StabilityAnalysis
StabilityAnalysisKeyword
StabilityAnalysisRandomNoise
StabilityAnalysisSynonyms
StabilityAnalysisTranslation
TSNEComponentsPairwisePlots
Ragas
AnswerCorrectness
AnswerRelevance
AnswerSimilarity
AspectCritique
ContextEntityRecall
ContextPrecision
ContextRecall
ContextRelevancy
Faithfulness
Sklearn
AdjustedMutualInformation
AdjustedRandIndex
ClassifierPerformance
ClusterCosineSimilarity
ClusterPerformance
ClusterPerformanceMetrics
CompletenessScore
ConfusionMatrix
FeatureImportanceComparison
FowlkesMallowsScore
HomogeneityScore
HyperParametersTuning
KMeansClustersOptimization
MinimumAccuracy
MinimumF1Score
MinimumROCAUCScore
ModelsPerformanceComparison
OverfitDiagnosis
PermutationFeatureImportance
PopulationStabilityIndex
PrecisionRecallCurve
RegressionErrors
RegressionErrorsComparison
RegressionModelsPerformanceComparison
RegressionR2Square
RegressionR2SquareComparison
RobustnessDiagnosis
ROCCurve
SHAPGlobalImportance
SilhouettePlot
TrainingTestDegradation
VMeasure
WeakspotsDiagnosis
Statsmodels
AutoARIMA
BoxPierce
CumulativePredictionProbabilities
DurbinWatsonTest
GINITable
JarqueBera
KolmogorovSmirnov
Lilliefors
LJungBox
PredictionProbabilitiesHistogram
RegressionCoeffsPlot
RegressionFeatureSignificance
RegressionModelForecastPlot
RegressionModelForecastPlotLevels
RegressionModelsCoeffs
RegressionModelSensitivityPlot
RegressionModelSummary
RegressionPermutationFeatureImportance
RunsTest
ScorecardHistogram
ShapiroWilk
Prompt Validation
Bias
Clarity
Conciseness
Delimitation
NegativeInstruction
Robustness
Specificity
Test sandbox (BETA)
NOTEBOOKS
Code samples
Credit Risk
Document an application scorecard model
Custom Tests
Implement custom tests
Integrate external test providers
Customization
Customize test outputs using output templates
NLP and LLM
Sentiment analysis of financial data using a large language model (LLM)
Summarization of financial data using a large language model (LLM)
Sentiment analysis of financial data using Hugging Face NLP models
Summarization of financial data using Hugging Face NLP models
Automate news summarization using LLMs
Prompt validation for large language models (LLMs)
RAG Model Documentation Demo
Regression
Document a California Housing Price Prediction regression model
Time Series
Document a time series forecasting model
REFERENCE
ValidMind Developer Framework
On this page
AspectCritique
Edit this page
Report an issue
AspectCritique
AnswerSimilarity
ContextEntityRecall