Skip to main content
Calcimator

Hyperparameter Grid Search Calculator

Calculate total experiments, time, and GPU cost for hyperparameter grid search with cross-validation.

Inputs

Results

Total Training Runs

300

GPU Hours

120 hrs

Grid Combinations60
Est. Total Hours150 hrs
Est. Cost (A100)$440.40
How to Use This Calculator
  1. Enter Param 1 Values, Param 2 Values, and Param 3 Values.
  2. Set Cross-Validation Folds (K).
  3. Review Total Training Runs and GPU Hours (hrs).
  4. Use Grid Combinations and Est. Total Hours (hrs) to inform your decision.
  5. Use the chart to visualize the results and explore different scenarios by adjusting inputs.

How the result changes with Param 1 Values

Param 1 ValuesTotal Training RunsGPU Hours
11660264 hrs
362,160864 hrs
653,9001,560 hrs
905,4002,160 hrs

What each input means

Param 1 Values
Number of values to try for the first hyperparameter (e.g., learning rate)
Param 2 Values
Number of values for the second hyperparameter (e.g., batch size)
Param 3 Values
Number of values for the third hyperparameter (e.g., hidden units)
Cross-Validation Folds (K)
Number of cross-validation folds (each grid point trains K times)

How this is calculated

Worked example, using the default values

  1. Identify Input Parameters
    4 parameters
    Param 1 Values = 5, Param 2 Values = 4, Param 3 Values = 3, Cross-Validation Folds (K) = 5 = 4 input(s) provided
  2. Calculate Total Training Runs
    Total Training Runs
    300 = 300
  3. Calculate GPU Hours
    GPU Hours
    120 = 120
  4. Calculate Grid Combinations
    Grid Combinations
    60 = 60
  5. Calculate Est. Total Hours
    Est. Total Hours
    150 = 150

Engine last updated . Checked against 2 independently-derived tests how we verify calculators.

The questions that sit next to this one — chosen by subject, including calculators filed under a different category.

More in Technology & Computing.