For simple models, it may be possible to determine the optimal value of the learning rate a priori. However, it is impossible for complex models to compute the optimal learning rate through theoretical reasoning that can make accurate predictions. Observation and experience play an important role in defining the optimal learning rate

BY Best Interview Question ON 24 Apr 2023