Can you build deep learning models based solely on linear regression?

Yes, building deep networks using a linear function as the motivation function for every layer is possible if a linear equation represents the issue. However, an issue that is a construction of linear functions is a linear function. Therefore, nothing can be pulled off by implementing a deep network because adding more nodes to the network will not increase the predictive capability of the machine learning model.

NOTE: Deep learning interviews are tough. If you are not well-prepared, some coding questions can leave you frantically searching for an answer. So prepare yourself to face all the queries.