Vires in Numeris


The 1cycle Policy

Picking the right learning rate at different iterations helps model to converge quickly. The 1cycle policy gives very fast results when training complex models. It follows the Cyclical Learning Rate (CLR) to obtain faster training time with regularization effect but with a slight modification. Specifically, it uses one cycle that is smaller than the total... » read more

A line-by-line layman’s guide to Linear Regression using TensorFlow

Linear regression is a great start to the journey of machine learning, given that it is a pretty straightforward problem and can be solved by popular modules such as the scikit-learn package. In this article, we shall discuss a line-by-line approach on we implement linear regression using TensorFlow. Looking at the equation of linear regression above,... » read more