Tensorizer
This is an interactive tool for simulating gradient descent on deep linear networks and general tensor networks. Draw a model in the canvas on the left, set hyperparameters at the bottom, run the simulation with a random target tensor $\mathbf{T}_*$, and look at its training dynamics.
T = 1
loss
$\mathcal{L} = |\!| \mathbf{T} - \mathbf{T}_* |\!|_F^2$
0.01
1
5
—
—