Simon Moritz Jensen

AI engineer · independent researcher

Building machine-learning systems for a living. Part-time independent researcher in theoretical computer science.

About

Research

How wide must the second layer be?

Two hidden layers of ReLU neurons are enough to compute the maximum of N numbers exactly, but every known network that does so is enormous. My current project asks how many neurons the second layer really needs, and proves lower bounds.

Preprint coming soon.

Side projects

Contact