Any Deep ReLU Network Is Shallow

Any Deep ReLU Network Is Shallow

[Submitted on 20 Jun 2023]

Download a PDF of the paper titled Any Deep ReLU Network is Shallow, by Mattia Jacopo Villani and 1 different authors

Download PDF

Abstract: We constructively show that each deep ReLU community could be rewritten as a
functionally equivalent three-layer community with weights valued within the prolonged
reals. Based on this proof, we offer an algorithm that, given a deep ReLU
community, finds the express weights of the corresponding shallow community. The
ensuing shallow community is clear and used to generate explanations of
the mannequin s behaviour.

Submission historical past

From: Mattia Jacopo Villani [view email]

[v1]

Tue, 20 Jun 2023 18:37:21 UTC (7,539 KB)

…. to be continued
Read the Original Article
Copyright for syndicated content material belongs to the linked Source : Hacker News – https://arxiv.org/abs/2306.11827

Exit mobile version