Skip to content
This repository has been archived by the owner on Jan 3, 2024. It is now read-only.

LeakyReLU changes

Compare
Choose a tag to compare
@matiasvlevi matiasvlevi released this 30 Dec 22:31

LeakyReLU is now:

function leakyReLU(x) {
    if (x >= 0) {
        return 1*x;
    } else {
        return 0.01*x;
    }
}

instead of the former:

function leakyReLU(x) {
    if (x >= 0) {
        return 1*x;
    } else {
        return 0.1*x;
    }

}