hh.sePublikasjoner
Endre søk
RefereraExporteraLink to record
Permanent link

Direct link
Referera
Referensformat
  • apa
  • ieee
  • modern-language-association-8th-edition
  • vancouver
  • Annet format
Fler format
Språk
  • de-DE
  • en-GB
  • en-US
  • fi-FI
  • nn-NO
  • nn-NB
  • sv-SE
  • Annet språk
Fler språk
Utmatningsformat
  • html
  • text
  • asciidoc
  • rtf
A simple trick for estimating the weight decay parameter
Högskolan i Halmstad, Akademin för informationsteknologi, Halmstad Embedded and Intelligent Systems Research (EIS).
1998 (engelsk)Inngår i: Neural Networks: Tricks of the Trade / [ed] Genevieve B. Orr and Klaus-Robert Müller, Berlin: Springer Berlin/Heidelberg, 1998, s. 71-92Konferansepaper, Publicerat paper (Fagfellevurdert)
Abstract [en]

We present a simple trick to get an approximate estimate of the weight decay parameter lambda. The method combines early stopping and weight decay, into the estimate lambda=parallel to del E(W(es))parallel to/parallel to 2W(es)parallel to, where W(es) is the set of weights at the early stopping point, and E(W) is the training data fit error. The estimate is demonstrated and compared to the standard cross-validation procedure for lambda selection on one synthetic and four real life data sets. The result is that lambda is as good an estimator for the optimal weight decay parameter value as the standard search estimate, but orders of magnitude quicker to compute. The results also show that weight decay can produce solutions that are significantly superior to committees of networks trained with early stop ping.

sted, utgiver, år, opplag, sider
Berlin: Springer Berlin/Heidelberg, 1998. s. 71-92
Serie
Lecture Notes in Computer Science, ISSN 0302-9743 ; 1524
HSV kategori
Identifikatorer
URN: urn:nbn:se:hh:diva-18803DOI: 10.1007/3-540-49430-8_4ISI: 000083105900004ISBN: 3-540-65311-2 (tryckt)OAI: oai:DiVA.org:hh-18803DiVA, id: diva2:541008
Tilgjengelig fra: 2012-07-13 Laget: 2012-06-25 Sist oppdatert: 2020-05-15bibliografisk kontrollert

Open Access i DiVA

Fulltekst mangler i DiVA

Andre lenker

Forlagets fulltekst

Personposter BETA

Rögnvaldsson, Thorsteinn

Søk i DiVA

Av forfatter/redaktør
Rögnvaldsson, Thorsteinn
Av organisasjonen

Søk utenfor DiVA

GoogleGoogle Scholar

doi
isbn
urn-nbn

Altmetric

doi
isbn
urn-nbn
Totalt: 197 treff
RefereraExporteraLink to record
Permanent link

Direct link
Referera
Referensformat
  • apa
  • ieee
  • modern-language-association-8th-edition
  • vancouver
  • Annet format
Fler format
Språk
  • de-DE
  • en-GB
  • en-US
  • fi-FI
  • nn-NO
  • nn-NB
  • sv-SE
  • Annet språk
Fler språk
Utmatningsformat
  • html
  • text
  • asciidoc
  • rtf