Neural Networks: Tricks of the Trade [electronic resource] /

It is our belief that researchers and practitioners acquire, through experience and word-of-mouth, techniques and heuristics that help them successfully apply neural networks to di cult real world problems. Often these \tricks" are theo- tically well motivated. Sometimes they are the result of trial and error. However, their most common link is that they are usually hidden in people’s heads or in the back pages of space-constrained conference papers. As a result newcomers to the eld waste much time wondering why their networks train so slowly and perform so poorly. This book is an outgrowth of a 1996 NIPS workshop called Tricks of the Trade whose goal was to begin the process of gathering and documenting these tricks. The interest that the workshop generated motivated us to expand our collection and compile it into this book. Although we have no doubt that there are many tricks we have missed, we hope that what we have included will prove to be useful, particularly to those who are relatively new to the eld. Each chapter contains one or more tricks presented by a given author (or authors). We have attempted to group related chapters into sections, though we recognize that the di erent sections are far from disjoint. Some of the chapters (e.g., 1, 13, 17) contain entire systems of tricks that are far more general than the category they have been placed in.

Saved in:
Bibliographic Details
Main Authors: Orr, Genevieve B. editor., Müller, Klaus-Robert. editor., SpringerLink (Online service)
Format: Texto biblioteca
Language:eng
Published: Berlin, Heidelberg : Springer Berlin Heidelberg, 1998
Subjects:Computer science., Microprocessors., Computers., Artificial intelligence., Pattern recognition., Complexity, Computational., Computer Science., Computation by Abstract Devices., Artificial Intelligence (incl. Robotics)., Processor Architectures., Pattern Recognition., Complexity.,
Online Access:http://dx.doi.org/10.1007/3-540-49430-8
Tags: Add Tag
No Tags, Be the first to tag this record!
id KOHA-OAI-TEST:170332
record_format koha
institution COLPOS
collection Koha
country México
countrycode MX
component Bibliográfico
access En linea
En linea
databasecode cat-colpos
tag biblioteca
region America del Norte
libraryname Departamento de documentación y biblioteca de COLPOS
language eng
topic Computer science.
Microprocessors.
Computers.
Artificial intelligence.
Pattern recognition.
Complexity, Computational.
Computer Science.
Computation by Abstract Devices.
Artificial Intelligence (incl. Robotics).
Processor Architectures.
Pattern Recognition.
Complexity.
Computer science.
Microprocessors.
Computers.
Artificial intelligence.
Pattern recognition.
Complexity, Computational.
Computer Science.
Computation by Abstract Devices.
Artificial Intelligence (incl. Robotics).
Processor Architectures.
Pattern Recognition.
Complexity.
spellingShingle Computer science.
Microprocessors.
Computers.
Artificial intelligence.
Pattern recognition.
Complexity, Computational.
Computer Science.
Computation by Abstract Devices.
Artificial Intelligence (incl. Robotics).
Processor Architectures.
Pattern Recognition.
Complexity.
Computer science.
Microprocessors.
Computers.
Artificial intelligence.
Pattern recognition.
Complexity, Computational.
Computer Science.
Computation by Abstract Devices.
Artificial Intelligence (incl. Robotics).
Processor Architectures.
Pattern Recognition.
Complexity.
Orr, Genevieve B. editor.
Müller, Klaus-Robert. editor.
SpringerLink (Online service)
Neural Networks: Tricks of the Trade [electronic resource] /
description It is our belief that researchers and practitioners acquire, through experience and word-of-mouth, techniques and heuristics that help them successfully apply neural networks to di cult real world problems. Often these \tricks" are theo- tically well motivated. Sometimes they are the result of trial and error. However, their most common link is that they are usually hidden in people’s heads or in the back pages of space-constrained conference papers. As a result newcomers to the eld waste much time wondering why their networks train so slowly and perform so poorly. This book is an outgrowth of a 1996 NIPS workshop called Tricks of the Trade whose goal was to begin the process of gathering and documenting these tricks. The interest that the workshop generated motivated us to expand our collection and compile it into this book. Although we have no doubt that there are many tricks we have missed, we hope that what we have included will prove to be useful, particularly to those who are relatively new to the eld. Each chapter contains one or more tricks presented by a given author (or authors). We have attempted to group related chapters into sections, though we recognize that the di erent sections are far from disjoint. Some of the chapters (e.g., 1, 13, 17) contain entire systems of tricks that are far more general than the category they have been placed in.
format Texto
topic_facet Computer science.
Microprocessors.
Computers.
Artificial intelligence.
Pattern recognition.
Complexity, Computational.
Computer Science.
Computation by Abstract Devices.
Artificial Intelligence (incl. Robotics).
Processor Architectures.
Pattern Recognition.
Complexity.
author Orr, Genevieve B. editor.
Müller, Klaus-Robert. editor.
SpringerLink (Online service)
author_facet Orr, Genevieve B. editor.
Müller, Klaus-Robert. editor.
SpringerLink (Online service)
author_sort Orr, Genevieve B. editor.
title Neural Networks: Tricks of the Trade [electronic resource] /
title_short Neural Networks: Tricks of the Trade [electronic resource] /
title_full Neural Networks: Tricks of the Trade [electronic resource] /
title_fullStr Neural Networks: Tricks of the Trade [electronic resource] /
title_full_unstemmed Neural Networks: Tricks of the Trade [electronic resource] /
title_sort neural networks: tricks of the trade [electronic resource] /
publisher Berlin, Heidelberg : Springer Berlin Heidelberg,
publishDate 1998
url http://dx.doi.org/10.1007/3-540-49430-8
work_keys_str_mv AT orrgenevievebeditor neuralnetworkstricksofthetradeelectronicresource
AT mullerklausroberteditor neuralnetworkstricksofthetradeelectronicresource
AT springerlinkonlineservice neuralnetworkstricksofthetradeelectronicresource
_version_ 1756263301223809024
spelling KOHA-OAI-TEST:1703322018-07-30T22:47:03ZNeural Networks: Tricks of the Trade [electronic resource] / Orr, Genevieve B. editor. Müller, Klaus-Robert. editor. SpringerLink (Online service) textBerlin, Heidelberg : Springer Berlin Heidelberg,1998.engIt is our belief that researchers and practitioners acquire, through experience and word-of-mouth, techniques and heuristics that help them successfully apply neural networks to di cult real world problems. Often these \tricks" are theo- tically well motivated. Sometimes they are the result of trial and error. However, their most common link is that they are usually hidden in people’s heads or in the back pages of space-constrained conference papers. As a result newcomers to the eld waste much time wondering why their networks train so slowly and perform so poorly. This book is an outgrowth of a 1996 NIPS workshop called Tricks of the Trade whose goal was to begin the process of gathering and documenting these tricks. The interest that the workshop generated motivated us to expand our collection and compile it into this book. Although we have no doubt that there are many tricks we have missed, we hope that what we have included will prove to be useful, particularly to those who are relatively new to the eld. Each chapter contains one or more tricks presented by a given author (or authors). We have attempted to group related chapters into sections, though we recognize that the di erent sections are far from disjoint. Some of the chapters (e.g., 1, 13, 17) contain entire systems of tricks that are far more general than the category they have been placed in.Speeding Learning -- Efficient BackProp -- Regularization Techniques to Improve Generalization -- Early Stopping - But When? -- A Simple Trick for Estimating the Weight Decay Parameter -- Controlling the hyperparameter search in MacKay’s Bayesian neural network framework -- Adaptive Regularization in Neural Network Modeling -- Large Ensemble Averaging -- Improving Network Models and Algorithmic Tricks -- Square Unit Augmented Radially Extended Multilayer Perceptrons -- A Dozen Tricks with Multitask Learning -- Solving the Ill-Conditioning in Neural Network Learning -- Centering Neural Network Gradient Factors -- Avoiding roundoff error in backpropagating derivatives -- Representing and Incorporating Prior Knowledge in Neural Network Training -- Transformation Invariance in Pattern Recognition — Tangent Distance and Tangent Propagation -- Combining Neural Networks and Context-Driven Search for Online, Printed Handwriting Recognition in the Newton -- Neural Network Classification and Prior Class Probabilities -- Applying Divide and Conquer to Large Scale Pattern Recognition Tasks -- Tricks for Time Series -- Forecasting the Economy with Neural Nets: A Survey of Challenges and Solutions -- How to Train Neural Networks.It is our belief that researchers and practitioners acquire, through experience and word-of-mouth, techniques and heuristics that help them successfully apply neural networks to di cult real world problems. Often these \tricks" are theo- tically well motivated. Sometimes they are the result of trial and error. However, their most common link is that they are usually hidden in people’s heads or in the back pages of space-constrained conference papers. As a result newcomers to the eld waste much time wondering why their networks train so slowly and perform so poorly. This book is an outgrowth of a 1996 NIPS workshop called Tricks of the Trade whose goal was to begin the process of gathering and documenting these tricks. The interest that the workshop generated motivated us to expand our collection and compile it into this book. Although we have no doubt that there are many tricks we have missed, we hope that what we have included will prove to be useful, particularly to those who are relatively new to the eld. Each chapter contains one or more tricks presented by a given author (or authors). We have attempted to group related chapters into sections, though we recognize that the di erent sections are far from disjoint. Some of the chapters (e.g., 1, 13, 17) contain entire systems of tricks that are far more general than the category they have been placed in.Computer science.Microprocessors.Computers.Artificial intelligence.Pattern recognition.Complexity, Computational.Computer Science.Computation by Abstract Devices.Artificial Intelligence (incl. Robotics).Processor Architectures.Pattern Recognition.Complexity.Springer eBookshttp://dx.doi.org/10.1007/3-540-49430-8URN:ISBN:9783540494300