Comparing Spectral Bias and Robustness For Two-Layer Neural Networks: SGD vs Adaptive Random Fourier

link之家

链接快照平台

输入网页链接，自动生成快照
标签化管理网页链接

相关文章推荐

八块腹肌的遥控器 · Hugging Face ...· 1 年前 ·

含蓄的薯片 · 将Db2 for ...· 1 年前 ·

文质彬彬的咖啡豆 · Self referencing loop ...· 1 年前 ·

想出国的弓箭 · 第十二届非线性偏微分方程暑期讲习班-非线性微 ...· 2 年前 ·

大力的枕头 · 2018腾讯内部调岗面试试题1——使用C/C ...· 2 年前 ·

We present experimental results highlighting two key differences resulting from the choice of training algorithm for two-layer neural networks. The spectral bias of neural networks is well known, while the spectral bias dependence on the choice of training algorithm is less studied. Our experiments demonstrate that an adaptive random Fourier features algorithm (ARFF) can yield a spectral bias closer to zero compared to the stochastic gradient descent optimizer (SGD). Additionally, we train two identically structured classifiers, employing SGD and ARFF, to the same accuracy levels and empirically assess their robustness against adversarial noise attacks. 中文翻译：

推荐文章

八块腹肌的遥控器 · Hugging Face 社区中蓬勃发展的计算机视觉 - HuggingFace - 博客园

1 年前

含蓄的薯片 · 将Db2 for LUW同步至自建Kafka集群_数据传输服务(DTS)-阿里云帮助中心

1 年前

文质彬彬的咖啡豆 · Self referencing loop detected - Microsoft Q&A

1 年前

想出国的弓箭 · 第十二届非线性偏微分方程暑期讲习班-非线性微分方程暑期讲习班

2 年前

大力的枕头 · 2018腾讯内部调岗面试试题1——使用C/C++但不能用sizeof判断操作系统是32位还是64位-腾讯云开发者社区-腾讯云

2 年前