Filters








20 Hits in 10.4 sec

Convergence rate of stochastic k-means [article]

Cheng Tang, Claire Monteleoni
2016 arXiv   pre-print
The k-means objective is non-convex and non-differentiable: we exploit ideas from non-convex gradient-based optimization by providing a novel characterization of the trajectory of k-means algorithm on  ...  Both scale up the widely used Lloyd 's algorithm via stochastic approximation, and have become popular for large-scale clustering and unsupervised feature learning.  ...  In Proceedings of The 28th Conference on Learning Theory, COLT 2015, Paris, France, July 3-6, 2015, pages 797-842, 2015. [10] Moritz Hardt.  ... 
arXiv:1610.04900v2 fatcat:5zpfr3qxbjg4hebnbmgzud3y4e

Frequency-Domain Representation of First-Order Methods: A Simple and Robust Framework of Analysis [article]

Ioannis Anagnostides, Ioannis Panageas
2021 arXiv   pre-print
An interesting byproduct is that OGD -- and variants thereof -- is an instance of PID control, arguably one of the most influential algorithms of the last century; this observation sheds more light to  ...  On the applications' side, we focus on the Optimistic Gradient Descent (OGD) method, which augments the standard Gradient Descent with an additional past-gradient in the optimization step.  ...  In Peter Grünwald, Elad Hazan, and Satyen Kale, editors, Proceedings of The 28th Conference on Learning Theory, COLT 2015, Paris, France, July 3-6, 2015, volume 40 of JMLR Workshop and Conference Proceedings  ... 
arXiv:2109.04603v2 fatcat:bpr7zr4ybjavze5fapqthlg5gu

Online learning with kernel losses [article]

Aldo Pacchiano, Niladri S. Chatterji, Peter L. Bartlett
2018 arXiv   pre-print
Under conditions on the eigendecay of the kernel we provide a sharp characterization of the regret for this algorithm.  ...  eigendecay $\mu_j \le \mathcal{O}(e^{-\beta j })$, we get an even tighter bound on the regret $\mathcal{R}_n \le \mathcal{O}(n^{1/2}\log(n)^{1/2})$.  ...  Acknowledgments We gratefully acknowledge the support of the NSF through grant IIS-1619362 and of the Australian Research Council through an Australian Laureate Fellowship (FL110100281) and through the  ... 
arXiv:1802.09732v1 fatcat:y3hrdddu2rcqfp3mpy32zugvkq

Escaping Saddle Points with Adaptive Gradient Methods [article]

Matthew Staib, Sashank J. Reddi, Satyen Kale, Sanjiv Kumar, Suvrit Sra
2020 arXiv   pre-print
By studying the preconditioner on its own, we elucidate its purpose: it rescales the stochastic gradient noise to be isotropic near stationary points, which helps escape saddle points.  ...  To this end, we first provide a novel view of adaptive methods as preconditioned SGD, where the preconditioner is estimated in an online manner.  ...  Acknowledgements This work was supported in part by the DARPA Lagrange grant, and an Amazon Research Award. We thank Nicolas Le Roux for helpful conversations.  ... 
arXiv:1901.09149v2 fatcat:uxtskdq6nvfu7k6w7ocxlusk2m

Efficiently avoiding saddle points with zero order methods: No gradients required [article]

Lampros Flokas, Emmanouil-Vasileios Vlatakis-Gkaragkounis, Georgios Piliouras
2019 arXiv   pre-print
For a wide variety of gradient approximators based on finite differences, we establish asymptotic convergence to second order stationary points using a carefully tailored application of the Stable Manifold  ...  We consider the case of derivative-free algorithms for non-convex optimization, also known as zero order algorithms, that use only function evaluations rather than gradients.  ...  Finally, this work was supported by the Onassis Foundation -Scholarship ID: F ZN 010-1/2017-2018.  ... 
arXiv:1910.13021v1 fatcat:bbv2t3or3vapdclptz2qwwougi

Topic Modeling with Wasserstein Autoencoders

Feng Nan, Ran Ding, Ramesh Nallapati, Bing Xiang
2019 Proceedings of the 57th Annual Meeting of the Association for Computational Linguistics  
To measure the diversity of the produced topics, we propose a simple topic uniqueness metric.  ...  We exploit the structure of the latent space and apply a suitable kernel in minimizing the Maximum Mean Discrepancy (MMD) to perform distribution matching.  ...  In Proceedings of the 35th International Conference on Machine Learn- ing, volume 80 of Proceedings of Machine Learning Research, pages 2678-2687, Stockholmsmässan, Stockholm Sweden. PMLR.  ... 
doi:10.18653/v1/p19-1640 dblp:conf/acl/NanDNX19 fatcat:hqanr3yzmfbdvj32jrc5vbr6mu

Online Learning in Kernelized Markov Decision Processes [article]

Sayak Ray Chowdhury, Aditya Gopalan
2019 arXiv   pre-print
and reward function structure on the learning performance.  ...  Our results are applicable to multidimensional state and action spaces with composite kernel structures, and generalize results from the literature on kernelized bandits, and the adaptive control of parametric  ...  Thompson sampling for learning parameterized markov decision processes. In Proceedings of The 28th Conference on Learning Theory, COLT 2015, Paris, France, July 3-6, 2015, pages 861-898, 2015.  ... 
arXiv:1805.08052v2 fatcat:bjoxa45pqrho7a5y4k2zpp5mmi

Research and Science Today No. 1(9)/2015

Flavius Cristian Marcau
2015 Research and Science Today  
The matryoshka -Russian Doll Effect The (im)mediate conclusion of the present study confirms the fact that an analysed course of structuralism cannot resist the temptation of departing from a (poetic)  ...  guide of postmodernism, which coincidentally announces, in a Derridian manner, "the free play of significant" with all re-filtered reclaiming of the écrivant, textuality, "metaphysics of absence" or detested  ...  on the occasion of the Ministerial Conference in Bucharest since 2012 in which it was asoptata Strategy. 5 OECD, Tertiary education for the Knowledge Society, Paris : OECD, 2008. 6 Gorun, H.T., Gorun  ... 
doaj:caac6c0949bb42b09a5944fe847103d5 fatcat:i4ctjistyradnmydqsftpihaoa

The U.S. Marine Corps' Tank Doctrine, 1920–50

Kenneth W. Estes, Romain Cansière
2021 Marine Corps history  
Major Joseph DiDomenico's study of U.S. Army influence on U.S. Marine Corps tank doctrine appeared in the Summer 2018 issue of this journal, titled "The U.S.  ...  Mobilizing an impressive array of primary and secondary sources, DiDomenico laid considerable credit for the Corps' improvements to its nascent World War II tank and amphibious tractor doctrine on the  ...  in Paris, France, on 19 November 1859.  ... 
doi:10.35318/mch.2020060203 fatcat:xmgplnpbcvf5lo3eqhavjspcja

La divulgazione orientalista francese di fine Ottocento e lo sviluppo sociale dei popoli d'Oriente: gli Armeni di Ernest Chantre [chapter]

Massimiliano Vaghi
2020 Eurasiatica  
An accurate analysis of the works of Ernest Chantre (1843-1924), often published under the auspices of the French Ministry of Public Education, shows a particular interest for civilisations of the Middle  ...  Chantre is influenced by the racial view that dominates in Europe in the late 19th century but, in the same time, he participates in the dissemination of knowledge of cultures and society of the Middle  ...  (Note to the President of the Peace Conference, 24 July 1919.  ... 
doi:10.30687/978-88-6969-453-0/004 fatcat:w4zuob3vtnhx5gkgxhkfobqhmu

Copenhagen Business School [chapter]

2018 The Grants Register 2018  
or conference proceedings.  ...  Conference Grant Program Subjects: Social science and humanities. Purpose: To assist an institution in holding a conference and publishing the resulting papers and proceedings in a scholarly fashion.  ...  of the following: international relations, public administration, political science, law, economics, European studies with an emphasis on Germany, German or German Studies, with a minor in one of the  ... 
doi:10.1007/978-1-349-94186-5_356 fatcat:lgs5dkulnvapxcn3cy76s633ii

Canadian Hospitality Foundation [chapter]

2018 The Grants Register 2018  
or conference proceedings.  ...  Conference Grant Program Subjects: Social science and humanities. Purpose: To assist an institution in holding a conference and publishing the resulting papers and proceedings in a scholarly fashion.  ...  of the following: international relations, public administration, political science, law, economics, European studies with an emphasis on Germany, German or German Studies, with a minor in one of the  ... 
doi:10.1007/978-1-349-94186-5_270 fatcat:cyiupyji4zbthhrtuvanuxnbli

Canadian Association for the Practical Study of Law in Education (CAPSLE) [chapter]

2018 The Grants Register 2019  
Conference Grant Program Subjects: Social science and humanities. Purpose: To assist an institution in holding a conference and publishing the resulting papers and proceedings in a scholarly fashion.  ...  Closing Date: Between July 1st and October 31st Funding: Private Contributor: Hitachi Limited No. of awards given last year: 3 No. of applicants last year: 6 Additional Information: While the Fellow is  ...  Purpose: The Curtin University is offering 3-year fully-funded PhD scholarship in Public Health.  ... 
doi:10.1007/978-1-349-95810-8_264 fatcat:kf6tson3dbfpvgcndstlhqw664

Center for Defense Information (CDI) [chapter]

2018 The Grants Register 2019  
Conference Grant Program Subjects: Social science and humanities. Purpose: To assist an institution in holding a conference and publishing the resulting papers and proceedings in a scholarly fashion.  ...  Closing Date: Between July 1st and October 31st Funding: Private Contributor: Hitachi Limited No. of awards given last year: 3 No. of applicants last year: 6 Additional Information: While the Fellow is  ...  Purpose: The Curtin University is offering 3-year fully-funded PhD scholarship in Public Health.  ... 
doi:10.1007/978-1-349-95810-8_310 fatcat:xqtuzwykx5d55flbitvl2wg3gm

Canadian Space agency [chapter]

2018 The Grants Register 2019  
Conference Grant Program Subjects: Social science and humanities. Purpose: To assist an institution in holding a conference and publishing the resulting papers and proceedings in a scholarly fashion.  ...  Closing Date: Between July 1st and October 31st Funding: Private Contributor: Hitachi Limited No. of awards given last year: 3 No. of applicants last year: 6 Additional Information: While the Fellow is  ...  Purpose: The Curtin University is offering 3-year fully-funded PhD scholarship in Public Health.  ... 
doi:10.1007/978-1-349-95810-8_284 fatcat:msbsorn4ardwnjosr2zr4x24c4
« Previous Showing results 1 — 15 out of 20 results