Computer vision---making machines interpret images---traveled from blocks-world edge finders to deep convolutional networks matching human benchmarks, and its history is AI's most complete case of representation learning's triumph. This article presents a narrative review of the field's canonical line: Roberts's 1963 machine perception of solids, Marr's 1982 computational vision, Viola and Jones's 2001 face detection, Lowe's 2004 SIFT features, Dalal and Triggs's 2005 HOG descriptors, Felzenszwalb and colleagues' 2010 deformable part models, Szeliski's 2010 synthesis, Girshick's 2015 Fast R-CNN, Long, Shelhamer, and Darrell's 2015 fully convolutional nets, Simonyan and Zisserman's 2015 VGG, He and colleagues' 2016 ResNet, and Redmon and colleagues' 2016 YOLO. The synthesis is organized around three themes: representation, in which hand-engineered features gave way to learned hierarchies; architecture, in which convolution, regions, and residual depth solved recognition's geometry; and tasks, in which classification widened into detection, segmentation, and real-time video. It is concluded that vision's deep learning settlement reorganized the field around data and compute---and that its open problems, robustness and embodiment, define the current frontier.
Zen Revista, 10 IA· Zenodo (CERN European Organi...· 0 citations
Computer vision---making machines interpret images---traveled from blocks-world edge finders to deep convolutional networks matching human benchmarks, and its history is AI's most complete case of representation learning's triumph. This article presents a narrative review of the field's canonical line: Roberts's 1963 machine perception of solids, Marr's 1982 computational vision, Viola and Jones's 2001 face detection, Lowe's 2004 SIFT features, Dalal and Triggs's 2005 HOG descriptors, Felzenszwalb and colleagues' 2010 deformable part models, Szeliski's 2010 synthesis, Girshick's 2015 Fast R-CNN, Long, Shelhamer, and Darrell's 2015 fully convolutional nets, Simonyan and Zisserman's 2015 VGG, He and colleagues' 2016 ResNet, and Redmon and colleagues' 2016 YOLO. The synthesis is organized around three themes: representation, in which hand-engineered features gave way to learned hierarchies; architecture, in which convolution, regions, and residual depth solved recognition's geometry; and tasks, in which classification widened into detection, segmentation, and real-time video. It is concluded that vision's deep learning settlement reorganized the field around data and compute---and that its open problems, robustness and embodiment, define the current frontier.
Zen Revista, 10 IA· Zenodo (CERN European Organi...· 0 citations
Federated learning---training a shared model across many devices that never surrender their data---inverted machine learning's architecture: instead of data to the model, the model to the data. This article presents a narrative review of that arc's canonical line: Dwork and colleagues' 2006 differential privacy, Dwork and Roth's 2014 foundations, Shokri and Shmatikov's 2015 privacy-preserving deep learning, Konecny and colleagues' 2016 communication strategies, McMahan and colleagues' 2017 FedAvg, Bonawitz and colleagues' 2017 secure aggregation, Zhao and colleagues' 2018 non-IID study, Bonawitz and colleagues' 2019 scale design, Yang and colleagues' 2019 concept paper, Zhu, Liu, and Han's 2019 gradient leakage, Li and colleagues' 2020 convergence analysis, and Kairouz and colleagues' 2021 open problems. The synthesis is organized around three themes: privacy, in which differential privacy's calculus and secure aggregation made learning without exposure precise; algorithm, in which FedAvg's weighted averaging met the heterogeneity of real devices and real data; and system, in which scale deployments faced stragglers, leakage, and the statistical reality of non-IID partitions. It is concluded that federated learning is privacy engineering's rare full-stack success---its limits as precisely mapped as its promise---and that its open problems are the field's charter: heterogeneity, security, and the economics of participation.
Zen Revista, 10 IA· Zenodo (CERN European Organi...· 0 citations
Federated learning---training a shared model across many devices that never surrender their data---inverted machine learning's architecture: instead of data to the model, the model to the data. This article presents a narrative review of that arc's canonical line: Dwork and colleagues' 2006 differential privacy, Dwork and Roth's 2014 foundations, Shokri and Shmatikov's 2015 privacy-preserving deep learning, Konecny and colleagues' 2016 communication strategies, McMahan and colleagues' 2017 FedAvg, Bonawitz and colleagues' 2017 secure aggregation, Zhao and colleagues' 2018 non-IID study, Bonawitz and colleagues' 2019 scale design, Yang and colleagues' 2019 concept paper, Zhu, Liu, and Han's 2019 gradient leakage, Li and colleagues' 2020 convergence analysis, and Kairouz and colleagues' 2021 open problems. The synthesis is organized around three themes: privacy, in which differential privacy's calculus and secure aggregation made learning without exposure precise; algorithm, in which FedAvg's weighted averaging met the heterogeneity of real devices and real data; and system, in which scale deployments faced stragglers, leakage, and the statistical reality of non-IID partitions. It is concluded that federated learning is privacy engineering's rare full-stack success---its limits as precisely mapped as its promise---and that its open problems are the field's charter: heterogeneity, security, and the economics of participation.
Zen Revista, 10 IA· Zenodo (CERN European Organi...· 0 citations
Deep generative models---neural networks that learn data's distribution and sample from it---matured from variational autoencoders' latent geometry to diffusion models' state-of-the-art images. This article presents a narrative review of that arc's canonical line: Kingma and Welling's 2013 auto-encoding variational Bayes, Goodfellow and colleagues' 2014 generative adversarial networks, Mirza and Osindero's 2014 conditional GANs, Rezende and Mohamed's 2015 normalizing flows, Sohl-Dickstein and colleagues' 2015 nonequilibrium thermodynamics, Arjovsky and colleagues' 2017 Wasserstein GANs, Karras and colleagues' 2019 style-based generator, Ho and colleagues' 2020 denoising diffusion, Ramesh and colleagues' 2021 text-to-image generation, Dhariwal and Nichol's 2021 diffusion-beats-GANs result, Nichol and Dhariwal's 2021 improved diffusion, and Rombach and colleagues' 2022 latent diffusion. The synthesis is organized around three themes: latent foundations, in which autoencoders and flows made sampling principled; adversarial training, in which games between generator and discriminator produced realism; and diffusion's rise, in which denoising trajectories conquered synthesis. It is concluded that generative modeling's decade ran from likelihood's compromise to sampling's triumph---and that latent diffusion is the field's new foundation.
Zen Revista, 10 IA· Zenodo (CERN European Organi...· 0 citations
Deep generative models---neural networks that learn data's distribution and sample from it---matured from variational autoencoders' latent geometry to diffusion models' state-of-the-art images. This article presents a narrative review of that arc's canonical line: Kingma and Welling's 2013 auto-encoding variational Bayes, Goodfellow and colleagues' 2014 generative adversarial networks, Mirza and Osindero's 2014 conditional GANs, Rezende and Mohamed's 2015 normalizing flows, Sohl-Dickstein and colleagues' 2015 nonequilibrium thermodynamics, Arjovsky and colleagues' 2017 Wasserstein GANs, Karras and colleagues' 2019 style-based generator, Ho and colleagues' 2020 denoising diffusion, Ramesh and colleagues' 2021 text-to-image generation, Dhariwal and Nichol's 2021 diffusion-beats-GANs result, Nichol and Dhariwal's 2021 improved diffusion, and Rombach and colleagues' 2022 latent diffusion. The synthesis is organized around three themes: latent foundations, in which autoencoders and flows made sampling principled; adversarial training, in which games between generator and discriminator produced realism; and diffusion's rise, in which denoising trajectories conquered synthesis. It is concluded that generative modeling's decade ran from likelihood's compromise to sampling's triumph---and that latent diffusion is the field's new foundation.
Zen Revista, 10 IA· Zenodo (CERN European Organi...· 0 citations
Graph neural networks---learning over relational, irregular structure by passing messages between nodes---generalized deep learning's grids to the graph: molecules, social networks, knowledge bases, and the web. This article presents a narrative review of that arc's canonical line: Sperduti and Starita's 1997 structure classification, Gori, Monfardini, and Scarselli's 2005 graph-domain learning, Scarselli and colleagues' 2009 GNN model, Bruna and colleagues' 2014 spectral networks, Defferrard and colleagues' 2016 localized filtering, Kipf and Welling's 2017 graph convolutions, Gilmer and colleagues' 2017 message passing, Hamilton, Ying, and Leskovec's 2017 GraphSAGE, Velickovic and colleagues' 2018 attention, Ying and colleagues' 2019 GNNExplainer, Wu and colleagues' 2021 comprehensive survey, and Bronstein and colleagues' 2021 geometric deep learning. The synthesis is organized around three themes: recursion, in which state propagation over nodes founded learning on graphs; convolution, in which spectral theory and message passing gave the graph a deep architecture; and geometry, in which attention, pooling, explainability, and symmetry made the network general. It is concluded that the GNN is deep learning's relational settlement---convolution's invariance learned from graph geometry rather than grid regularity---and that its message-passing abstraction is one of machine learning's cleanest unifications.
Zen Revista, 10 IA· Zenodo (CERN European Organi...· 0 citations
Graph neural networks---learning over relational, irregular structure by passing messages between nodes---generalized deep learning's grids to the graph: molecules, social networks, knowledge bases, and the web. This article presents a narrative review of that arc's canonical line: Sperduti and Starita's 1997 structure classification, Gori, Monfardini, and Scarselli's 2005 graph-domain learning, Scarselli and colleagues' 2009 GNN model, Bruna and colleagues' 2014 spectral networks, Defferrard and colleagues' 2016 localized filtering, Kipf and Welling's 2017 graph convolutions, Gilmer and colleagues' 2017 message passing, Hamilton, Ying, and Leskovec's 2017 GraphSAGE, Velickovic and colleagues' 2018 attention, Ying and colleagues' 2019 GNNExplainer, Wu and colleagues' 2021 comprehensive survey, and Bronstein and colleagues' 2021 geometric deep learning. The synthesis is organized around three themes: recursion, in which state propagation over nodes founded learning on graphs; convolution, in which spectral theory and message passing gave the graph a deep architecture; and geometry, in which attention, pooling, explainability, and symmetry made the network general. It is concluded that the GNN is deep learning's relational settlement---convolution's invariance learned from graph geometry rather than grid regularity---and that its message-passing abstraction is one of machine learning's cleanest unifications.
Zen Revista, 10 IA· Zenodo (CERN European Organi...· 0 citations
This narrative review examines the current state of knowledge regarding Reinforcement Learning in Robotics within the broader context of Artificial Intelligence. We survey the theoretical foundations, methodological approaches, and key findings that have shaped the field, identifying major themes and tracing the evolution of ideas over time. The review synthesizes evidence from multiple research traditions and highlights both established conclusions and areas of ongoing debate. Particular attention is given to recent advances that have opened new avenues for investigation and to the practical implications of theoretical developments. We conclude with a discussion of the most promising directions for future research, emphasizing the importance of interdisciplinary collaboration and methodological innovation.
Zen Revista, 10 IA· Zenodo (CERN European Organi...· 0 citations
This narrative review examines the current state of knowledge regarding Reinforcement Learning in Robotics within the broader context of Artificial Intelligence. We survey the theoretical foundations, methodological approaches, and key findings that have shaped the field, identifying major themes and tracing the evolution of ideas over time. The review synthesizes evidence from multiple research traditions and highlights both established conclusions and areas of ongoing debate. Particular attention is given to recent advances that have opened new avenues for investigation and to the practical implications of theoretical developments. We conclude with a discussion of the most promising directions for future research, emphasizing the importance of interdisciplinary collaboration and methodological innovation.
Zen Revista, 10 IA· Zenodo (CERN European Organi...· 0 citations
Reinforcement learning---learning what to do from reward and punishment rather than from instruction---unifies animal psychology, optimal control, and machine learning into one computational program, and its deep-learning era delivered the field's most visible artificial intelligence achievements. This article presents a narrative review of the canonical line: Thorndike's 1911 law of effect, Bellman's 1957 dynamic programming, Samuel's 1959 checkers player, Sutton's 1988 temporal-difference learning, Watkins and Dayan's 1992 Q-learning, Tesauro's 1995 TD-Gammon, Sutton and Barto's 1998 synthesis, Mnih and colleagues' 2015 Deep Q-Network, Silver and colleagues' 2016 AlphaGo and 2017 AlphaGo Zero, Lillicrap and colleagues' continuous control with DDPG, and Schulman and colleagues' 2017 proximal policy optimization. The synthesis is organized around three themes: foundations, in which the credit-assignment problem received formal solutions in value functions and temporal difference; scaling, in which function approximation, experience replay, and self-play converted tabular theory into high-dimensional control; and algorithmic consolidation, in which actor-critic methods and policy gradients stabilized practice. It is concluded that reinforcement learning's contribution is a general grammar of goal-directed learning---and that its open problems, sample efficiency and reward specification, define the frontier between artificial and natural intelligence.
Zen Revista, 10 IA· Zenodo (CERN European Organi...· 0 citations
Reinforcement learning---learning what to do from reward and punishment rather than from instruction---unifies animal psychology, optimal control, and machine learning into one computational program, and its deep-learning era delivered the field's most visible artificial intelligence achievements. This article presents a narrative review of the canonical line: Thorndike's 1911 law of effect, Bellman's 1957 dynamic programming, Samuel's 1959 checkers player, Sutton's 1988 temporal-difference learning, Watkins and Dayan's 1992 Q-learning, Tesauro's 1995 TD-Gammon, Sutton and Barto's 1998 synthesis, Mnih and colleagues' 2015 Deep Q-Network, Silver and colleagues' 2016 AlphaGo and 2017 AlphaGo Zero, Lillicrap and colleagues' continuous control with DDPG, and Schulman and colleagues' 2017 proximal policy optimization. The synthesis is organized around three themes: foundations, in which the credit-assignment problem received formal solutions in value functions and temporal difference; scaling, in which function approximation, experience replay, and self-play converted tabular theory into high-dimensional control; and algorithmic consolidation, in which actor-critic methods and policy gradients stabilized practice. It is concluded that reinforcement learning's contribution is a general grammar of goal-directed learning---and that its open problems, sample efficiency and reward specification, define the frontier between artificial and natural intelligence.
Zen Revista, 10 IA· Zenodo (CERN European Organi...· 0 citations