Neural Program Synthesis Rishabh Singh, Google Brain Great - PowerPoint PPT Presentation

Sep 13, 2022 •19 likes •1.44k views

Neural Program Synthesis Rishabh Singh, Google Brain Great Collaborators! Deep Learning and Evolutionary Progression Vision Speech Language Deep Learning and Evolutionary Progression Vision Speech Language Programming Deep Learning

Reverse-Recursive Input: root representation from recursive pass
Reverse-Recursive Input: root representation from recursive pass
Reverse-Recursive Input: root representation from recursive pass Output: Global leaf representations.
Reverse-Recursive Input: root representation from recursive pass Output: Global leaf representations.
Reverse-Recursive Input: root representation from recursive pass Output: Global leaf representations.
Cross-Correlation I/O Encoder
Cross-Correlation I/O Encoder
Cross-Correlation I/O Encoder
Synthetic Data Results (< 13 AST)
FlashFill Benchmarks
FlashFill Benchmarks Batching Trees for larger programs
FlashFill Benchmarks Batching Trees for larger programs R3NN for contextual program embeddings
RobustFill [ICML 2017] J. Devlin, J. Uesato, S. Bhuptiraju, R. Singh, A. Mohamed, P . Kohli
RobustFill [ICML 2017] J. Devlin, J. Uesato, S. Bhuptiraju, R. Singh, A. Mohamed, P . Kohli
RobustFill [ICML 2017] J. Devlin, J. Uesato, S. Bhuptiraju, R. Singh, A. Mohamed, P . Kohli
RobustFill [ICML 2017] J. Devlin, J. Uesato, S. Bhuptiraju, R. Singh, A. Mohamed, P . Kohli
Multiple I/O Examples
Multiple I/O Examples
Multiple I/O Examples
Extended DSL
92% Generalization Accuracy
Robustness with Noise
Incorrect Generalization

Recommend

SYNTHESIS OF SUPER SYNTHESIS OF SUPER NANOPOROUS SYNTHESIS OF SUPER SYNTHESIS OF

SYNTHESIS OF SUPER SYNTHESIS OF SUPER NANOPOROUS SYNTHESIS OF SUPER SYNTHESIS OF SUPER-NANOPOROUS NANOPOROUS NANOPOROUS CARBON ALLOY BY CARBON ALLOY BY ELECTROOXIDATION OF A ZEOLITE ELECTROOXIDATION OF A ZEOLITE ELECTROOXIDATION OF A

577 views • 44 slides

Neural Information Retrieval Wassila Lalouani 1 Plan Neural network architectures Neural

Neural Information Retrieval Wassila Lalouani 1 Plan Neural network architectures Neural IR tasks Neural IR architecture Feature Representations Neural IR query auto completion Neural IR query suggestion Neural IR document

1.48k views • 18 slides

From Program Synthesis to Optimal Program . . . Optimal Program Synthesis Logical Interpretation

Need for Data . . . Program Synthesis Wave Algorithm for . . . Boolean Logic . . . From Program Synthesis to Optimal Program . . . Optimal Program Synthesis Logical Interpretation . . . A Seemingly Natural . . . Counter-Example to . . .

728 views • 24 slides

Total Synthesis of the Polycyclic Total Synthesis of the Polycyclic Total Synthesis of the

Total Synthesis of the Polycyclic Total Synthesis of the Polycyclic Total Synthesis of the Polycyclic Total Synthesis of the Polycyclic Fungal Metabolite ( Fungal Metabolite () g g ( ) ( ) )-Communesin F Communesin F Liu, P.; Seo, J.

325 views • 19 slides

Chemical Synthesis Techniques Chemical Synthesis Techniques Chemical Synthesis Techniques

Chemical Synthesis Techniques Chemical Synthesis Techniques Chemical Synthesis Techniques Chemical Synthesis Techniques Thin Films & Variations Electrochemical Deposition Electrochemical Deposition (Electrodeposition, Electroplating)

673 views • 9 slides

Synthesis of Ranking Functions and Synthesis of Inductive Invariants and Synthesis of

Synthesis of Ranking Functions and Synthesis of Inductive Invariants and Synthesis of Recurrence Sets via Constraint Solving Andreas Podelski January 17, 2012 1 Program Verification and Constraints Reasoning about program

423 views • 28 slides

Neural Networks and Handwriting Recognition Background Neural Networks Neural Network Steven

Neural Networks and Handwriting Recognition Steven Sloss Math 164 Neural Networks and Handwriting Recognition Background Neural Networks Neural Network Steven Sloss Structure Training Neural Networks Math 164 Motivation Problem

895 views • 41 slides

Learning Neural Networks Learning Neural Networks Neural Networks can represent complex Neural

Learning Neural Networks Learning Neural Networks Neural Networks can represent complex Neural Networks can represent complex decision boundaries decision boundaries Variable size. Any boolean function can be Variable size. Any boolean

361 views • 14 slides

Synthesis of Carbon Synthesis of Carbon Nanotubes Nanotubes Polina Shifrina Supervisors: Dr.

Synthesis of Carbon Synthesis of Carbon Nanotubes Nanotubes Polina Shifrina Supervisors: Dr. Stephanie Reich, Heiko Dumlich 12.05.2011 Synthesis of CNT s Synthesis of CNT s Arc Discharge (1991) Laser Ablation (1995) Chemical

415 views • 17 slides

Solid Texture Synthesis Solid Texture Synthesis Solid Texture Synthesis from 2D Exemplars from

Solid Textures Solid Textures Solid Texture Synthesis Solid Texture Synthesis Solid Texture Synthesis from 2D Exemplars from 2D Exemplars from 2D Exemplars Johannes Kopf, University of Konstanz Chi-Wing Fu, Hong Kong Sc & Tech Daniel

270 views • 10 slides

Post-Synthesis Simulation VITAL Models, SDF Files, Timing Simulation Post-synthesis simulation

Post-Synthesis Simulation VITAL Models, SDF Files, Timing Simulation Post-synthesis simulation Purpose: Verify correctness of synthesized circuit Verify synthesis tool delay/timing estimates Synthesis tool generates: Gate-level

365 views • 18 slides

Text-to-Speech Synthesis Bernd Mbius Language Science and Technology Saarland University

Text-to-Speech Synthesis Bernd Mbius Language Science and Technology Saarland University Lecture 3 May 28, 2020 Formant Synthesis B Mbius Formant synthesis 1 l Formant synthesis acoustic-parametric synthesis method modeling

576 views • 22 slides

CTP431- Music and Audio Computing Sound Synthesis Graduate School of Culture Technology KAIST

CTP431- Music and Audio Computing Sound Synthesis Graduate School of Culture Technology KAIST Juhan Nam 1 Outlines Additive Synthesis Subtractive Synthesis Analog synthesizers Singing voice synthesis Nonlinear Synthesis

426 views • 39 slides

Texture Synthesis Given a texture, create more CS176: Texture Synthesis All examples from Wei

Texture Synthesis Given a texture, create more CS176: Texture Synthesis All examples from Wei & Levoy CS 176 Winter 2011 CS 176 Winter 2011 1 2 Texture Synthesis Texture Synthesis Dont expect too much And amazing successes All

348 views • 3 slides

Text-to-Image Generation Yu Cheng Text-to-Image Synthesis Text-to-Image Synthesis

Text-to-Image Generation Yu Cheng Text-to-Image Synthesis Text-to-Image Synthesis StackGAN, AttnGAN, TAGAN, ObjGAN Text-to-Video Synthesis GAN-based methods, VAE-based methods, StoryGAN Dialogue-based Image Synthesis

831 views • 45 slides

Scaling Program Synthesis by Exploiting Existing Code James Bornholt Emina Torlak University of

Scaling Program Synthesis by Exploiting Existing Code James Bornholt Emina Torlak University of Washington Synthesis: write programs automatically Syntax Semantics Synthesis: write programs automatically Syntax Semantics Synthesis: write

1.03k views • 87 slides

Invertebrate Learning Computational Models of Neural Systems Lecture 3.3 David S. Touretzky

Invertebrate Learning Computational Models of Neural Systems Lecture 3.3 David S. Touretzky October, 2007 Eric Kandel Nobel Prize in Physiology or Medicine, 2000 10/10/07 Computational Models of Neural Systems 2 Aplysia Californica

781 views • 55 slides

The influence of forward model conductivities on EEG/MEG source reconstruction Jens Haueisen

The influence of forward model conductivities on EEG/MEG source reconstruction Jens Haueisen Institut fr Biomedizinische Technik und Informatik Technische Universitt Ilmenau Introduction How does volume conduction influence source

690 views • 23 slides

Overview of the NSF-CDI project (Year-3) and Research Progress Ming-Hsiang (Ming) Tsou

Mapping Ideas from Cyberspace to Realspace. Funded by NSF Cyber- Enabled Discovery and Innovation ( CDI ) program. Award # 1028177. (2010-2014) http://mappingideas.sdsu.edu/ Overview of the NSF-CDI project (Year-3) and Research Progress

451 views • 30 slides

THIRD QUARTER 2017 EARNINGS CALL November 21, 2017 Disclosures regarding Forward Looking

Q1 2017 EARNINGS CALL THIRD QUARTER 2017 EARNINGS CALL November 21, 2017 Disclosures regarding Forward Looking Statements & Non-GAAP Financial Measures (pages 13-23) Q3 2017 EARNINGS CALL THIRD QUARTER HIGHLIGHTS Comp Sales +5.7% Gross

771 views • 24 slides

A Blueprint of Standardized and Composable ML Eric Xing and Zhiting Hu Petuum & Carnegie

A Blueprint of Standardized and Composable ML Eric Xing and Zhiting Hu Petuum & Carnegie Mellon 1 The universe of problems ML/AI is trying to solve 2 2 Data and experiences of all kinds Type-2 diabetes is 90% more common than type-1

907 views • 65 slides

2015 Stroke Advances: Case 1 A Chance to Cut is a Chance to. A 75 year old man presents

2/13/2015 2015 Stroke Advances: Case 1 A Chance to Cut is a Chance to. A 75 year old man presents with a 10 minute episode of R hand weakness that has since completely resolved He takes only ASA as an outpatient S. Andrew

807 views • 10 slides

Abduction Abduction is an assumption-based reasoning strategy where H is a set of assumptions

Abduction Abduction is an assumption-based reasoning strategy where H is a set of assumptions about what could be happening in a system F axiomatizes how a system works g to be explained is an observation or a design goal Example: in

650 views • 20 slides

Enumerating coherent configurations of small order Matan Ziv-Av Ben Gurion University of the

Enumerating coherent configurations of small order Matan Ziv-Av Ben Gurion University of the Negev MTAGT, Villanova, June 2-5 2014 Coherent configurations A partition of 2 , M = R 1 , . . . , R r is a coherent configuration if CC1 i

311 views • 20 slides

Download document

More recommend

Explore More Topics

Stay informed with curated content and fresh updates.

animals pets art culture automotive transportation business finance computer internet construction architecture education-career electronics communication

Neural Program Synthesis Rishabh Singh, Google Brain Great - PowerPoint PPT Presentation

Neural Program Synthesis Rishabh Singh, Google Brain Great Collaborators! Deep Learning and Evolutionary Progression Vision Speech Language Deep Learning and Evolutionary Progression Vision Speech Language Programming Deep Learning

SYNTHESIS OF SUPER SYNTHESIS OF SUPER NANOPOROUS SYNTHESIS OF SUPER SYNTHESIS OF

Neural Information Retrieval Wassila Lalouani 1 Plan Neural network architectures Neural

From Program Synthesis to Optimal Program . . . Optimal Program Synthesis Logical Interpretation

Total Synthesis of the Polycyclic Total Synthesis of the Polycyclic Total Synthesis of the

Chemical Synthesis Techniques Chemical Synthesis Techniques Chemical Synthesis Techniques

Synthesis of Ranking Functions and Synthesis of Inductive Invariants and Synthesis of

Neural Networks and Handwriting Recognition Background Neural Networks Neural Network Steven

Learning Neural Networks Learning Neural Networks Neural Networks can represent complex Neural

Synthesis of Carbon Synthesis of Carbon Nanotubes Nanotubes Polina Shifrina Supervisors: Dr.

Solid Texture Synthesis Solid Texture Synthesis Solid Texture Synthesis from 2D Exemplars from

Post-Synthesis Simulation VITAL Models, SDF Files, Timing Simulation Post-synthesis simulation

Text-to-Speech Synthesis Bernd Mbius Language Science and Technology Saarland University

CTP431- Music and Audio Computing Sound Synthesis Graduate School of Culture Technology KAIST

Texture Synthesis Given a texture, create more CS176: Texture Synthesis All examples from Wei

Text-to-Image Generation Yu Cheng Text-to-Image Synthesis Text-to-Image Synthesis

Scaling Program Synthesis by Exploiting Existing Code James Bornholt Emina Torlak University of

Invertebrate Learning Computational Models of Neural Systems Lecture 3.3 David S. Touretzky

The influence of forward model conductivities on EEG/MEG source reconstruction Jens Haueisen

Overview of the NSF-CDI project (Year-3) and Research Progress Ming-Hsiang (Ming) Tsou

THIRD QUARTER 2017 EARNINGS CALL November 21, 2017 Disclosures regarding Forward Looking

A Blueprint of Standardized and Composable ML Eric Xing and Zhiting Hu Petuum & Carnegie

2015 Stroke Advances: Case 1 A Chance to Cut is a Chance to. A 75 year old man presents

Abduction Abduction is an assumption-based reasoning strategy where H is a set of assumptions

Enumerating coherent configurations of small order Matan Ziv-Av Ben Gurion University of the

Explore More Topics

Sambuz

Useful Links

Newsletter

Mail Us

Neural Program Synthesis Rishabh Singh, Google Brain Great - PowerPoint PPT Presentation

Neural Program Synthesis Rishabh Singh, Google Brain Great Collaborators! Deep Learning and Evolutionary Progression Vision Speech Language Deep Learning and Evolutionary Progression Vision Speech Language Programming Deep Learning

SYNTHESIS OF SUPER SYNTHESIS OF SUPER NANOPOROUS SYNTHESIS OF SUPER SYNTHESIS OF

Neural Information Retrieval Wassila Lalouani 1 Plan Neural network architectures Neural

From Program Synthesis to Optimal Program . . . Optimal Program Synthesis Logical Interpretation

Total Synthesis of the Polycyclic Total Synthesis of the Polycyclic Total Synthesis of the

Chemical Synthesis Techniques Chemical Synthesis Techniques Chemical Synthesis Techniques

Synthesis of Ranking Functions and Synthesis of Inductive Invariants and Synthesis of

Neural Networks and Handwriting Recognition Background Neural Networks Neural Network Steven

Learning Neural Networks Learning Neural Networks Neural Networks can represent complex Neural

Synthesis of Carbon Synthesis of Carbon Nanotubes Nanotubes Polina Shifrina Supervisors: Dr.

Solid Texture Synthesis Solid Texture Synthesis Solid Texture Synthesis from 2D Exemplars from

Post-Synthesis Simulation VITAL Models, SDF Files, Timing Simulation Post-synthesis simulation

Text-to-Speech Synthesis Bernd Mbius Language Science and Technology Saarland University

CTP431- Music and Audio Computing Sound Synthesis Graduate School of Culture Technology KAIST

Texture Synthesis Given a texture, create more CS176: Texture Synthesis All examples from Wei

Text-to-Image Generation Yu Cheng Text-to-Image Synthesis Text-to-Image Synthesis

Scaling Program Synthesis by Exploiting Existing Code James Bornholt Emina Torlak University of

Invertebrate Learning Computational Models of Neural Systems Lecture 3.3 David S. Touretzky

The influence of forward model conductivities on EEG/MEG source reconstruction Jens Haueisen

Overview of the NSF-CDI project (Year-3) and Research Progress Ming-Hsiang (Ming) Tsou

THIRD QUARTER 2017 EARNINGS CALL November 21, 2017 Disclosures regarding Forward Looking

A Blueprint of Standardized and Composable ML Eric Xing and Zhiting Hu Petuum &amp; Carnegie

2015 Stroke Advances: Case 1 A Chance to Cut is a Chance to. A 75 year old man presents

Abduction Abduction is an assumption-based reasoning strategy where H is a set of assumptions

Enumerating coherent configurations of small order Matan Ziv-Av Ben Gurion University of the

Explore More Topics

Sambuz

Useful Links

Newsletter

Mail Us

A Blueprint of Standardized and Composable ML Eric Xing and Zhiting Hu Petuum & Carnegie