on FPGA Shuyi Chen Lizi George Kelly Ran Outline Motivation - PowerPoint PPT Presentation

Polyphonic Music Transcription on FPGA Shuyi Chen Lizi George Kelly Ran

Outline • Motivation • System • Architecture • Evaluation • Exploration

Motivation • Speed • Polyphonic detection methods are still being investigated – Using techniques from growing field of speech recognition • Real-time transcription

Background • Research is currently ongoing into best algorithm for polyphonic pitch detection with timbre rejection • A paper in Spring 2012 describes Klapuri algorithm and several others – We chose to implement Klapuri because it had the lowest error rate of 6 algorithms discussed for 1-4 pitches per time-slice

System Block Diagram

Input and Hanning Windows • Negate impact of sharp edges in time slices

FFT and Absolute Value • 4096-pt Streaming FFT – Minimal area requirements – ML605 Virtex-6 FPGA needed …

Spectral Whitening • Smooth out spectrum of computed sub-bands without boosting noise – Uses inverse filtering to flatten spectrum energy distribution to mitigate timbre effects

Spectral Whitening

Salience • Uses variation of binary search to find pitches present during time-slice – Includes harmonic contributions

Test Bench • MATLAB implementation of Klapuri algorithm – Compare to this result for algorithm checking • Lilypond engraving software output compared to known – Shell scripts written to take output file and generate lilypond code and refresh pdf in realtime

Evaluation • FFT output is in bit-reversed order – Implemented a sorter • Cube root implementation in binary – More efficient • SquareRoot and StreamFFT were reused IP blocks • Realtime?

Future Work • Increase FFT resolution in response to smaller differences between pitches as lower frequencies • Decreasing window size • Adding beat detection • Attempt to improve algorithm for 4-part piano harmonies • User-friendly real-time transcription system (front-end GUI, user input)

Synthesis Report • 4096-pt FFT has difficulties synthesizing on FPGA – Using Virtex-6 ML605 • We plan to complete synthesis and run on FPGA in the next few days

Questions?

on FPGA Shuyi Chen Lizi George Kelly Ran Outline Motivation - PowerPoint PPT Presentation

Polyphonic Music Transcription on FPGA Shuyi Chen Lizi George Kelly Ran Outline Motivation System Architecture Evaluation Exploration Motivation Speed Polyphonic detection methods are still being investigated

Open Source FPGA Toolchain FPGA LSE Summer Week 2015 iCE40 Flow Conclusion Vincent Gatine

Tips about an FPGA 02/09/2018 J.C. special topic FPGA ( field-programmable gate array ) FPGA :

FPGA What is a FPGA? How FPGAs work How do they work? Manufacturers

WWW.FPGA What is an FPGA? Field Programmable Gate Array Introduction to FPGA designs

Current Trends in Hybrid FPGA/CPU Devices Hybrid FPGA/CPU Devices Xilinx Zynq Series Real

FPGA-CAPELLA: A REAL TIME AUDIO FX UNIT COSMA KUFA AND JUSTIN XIAO WHAT IS FPGA-CAPELLA?

GRVI Phalanx Update: A Massively Parallel RISC-V FPGA Accelerator Framework Jan Gray |

RTLinux in an FPGA Alejandro Lucero alucero@os3sl.com www.os3sl.com RTLinux in a FPGA 1.

Public FPGA based DM Public FPGA based DMA Atta A Attacking king UlfFrisk Agenda Background

An introduction to FPGA-based acceleration of neural networks Marco Pagani 1 What is an FPGA?

T42 Transputer Design in FPGA Transputer Design in FPGA T42 Year- -Three Design Status

T42 Transputer Design in FPGA Transputer Design in FPGA T42 Year- -Two Design Status

FPGA%Timing%Models Many%FPGA%and%CPLD%vendors%provide%a% timing model

The nextpnr FOSS FPGA place-and-route tool Clifford Wolf Symbiotic EDA FOSS FPGA PnR VPR

From OO to FPGA: From OO to FPGA: Fitting Round Objects Fitting Round Objects into Square

Andrew Clinton, Matt Liberty, Ian Kuon FPGA Routing (Interconnect) FPGA routing consists of a

Attorney Generals D Direct ctive 2 2015-1 Police Body W Worn Cameras a and Stored B Body

Police and Community Engagement Team Presented for Information Edmonton Police Commission

GREATER SUDBURY POLICE SERVICES BOARD Ontario Regulation 58/16 Collection of Identifying

Shouldnt teens How Do We Best Equip Police to still know Handle Youth? RIGHT from A

THE RESEARCH PRACTICE GAP: A COMPARATIVE PERSPECTIVE Ileana Steccolini Newcastle University

Document Vectors in the Wild: Building a Content Recommendation System for Reuters.com James

Informa(on Retrieval as Sta(s(cal Transla(on Presented by: Lin

Imagine a language learning platform that helps you remember every new word http://lexicum.net

Explore More Topics

Sambuz

Useful Links

Newsletter

Mail Us