Steven K. Tjoa  ⋅  stevetjoa.com/cv  ⋅  steve at stevetjoa com

Last updated 24 December 2016.

Education

Ph. D., Electrical Engineering

University of Maryland  ⋅  College Park, MD  ⋅  1/2007–5/2011

  • Advisor: K. J. Ray Liu (President, IEEE Signal Processing Society; IEEE Fellow; AAAS Fellow).

  • Dissertation: “Sparse and Nonnegative Factorizations for Music Understanding”

M. S., Electrical Engineering

University of Maryland  ⋅  College Park, MD  ⋅  8/2004–12/2006

  • Scholarly Paper: “Digital Image Source Coder Identification: A Non-Intrusive Forensic Methodology”

B. S., Computer Engineering

University of Maryland  ⋅  College Park, MD  ⋅  8/2000–5/2004

  • University Honors Program. Citation in Music Performance. UM Symphony Orchestra.

Industry Experience

Founder

Classical Metrics, LLC  ⋅  San Francisco, CA  ⋅  11/2013–present

  • Developing software to remove the barriers encountered when learning, rehearsing, and performing classical music.

  • Consulted on projects related to signal processing and machine learning for companies in the audio industry.

Engineer

Humtap, Inc.  ⋅  San Francisco, CA  ⋅  1/2014–1/2015

  • Designed, implemented, and tested signal processing and machine learning algorithms to transcribe acoustic input into symbolic musical output.

Postdoctoral Research Engineer

iZotope, Inc.  ⋅  San Francisco, CA  ⋅  3/2012–6/2013

Imagine Research, Inc. (acquired by iZotope, Inc.)  ⋅  San Francisco, CA  ⋅  6/2011–3/2012

  • Received a two-year Small Business Postdoctoral Research Fellowship from the U. S. National Science Foundation (NSF).

  • Implemented algorithms to improve the MediaMined sound classifier and search engine. Examples include support vector machines, linear discriminant analysis, principal component analysis, nonnegative matrix factorization, and k-means clustering.

  • Prepared the MediaMined production server for widespread commercial use over the Internet. Technologies included Amazon Web Services (EC2, S3, RDS, SNS) for automation and scalability, PHP web server, and MySQL database server.

  • Wrote mediamined, an internal Python package. Subpackages include tools for rhythmic analysis (rhythm), timbral analysis (timbre), database communication (database), web communication (web), transfers to/from Amazon S3 (s3), audio collection management (collection), unit tests (test), signal processing (signal), and machine learning (ml). Compliant with Sphinx for automatic HTML and PDF documentation.

  • Wrote two automated test suites for XML validation and large-scale response-time testing.

  • Designed evaluations and visualizations to verify the quality of MediaMined’s search results.

  • Wrote an internal dashboard for iZotope employees that displays the usage statistics of MediaMined per user and per audio collection.

  • Wrote programs in Python (NumPy, SciPy, Matplotlib, audiolab, boto, distutils, MySQLdb, ElementTree, Multi-Mechanize, sphinx), SQL, PHP, and Octave.

  • Used project management tools such as Git, Subversion, Jira, Confluence, SourceRepo, and GoToMeeting.

  • Used agile development practices including Scrum and Kanban.

  • Served as a liaison between the industry and academic communities by reaching out to students and faculty for potential partnerships and by educating members of industry about the latest technological advances.

  • Gave two internal technical presentations.

Research Experience

Research Assistant, Dept. of ECE

University of Maryland  ⋅  College Park, MD  ⋅  6/2005–5/2011

  • Developed sparse and nonnegative factorization methods for music information retrieval (MIR) tasks such as transcription, instrument recognition, and more.

  • Developed forensic methods to detect and classify traces of compression in digital images based solely upon information intrinsic to the image such as artifacts caused by pre-processing, transformation, and quantization.

  • Received a Graduate Student Summer Research Fellowship from the Graduate School for 2008.

Research Assistant, Dept. of ECE

University of Maryland  ⋅  College Park, MD  ⋅  1/2003–8/2003

  • Implemented an indoor location system using a four-antenna array for synchronous data collection following the IEEE 802.11b standard. Wrote programs in VHDL, C, and Matlab.

Service and Leadership Activities

Mentor

Real Industry, Galvanize, Hackbright Academy

Member

IEEE, IEEE Signal Processing Society, ACM

Committee Member

International conferences and workshops.

  • Organizing Committee Stanford CCRMA MIR Workshop (2011–2016), ACM MIRUM 2012

  • Program Committee ACM Multimedia 2013-14, AdMIRe 2012

  • Technical Program Committee IEEE WIAMIS 2013, IEEE ICME (2011, 2012)

Reviewer

Nineteen journal and ninety-four conference paper submissions.

  • Journals   IEEE Trans. Audio Speech and Language Processing, IEEE Trans. Image Processing, Springer Int. J. Multimedia Information Retrieval, IEEE Trans. Information Forensics and Security, IEEE J. Selected Topics in Signal Processing, IEEE Signal Processing Letters, SPIE J. Electronic Imaging, Elsevier J. Visual Comm. and Image Representation.

  • Conferences   IEEE ICASSP (2008, 2012, 2013, 2016), ACM Multimedia (2013, 2014, 2016), IEEE WASPAA (2013, 2015), ISMIR (2011–2015), IEEE MMSP (2012, 2013), IEEE WIAMIS 2013, ACM MIRUM 2012, AdMIRe 2012, IEEE ICME (2011, 2012), Dagstuhl Seminar on Multimodal Music Processing 2011, IEEE ISCAS 2012, AES 42, IEEE ICIP (2008, 2010), IEEE ICCCAS 2006.

  • Quality Reviewer, ICME 2011

Conference Volunteer

Various international conferences

  • Helped grade the MIREX contests at ISMIR 2010 and 2011.

  • Performed administrative tasks at IEEE ICASSP 2007 and ISMIR 2008.

Coordinator, Entrepreneurial Activities

U. of Maryland  ⋅  College Park, MD  ⋅  9/2009–5/2011

  • Helped organize colloquia and social events related to entrepreneurship.

Graduate Dean’s Student Advisory Committee

U. of Maryland  ⋅  College Park, MD  ⋅  1/2008–5/2011

  • Advised the Graduate Dean on graduate-level academic issues at the University of Maryland including assistantship policy, mentoring, entrepreneurship, ethics, career placement, inter-departmental collaboration, awards and recognition, revision of the UMD Strategic Plan, facility renovations, and more.

  • Was invited for membership by nomination.

President, ECEGSA

University of Maryland  ⋅  College Park, MD  ⋅  7/2007–6/2008

  • Led the Electrical and Computer Engineering Graduate Student Association (ECEGSA), an organization that serves the 400-person ECE graduate student body through social, academic, and professional activities. Served as the primary interface between the graduate students and faculty, staff, industry, and professional organizations. Managed a board of nine graduate students.

  • Organized and moderated weekly research seminars, panel discussions, and award ceremonies. Organized such social events as hiking, skiing, barbecues, weekly coffee hours, and more.

  • Received the Graduate Student Service Award from the Department of Electrical and Computer Engineering for the 2007-2008 academic year.

Lab Manager

University of Maryland  ⋅  College Park, MD  ⋅  6/2007–5/2011

  • Handled everyday concerns related to the Multimedia Signal Processing Laboratory, including computer maintenance, item inventory, and lab organization. Created and maintained the Signals and Information Group web site.

Volunteer, Laboratory Demonstrations

University of Maryland  ⋅  College Park, MD  ⋅  4/2006–4/2011

  • Gave public demonstrations in the Multimedia Signal Processing Laboratory, including Maryland Day 2006-2011 and many others. Assisted with hands-on demonstrations.

Community Assistant, Dept. of Resident Life

Univ. of Maryland  ⋅  College Park, MD  ⋅  8/2001–8/2002

  • Provided customer service to students, parents, staff, and faculty within the UMD community. Maintained security of keys and packages within North Hill resident halls.

  • Received an award for Community Assistant of the Year for the 2001-2002 academic year.

Invited Talks

  • Two lecture and five poster presentations at international conferences. Click here for more.

  • “Music Information Retrieval in Polyphonic Mixtures,” Stanford University, CA, June 29, 2011; June 27, 2012; and June 27, 2013. Center for Computer Research in Music and Acoustics (CCRMA) Workshop on MIR.

  • “My First Four Months at a Tech Startup,” University of Maryland, College Park, MD, October 21, 2011. ECEGSA seminar.

  • “LaTeX From Scratch,” University of Maryland, College Park, MD, February 8, 2011. Workshop for ECE students. Wrote LaTeX At A Glance for participants.

  • “Make It Stick: Get Students to Remember Your Message,” University of Maryland, College Park, MD, October 27, 2010. Workshop for graduate ECE teaching assistants. Selected feedback: “I like Steve’s workshops, he’s good.” “Very helpful.” “Really useful and interesting.” “Informative and very easy to listen to.” “That’s what every TA needs to know.”

  • “Factorizing Bach: Recent Convergences Between Music and Machines,” University of Maryland, College Park, MD, February 19, 2010. ECEGSA seminar on music information retrieval. Received an ECEGSA Best Student Speaker Award for 2009-10.

  • “Public Speaking: Conquering your fears through practice,” University of Maryland, College Park, MD, March 5, 2009. Workshop for graduate ECE teaching assistants.

  • “Time Management for Teaching Assistants: There is Not Enough Time in the Day,” University of Maryland, College Park, MD, October 16, 2008 and March 8, 2010. Workshop for graduate ECE teaching assistants.

Teaching Experience

Instructor

Galvanize  ⋅  San Francisco, CA  ⋅  2016–present

  • Taught courses in data science.

Co-instructor, MIR Workshop

CCRMA, Stanford University  ⋅  Stanford, CA  ⋅  2011–2016

  • Helped teach and administer the annual summer workshop on music information retrieval. Presented lectures and designed laboratory exercises on machine learning, pitch detection, chord detection, music transcription, source separation, and deep belief networks. Recruited guest lecturers.

Lecturer

University of Maryland  ⋅  College Park, MD  ⋅  Fall 2009

  • Selected Student Feedback “The techniques used by Steve work very well for me.” “really great balance between theory and examples.” “good balance between theory and examples.” “extremely well-taught course.” “seemed genuinely interested in helping students.” “very approachable!” “has motivated me to branch into DSP.” “has been my best class this semester.” “Awesome class!!! my favorite this semester.”

  • ENEE322: Signal and System Theory Taught forty-eight students over 33% of the Fall 2009 semester. Designed lesson plans, homework assignments, and exams. Mentored two teaching assistants. Held regular office hours and review sessions. Graded exams.

Teaching Assistant

University of Maryland  ⋅  College Park, MD  ⋅  8/2005–5/2011

  • Selected Student Feedback “Steve Tjoa - Best TA in the university.” “Steve was the best TA that I have ever had at UMD. Always had an answer to any question asked and used discussion time effectively.” “The TA Steve Tjoa, was the best TA I have ever had at Maryland” “he is absolutely the best TA I’ve ever had. His way of explaining things is really amazing.” “Best TA I’ve had in EE. Knows material well, explains concepts well.” “by far the best TA I ever had at UMD.” “great understanding of the subject.” “very friendly and approachable.” “offers insight and suggestions.” “always full of energy.” “enthusiastic.” “well organized, conveyed concepts clearly.” “understands student’s needs and difficulties.” “fair and sincere.” “communicates well.” “one of the most dedicated TAs I’ve had.” “one of the most helpful TAs I’ve come across.” “extremely helpful at all times and motivates you to do good work in lab.” “holds additional office hours and is very fair at grading reports.” “I hope you win the best TA award.”

  • ENEE324H: Engineering Probability Honors Taught one section (eighteen students). Held regular office hours. Graded homework assignments.

  • ENEE408G: Multimedia Signal Processing Taught over five semesters (fifty-seven students total). Administered four design projects per semester. Assisted with final semester projects, providing directions for research. Coauthored various assignments and programming guides. Held regular office hours and graded lab reports. Mentored four additional groups (twenty students total) in Spring 2010 on final semester projects related to music information retrieval.

  • ENEE241: Numerical Techniques in Engineering Taught over two semesters (thirty-seven students total). Held regular office hours. Helped design exams. Graded homework assignments and exams.

  • ENEE428: Communications Design Laboratory Taught one section (four students). Graded lab reports for two sections (sixteen students). Assisted students with DSP programming of the TI TMS320C6701. Administered lab assignments. Held office hours.

  • Awards Received the George Corcoran Memorial Award from the Department of Electrical and Computer Engineering for the 2006-2007 academic year. Received two Distinguished Teaching Assistant Awards from the Center for Teaching Excellence. Received a travel grant to the Lilly-East Conference on College and University Teaching.

Honors 100 Section Leader

University of Maryland  ⋅  College Park, MD  ⋅  Fall 2002

  • Taught a weekly honors seminar (fourteen students), HONR100, as part of the University Honors Program. Introduced college freshmen to the qualities of a liberal education (e.g., diversity, current events, community service, arts), and helped them facilitate the transition from high school to college (e.g., academic planning, campus resources).

Computer Skills

  • Languages  Python, C, Matlab/Octave, Java, PHP, HTML/XML

  • Version Control  Git, Github, Mercurial, Bitbucket, SVN, SourceRepo

  • OSs, Servers, Databases  Unix/Linux, Mac OS X, Windows, Apache, MySQL, SQLite

  • Web Hosting Amazon Web Services EC2/S3, Linode, Slicehost, DigitalOcean

  • Hardware  TI TMS320C6701 EVM

Graduate Coursework

  • Signal Processing  Advanced Digital Signal Processing, Digital Image Processing, Space-Time Signal Processing (A+), Auditory Scene Analysis (A+)

  • Machine Learning  Statistical Pattern Recognition (A+), Pattern Recognition in Temporal Data

  • Communications  Random Processes, Information Theory, Estimation and Detection Theory, Random Graphs

  • Optimization and Controls  System Theory, Optimal Control, Advanced Numerical Optimization, Convex Optimization (A+), Networked Control Systems, Foundations of Optimization

  • Computing  Numerical Analysis, Digital Computer Design, Real-Time Collision Detection

  • Miscellaneous  Future Faculty Program Seminar I/II/III, Teaching Practicum (A+), Technology Law (A+)

Honors and Awards

  • NSF/ASEE Small Business Postdoctoral Research Fellowship, 2011

  • Quality Reviewer, IEEE Int. Conf. Multimedia Expo (ICME), 2011

  • UMD Distinguished Teaching Assistant, 2007, 2011

  • ECEGSA Best Student Speaker, 2010 (awarded to two ECE graduate students)

  • ECE TA Training and Development Fellow, 2010

  • ECE Graduate Student Service Award, 2008 (awarded to one ECE graduate student)

  • UMD Graduate Student Summer Research Fellowship, 2008 (awarded to fifty-six UMD graduate students)

  • Lilly Conference Travel Grant, 2008

  • UMD Future Faculty Fellow, 2008 (awarded to twenty UMD engineering graduate students)

  • ECE George Corcoran Memorial Award, 2007 (awarded to one ECE graduate student)

  • UMD Dept. of Resident Life Community Assistant of the Year, 2002

  • UMD Presidential Scholarship, 2000

  • ECE Departmental Scholarship, 2000

  • Edward J. Bloustein Distinguished Scholar, New Jersey, 2000

  • New Jersey Governor’s School of the Arts, 1999

  • MENC All-Eastern Orchestra, Carnegie Hall, New York, 1999

Internships

Intern, Satellite Management Systems

Intelsat  ⋅  Washington, DC  ⋅  6/2004–8/2004

  • Performed software tests on telemetry and flight dynamic commanding for Loral Ground Network Systems integration. Assisted with maintenance of software documentation.

Intern, Satellite Engineering

Intelsat  ⋅  Washington, DC  ⋅  6/2002–11/2002

  • Performed software and database testing for the IS-X satellite series. Revised acceptance test plans and software requirement specifications.

Miscellaneous

  • Born in New Jersey, USA. USA citizen.

  • Violinist with the San Francisco Civic Symphony (9/2012–present). Concertmaster since 11/2014.

  • Studied violin under John Chisholm (San Francisco Symphony, Eastman), Dr. James Stern (U. Maryland, Juilliard), and Ms. Ayako Hosoi (retired, New Jersey SO, Curtis).