About Me

I create smart machines that free people from boring tasks and enable them to do what they are most good at. For the past ten years, I built machines that can sense, think, and act, in places like factories, farms, and homes. I combined my expertise in multiple fields to create these smart machines. My expertise is in the fields of machine vision, machine learning, Internet-of-Things, embedded systems, and mechatronics.

Professional Profile

  • Commercial product development, from prototyping to mass production.
  • Optimization of computer vision and machine learning algorithms on custom hardware.
  • Internet-of-things devices, edge and cloud platforms for machine learning applications.
  • Implementation of electronics systems, from chip design to firmware/software stack.
  • Integration of electronics systems into mechatronics and robotics systems.

Download Resume

Experience

  • July 2020
    -
    Current

    ams OSRAM

    Machine Vision Consultant via TMC

    Design algorithms and demonstrators for smart image sensor. Design hardware-friendly HDR algorithms. Analyze AR/VR applications and machine learning models on resource-constrained platform. Modeling of camera systems. Develop Linux kernel space driver for image sensors.

  • July 2020
    -
    Current

    TMC

    Machine Vision Expert

    Help clients create innovative machine vision systems.

  • Sep 2019
    -
    May 2020

    CASPAR.AI

    Hardware and Software Engineer

    Bring up smart home device prototypes. Build edge computing platforms supporting deep learning applications in vision domain. Build an intelligent operating system for homes.

  • July 2016
    -
    Aug 2019

    Connecterra

    Hardware and Devices Engineer

    Commercial product development, from prototyping to mass production. Electronics, firmware, and software for wireless Internet-of-things devices. Optimization of neural network for motion analysis on battery-powered devices. Edge computing platform supporting deep learning applications. Building the technology behind IDA.

  • Aug 2014
    -
    June 2016

    Intel

    Firmware Engineer

    Implementation of firmware stack for Intel Image Signal Processors (ISP), used in various products including Intel Atom E3900 Series.

  • April 2014
    -
    July 2014

    Delft University of Technology

    Researcher on Embedded Vision

    Implementation of a proprietary computer vision algorithm on field-programmable gate arrays (FPGAs) in 4 months.

  • Sep 2009
    -
    March 2014

    Eindhoven University of Technology

    PhD Researcher on Embedded Vision Architecture

    Design and implementation of high-speed vision processing systems on field-programmable gate arrays (FPGAs), and high-speed high-precision vision-in-the-loop mechatronic systems.

Education

  • 2009
    -
    2020

    Eindhoven University of Technology

    PhD Degree in Mechanical Engineering

    Design, implementation, and modeling of high-speed and high-precision vision-in-the-loop mechatronic systems. Thesis defended on 26 May 2020.

  • 2006
    -
    2009

    Eindhoven University of Technology

    Master Degree in Embedded System

    Thesis on graphics processing units (GPUs) architecture and code optimization.

  • 2002
    -
    2006

    Harbin Institute of Technology

    Bachelor Degree in Electronic Engineering

    With half-year exchange to Hong Kong University of Science and Technology

Research

PhD Project: Embedded Vision Architecture

In this project, I have implemented an FPGA-based vision system, integrated it into a motion stage, and performed the modeling and control of the visual servo system. Experimental results demonstrate the feasibility of using visual feedback for precision motion control. Below is a demo of the 1000 frames-per-second vision-in-the-loop system. Results of this project have been presented in ICT.OPEN.2012 (slides).

PhD Thesis: Implementation, Modeling, and Exploration of Precision Visual Servo Systems

In this thesis, methods are provided to design high-speed vision systems, to evaluate delay and accuracy of vision algorithms, to design control laws that compensate for these constraints, and to find out among a large number of design options which is most suitable for a specific use case. This thesis is defended on 26 May 2020.

Publications

  • Gernot Fiala, Zhenyu Ye, Christian Steger, "Framework for Image Sensor Design Parameter Optimization for Pupil Detection", in International Conference on Systems and Informatics (ICSAI) 2022. (preprint, doi)
  • Gernot Fiala, Zhenyu Ye, Christian Steger, "Pupil Detection for Augmented and Virtual Reality based on Images with Reduced Bit Depths", in IEEE Sensors Applications Symposium (SAS) 2022. (preprint, doi)
  • Zhenyu Ye, Henk Corporaal, Pieter Jonker, Henk Nijmeijer, "Cross-domain Modeling and Optimization of High-speed Visual Servo Systems", in 15th International Conference on Control, Automation, Robotics and Vision (ICARCV) 2018. (preprint, slides.pdf, slides.pptx, doi)
  • Roel Pieters, Zhenyu Ye, Pieter Jonker, Henk Nijmeijer, "Direct Motion Planning for Vision-Based Control", in IEEE Transactions on Automation Science and Engineering Oct. 2014. (preprint, doi)
  • Zhenyu Ye, Pieter Jonker, Henk Corporaal, Henk Nijmeijer, "High-Level Synthesis of Massively Parallel Vision Architectures for 100000 Frames-per-Second Visual Servo Control", in ICT.OPEN 2013. (poster)
  • Zhenyu Ye, Pieter Jonker, Henk Corporaal, Henk Nijmeijer, "Closed-Loop Evaluation of an Embedded Visual Servo System", in ICT.OPEN 2012. (presentation, poster)
  • Zhenyu Ye, Henk Corporaal, Pieter Jonker, "PhD Forum: A Cyber-Physical System Approach To Embedded Visual Servoing", in ACM/IEEE International Conference on Distributed Smart Cameras (ICDSC) 2011. (doi, preprint, bibtex, review)
  • Zhenyu Ye, Yifan He, Roel Pieters, Bart Mesman, Henk Corporaal, Pieter Jonker, "Demo: An Embedded Vision System for High Frame Rate Visual Servoing", in ACM/IEEE International Conference on Distributed Smart Cameras (ICDSC) 2011. (doi, preprint, bibtex,review, videos)
  • Yifan He, Zhenyu Ye, Dongrui She, Bart Mesman, Henk Corporaal, "Feasibility Analysis of Ultra High Frame Rate Visual Servoing on FPGA and SIMD Processor", in Advanced Concepts for Intelligent Vision Systems (ACIVS) 2011. (preprint, bibtex)
  • Zhenyu Ye, Yifan He, Roel Pieters, Bart Mesman, Henk Corporaal, Pieter Jonker, "Bottlenecks and Tradeoffs in High Frame Rate Visual Servoing: A Case Study", in IAPR Conference on Machine Vision Applications (MVA) 2011. (preprint, poster, bibtex, review)
  • Yu Pu, Yifan He, Zhenyu Ye, Sebastian Moreno Londono, Anteneh Alemu Abbo, Richard Kleihorst, Henk Corporaal, "From Xetal-II to Xetal-Pro: On the Road Towards An Ultra Low-Energy and High Throughput SIMD Processor", in IEEE Transactions on Circuits and Systems for Video Technology (TCSVT) April 2011. (preprint, doi)
  • Yifan He, Yu Pu, Zhenyu Ye, Sebastian M. Moreno, Richard Kleihorst, Anteneh A. Abbo, Henk Corporaal, "Xetal-Pro: An Ultra-low Energy and High Throughput SIMD Processor", in Design Automation Conference (DAC) 2010. (preprint, doi) (HiPEAC Paper Award)
  • Zhenyu Ye, "Design Space Exploration for GPU-Based Architecture", Master thesis, TU Eindhoven, 2009. (preprint, archived record)

Teaching

Contact

zhenyu.z.ye@gmail.com

Amstelveen, Netherlands