≡
profile photo

Jianyuan Ni

I am a final-year Ph.D. candidate in Computer Science at Texas State University (TXST) under the supervision of Prof. Anne H.H. Ngu. My research primarily centers on the development of innovative multi-modal systems to improve the performance of wearable sensor-based Human Activity Recognition (HAR) problems. Specifically, a key focus of my work is on evaluating the feasibility of knowledge transfer from multi-modal data to time series data, particularly on resource-constrained wearable devices. Additionally, I strive to facilitate the deployment of multi-modal systems among wearable devices through the application of generative adversarial networks, which play a pivotal role in creating these systems for improved recognition capabilities.

Email  /  Google Scholar  /  GitHub

News

05-2021: One IoT edge computing using Cordova accessor host paper has been accepted to IoT Journal. 👏 👏 👏 👏

08-2021: Recruit and collect nine senior participants' ADL data in Summer 2021. Dataset is avaliable here.

01-2022: One Crossmodal KD paper has been accepted to ICASSP 2022. 👏 👏 👏 👏

07-2022: One Progressive KD paper has been accepted to ACM MM 2022. 👏 👏 👏 👏

08-2022: Recruit and collect twelve participants' ADL and fall data in Summer 2022. Dataset is avaliable here.

10/2022: Selected and excited to present my Progressive KD work at NSF-NIH SCH PI Meeting.

01-2023: One Transfer Learning for fall detection paper has been accepted to the Sensors journal. 👏 👏 👏 👏

12-2023: One Adaptive Cross-architecture Mutual KD paper has been accepted to FG 2024. 👏 👏 👏 👏

Publication

  • Self-Distillation of Spiking Neural Network for Human Action Recognition
    Jianyuan Ni, Hao Tang, Yan Yan
    Under Review 2023 paper

  • Physical-aware Cross-modal Adversarial Network for Wearable Sensor-based Human Action Recognition
    Jianyuan Ni, Hao Tang, Yan Yan
    Under Review 2023 paper

  • Introducing Inductive Bias to Self-Distillation
    Jianyuan Ni, Hao Tang, Yan Yan
    Under Review 2023 paper

  • Adaptive Cross-architecture Mutual Knowledge Distillation
    Jianyuan Ni, Hao Tang, Yan Yan
    Accepted to FG 2024 paper

  • Progressive Cross-modal Knowledge Distillation for Human Action Recognition
    Jianyuan Ni, Anne H.H. Ngu, Yan Yan
    ACM MM 2022 paper

  • Cross-modal knowledge distillation for Vision-to-Sensor action recognition
    Jianyuan Ni, Raunak Sarbajna, Yang Liu, Anne H.H. Ngu, Yan Yan
    ICASSP 2022 | paper code

  • Transfer Learning On Small Datasets for Improved Fall Detection
    Nader Maray, Anne H.H. Ngu, Jianyuan Ni, Minakshi Debnath, and Lu Wang
    Sensors 2023 paper dataset

  • An IoT Edge Computing Framework Using Cordova Accessor Host
    Anne H.H. Ngu, Jesuloluwa S. Eyitayo, Guowei Yang, Colin Campbell, Quan Z.Sheng, Jianyuan Ni
    IoT 2021 | paper

    • Teaching

  • Instructor: CS1342: Programming for Scientists & Engineers, Spring 2024, TXST.

  • Instructor: CS1342: Programming for Scientists & Engineers, Fall 2023, TXST. (Student Evaluation Result)

  • Instructor: CS1342: Programming for Scientists & Engineers, Spring 2023, TXST. (Student Evaluation Result)

  • Teaching Assistant: CS4328: Operating Systems, Fall 2020 -- Fall 2022, TXST.

    • Awards

  • Faculty Innovation Accelerator Program Scholarship, 2023, TXST

  • Computer Science Scholarship, 2023, TXST

  • New Venture Scholarship, 2022, TXST

  • Merrick Merit Fellowship, 2021, TXST

    • Service

  • Program Committee for the 10th IEEE International Conference on Data Science and Advance Analytics (DSAA-2023). DSAA Ranking: A (Source: CORE2021)

  • External Reviewer for multiple international journals and conferences such as TAFFC, TIP, TMM, TOMM, TNNLS, CVIU, TMI, TKDE, TCSVT, TETCI, CYB-E, Neurocomputing, ACM MM and etc.