LOGO
LoginSign up
Guide for authors
Published on: 2026-09-29
From: Journal of Intelligent and Connected Vehicles

On-Board Pedestrian Crossing Intention Prediction for Intelligent Vehicles: Deployment, Optimization, and Evaluation

Yancheng Ling, Lin Zhao, Abbas Carayol, Mikael Nybacka, Zhenliang Ma

This paper presents an end-to-end approach for deploying and evaluating pedestrian crossing intention prediction on an on-board embedded computing platform. The proposed pipeline integrates YOLO11s for pedestrian detection, DeepSORT for identity tracking, RTMPose-s for pose estimation, an identity-aware temporal buffer, and PedAST-GCN for crossing intention prediction. We optimize the pipeline using ONNX Runtime and TensorRT and deploy it on an NVIDIA Jetson AGX Orin installed in KTH’s Research Concept Vehicle E. In addition, we introduce an offline LLM-based evaluation framework that automatically annotates pedestrian crossing states from real-world tracking videos and evaluates whether the system can anticipate crossing behavior one to two seconds in advance. Experiments conducted at the Gillinge test track demonstrate reliable prediction performance and real-time inference at approximately 16.6 FPS. This replication package provides the source code and documentation required to reproduce the deployment, optimization, and evaluation procedures reported in the paper.

Automated vehicleAutonomous driving
DOI: 10.26599/ETSD.2026.9190090
CSTR: 32009.11.ETSD.2026.9190090
Category: Road transport data (passenger), Computer vision data
Data Type: Image/video data
Europe, Sweden, Solna Download ZIP (130.10 MB)
Data and Code Disclosure and Sharing Policy
Cite this dataset
Yancheng Ling, Lin Zhao, Abbas Carayol, et al. On-Board Pedestrian Crossing Intention Prediction for Intelligent Vehicles: Deployment, Optimization, and Evaluation. ETS-Data, 2026. https://doi.org/10.26599/ETSD.2026.9190090
Yancheng Ling, Lin Zhao, Abbas Carayol, et al. On-Board Pedestrian Crossing Intention Prediction for Intelligent Vehicles: Deployment, Optimization, and Evaluation. ETS-Data, 2026. https://cstr.cn/32009.11.ETSD.2026.9190090
The source codes and replication package130.08 MB
Funding information

This work was in part financially supported by Digital Futures.