Brain-inspired LabPeking University

Publications

We primarily publish our research in the relevant IEEE Transactions titles.

Most of our recent work should be accessible on an Open Access basis. However, if you cannot locate a specific manuscript online, please feel free to contact us.

2024

SpikingResformer: bridging ResNet and vision transformer in spiking neural networks  (2024)  ·  X Shi, Z Hao, Z Yu  ·  Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern …, 2024
Revealing the mechanisms of semantic satiation with deep learning models  (2024)  ·  X Zhang, J Lian, …, J Liu, JK Liu  ·  Communications Biology 7 (1), 487, 2024
Optical flow for spike camera with hierarchical spatial-temporal spike fusion  (2024)  ·  R Zhao, R Xiong, …, Z Yu, T Huang  ·  Proceedings of the AAAI Conference on Artificial Intelligence 38 (7), 7496-7504, 2024
Robust stable spiking neural networks  (2024)  ·  J Ding, Z Pan, …, Z Yu, T Huang  ·  arXiv preprint arXiv:2405.20694, 2024
Super-resolution reconstruction from Bayer-pattern spike streams  (2024)  ·  Y Dong, R Xiong, …, S Zhu, T Huang  ·  Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern …, 2024
LM-HT SNN: Enhancing the performance of SNN to ANN counterpart through learnable multi-hierarchical threshold model  (2024)  ·  Z Hao, X Shi, …, Z Yu, T Huang  ·  arXiv preprint arXiv:2402.00411, 2024
Converting artificial neural networks to ultra-low-latency spiking neural networks for action recognition  (2024)  ·  H You, X Zhong, …, Z Yu, T Huang  ·  IEEE Transactions on Cognitive and Developmental Systems, 2024
Spikereveal: Unlocking temporal sequences from real blurry inputs with spike streams  (2024)  ·  K Chen, S Chen, …, T Huang, Z Yu  ·  Advances in Neural Information Processing Systems 37, 62673-62696, 2024
Boosting spike camera image reconstruction from a perspective of dealing with spike fluctuations  (2024)  ·  R Zhao, R Xiong, …, Z Yu, T Huang  ·  Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern …, 2024
Threaten spiking neural networks through combining rate and temporal information  (2024)  ·  Z Hao, T Bu, …, Z Yu, T Huang  ·  The Twelfth International Conference on Learning Representations, 2024
Towards High-performance Spiking Transformers from ANN to SNN Conversion  (2024)  ·  Z Huang, X Shi, …, Z Yu, T Huang  ·  ACM Multimedia 2024, 2024
One forward is enough for neural network training via likelihood ratio method  (2024)  ·  J Jiang, Z Zhang, …, Z Yu, Y Peng  ·  The Twelfth International Conference on Learning Representations, 2024
Enhancing the robustness of spiking neural networks with stochastic gating mechanisms  (2024)  ·  J Ding, Z Yu, T Huang, JK Liu  ·  Proceedings of the AAAI Conference on Artificial Intelligence 38 (1), 492-502, 2024
Online stabilization of spiking neural networks  (2024)  ·  Y Zhu, J Ding, …, X Xie, Z Yu  ·  The Twelfth International Conference on Learning Representations, 2024
A progressive training framework for spiking neural networks with learnable multi-hierarchical model  (2024)  ·  Z Hao, X Shi, …, Z Yu, T Huang  ·  The Twelfth International Conference on Learning Representations, 2024
Robust decoding of rich dynamical visual scenes with retinal spikes  (2024)  ·  Z Yu, T Bu, …, T Huang, JK Liu  ·  IEEE Transactions on Neural Networks and Learning Systems, 2024
Brain-inspired artificial intelligence research: A review  (2024)  ·  GY Wang, HN Bao, …, CW Lu, …  ·  Science China Technological Sciences 67 (8), 2282-2296, 2024
Exploring efficient asymmetric blind-spots for self-supervised denoising in real-world scenarios  (2024)  ·  S Chen, J Zhang, Z Yu, T Huang  ·  Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern …, 2024
Assessment of visual function in blind mice and monkeys with subretinally implanted nanowire arrays as artificial photoreceptors  (2024)  ·  R Yang, P Zhao, …, M Shen, …  ·  Nature Biomedical Engineering 8 (8), 1018-1039, 2024
Towards energy efficient spiking neural networks: An unstructured pruning framework  (2024)  ·  X Shi, J Ding, Z Hao, Z Yu  ·  The Twelfth International Conference on Learning Representations, 2024
Spikegs: 3d gaussian splatting from spike streams with high-speed camera motion  (2024)  ·  J Zhang, K Chen, …, T Huang, Z Yu  ·  Proceedings of the 32nd ACM International Conference on Multimedia, 9194-9203, 2024

2023

Spikingjelly: An open-source machine learning infrastructure platform for spike-based intelligence  (2023)  ·  W Fang, Y Chen, …, H Zhou, …  ·  Science Advances 9 (40), eadi1480, 2023
SpikeCV: open a continuous computer vision era  (2023)  ·  Y Zheng, J Zhang, …, Z Yu, T Huang  ·  arXiv preprint arXiv:2303.11684, 2023
Unsupervised optical flow estimation with dynamic timing representation for spike camera  (2023)  ·  L Xia, Z Ding, …, T Huang, R Xiong  ·  Advances in Neural Information Processing Systems 36, 2023
SpiReco: Fast and efficient recognition of high-speed moving objects with spike cameras  (2023)  ·  J Zhao, S Zhang, Z Yu, T Huang  ·  IEEE Transactions on Circuits and Systems for Video Technology, 2023
Spike camera image reconstruction using deep spiking neural networks  (2023)  ·  R Zhao, R Xiong, …, L Ma, T Huang  ·  IEEE Transactions on Circuits and Systems for Video Technology 34 (6), 5207-5212, 2023
Enhancing motion deblurring in high-speed scenes with spike streams  (2023)  ·  S Chen, J Zhang, …, T Huang, Z Yu  ·  Advances in Neural Information Processing Systems 36, 2023
Self-supervised joint dynamic scene reconstruction and optical flow estimation for spiking camera  (2023)  ·  S Chen, Z Yu, T Huang  ·  Proceedings of the AAAI Conference on Artificial Intelligence 37 (1), 350-358, 2023
Learning temporal-ordered representation for spike streams based on discrete wavelet transforms  (2023)  ·  J Zhang, S Jia, Z Yu, T Huang  ·  Proceedings of the AAAI Conference on Artificial Intelligence 37 (1), 137-147, 2023
Exploring loss functions for time-based training strategy in spiking neural networks  (2023)  ·  Y Zhu, W Fang, …, T Huang, Z Yu  ·  Advances in Neural Information Processing Systems 36, 2023
Rate gradient approximation attack threats deep spiking neural networks  (2023)  ·  T Bu, J Ding, Z Hao, Z Yu  ·  Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern …, 2023
Capture the moment: High-speed imaging with spiking cameras through short-term plasticity  (2023)  ·  Y Zheng, L Zheng, …, T Huang, S Wang  ·  IEEE Transactions on Pattern Analysis and Machine Intelligence 45 (7), 8127-8142, 2023
A unified framework for soft threshold pruning  (2023)  ·  Y Chen, Z Ma, …, Z Yu, Y Tian  ·  The Eleventh International Conference on Learning Representations, 2023
Meta reinforcement learning for multi-task offloading in vehicular edge computing  (2023)  ·  P Dai, Y Huang, …, H Xing, Z Yu  ·  IEEE Transactions on Mobile Computing 23 (3), 2123-2138, 2023
Bridging the Gap between ANNs and SNNs by Calibrating Offset Spikes  (2023)  ·  Z Hao, J Ding, …, T Huang, Z Yu  ·  The Eleventh International Conference on Learning Representations, 2023
Parallel spiking neurons with high efficiency and ability to learn long-term dependencies  (2023)  ·  W Fang, Z Yu, …, T Masquelier, Y Tian  ·  Advances in Neural Information Processing Systems 36, 2023
Reducing ANN-SNN Conversion Error through Residual Membrane Potential  (2023)  ·  Z Hao, T Bu, …, T Huang, Z Yu  ·  The Thirty-Seventh AAAI Conference on Artificial Intelligence 37 (1), 11-21, 2023
1000× faster camera and machine vision with ordinary devices  (2023)  ·  T Huang, Y Zheng, …, S Dong, …  ·  Engineering 25, 110-119, 2023
Optimal ANN-SNN conversion for high-accuracy and ultra-low-latency spiking neural networks  (2023)  ·  T Bu, W Fang, …, Z Yu, T Huang  ·  arXiv preprint arXiv:2303.04347, 2023
Complementary intrinsics from neural radiance fields and CNNs for outdoor scene relighting  (2023)  ·  S Yang, X Cui, …, Z Yu, B Shi  ·  Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern …, 2023

2022

Temporal Effective Batch Normalization in Spiking Neural Networks  (2022)  ·  C Duan, J Ding, …, Z Yu, T Huang  ·  Advances in Neural Information Processing Systems, 2022
Representing the dynamics of high-dimensional data with non-redundant wavelets  (2022)  ·  S Jia, X Li, …, JK Liu, Z Yu  ·  Patterns 3 (3), 2022
Decoding pixel-level image features from two-photon calcium signals of macaque visual cortex  (2022)  ·  Y Zhang, T Bu, …, JK Liu, T Huang  ·  Neural Computation 34 (6), 1369-1397, 2022
Spikingsim: A bio-inspired spiking simulator  (2022)  ·  J Zhao, S Zhang, …, Z Yu, T Huang  ·  2022 IEEE International Symposium on Circuits and Systems (ISCAS), 3003-3007, 2022
Structure inference of networked system with the synergy of deep residual network and fully connected layer network  (2022)  ·  K Huang, S Li, …, Z Yu, L Ma  ·  Neural networks 145, 288-299, 2022
Neural decoding of visual information across different neural recording modalities and approaches  (2022)  ·  YJ Zhang, ZF Yu, JK Liu, TJ Huang  ·  Machine Intelligence Research 19 (5), 350-365, 2022
Deep spike learning with local classifiers  (2022)  ·  C Ma, R Yan, Z Yu, Q Yu  ·  IEEE Transactions on Cybernetics 53 (5), 3363-3375, 2022
Learning Optical Flow from Continuous Spike Streams  (2022)  ·  R Zhao, R Xiong, …, X Fan, T Huang  ·  Advances in Neural Information Processing Systems, 2022
SNN-RAT: Robustness-enhanced Spiking Neural Network through Regularized Adversarial Training  (2022)  ·  J Ding, T Bu, …, T Huang, JK Liu  ·  Advances in Neural Information Processing Systems, 2022
Spike-based motion estimation for object tracking through bio-inspired unsupervised learning  (2022)  ·  Y Zheng, Z Yu, S Wang, T Huang  ·  IEEE Transactions on Image Processing 32, 335-349, 2022
State transition of dendritic spines improves learning of sparse spiking neural networks  (2022)  ·  Y Chen, Z Yu, …, T Huang, Y Tian  ·  International Conference on Machine Learning, 3701-3715, 2022
Training spiking neural networks with event-driven backpropagation  (2022)  ·  Y Zhu, Z Yu, …, T Huang, T Masquelier  ·  Advances in Neural Information Processing Systems 35, 30528-30541, 2022
Spike transformer: Monocular depth estimation for spiking camera  (2022)  ·  J Zhang, L Tang, …, J Lu, T Huang  ·  European Conference on Computer Vision, 34-52, 2022
Spatio-temporal recurrent networks for event-based optical flow estimation  (2022)  ·  Z Ding, R Zhao, …, Z Yu, T Huang  ·  Proceedings of the AAAI conference on artificial intelligence 36 (1), 525-533, 2022
Optimized potential initialization for low-latency spiking neural networks  (2022)  ·  T Bu, J Ding, Z Yu, T Huang  ·  Proceedings of the AAAI conference on artificial intelligence 36 (1), 11-20, 2022
Modeling the detection capability of high-speed spiking cameras  (2022)  ·  J Zhao, Z Yu, …, Y Tian, T Huang  ·  ICASSP 2022-2022 IEEE International Conference on Acoustics, Speech and …, 2022

2021

Incorporating learnable membrane time constant to enhance learning of spiking neural networks  (2021)  ·  W Fang, Z Yu, …, T Huang, Y Tian  ·  Proceedings of the IEEE/CVF international conference on computer vision …, 2021
Asynchronous spatiotemporal spike metric for event cameras  (2021)  ·  J Li, Y Fu, …, T Huang, Y Tian  ·  IEEE Transactions on Neural Networks and Learning Systems 34 (4), 1742-1753, 2021
Neural system identification with spike-triggered non-negative matrix factorization  (2021)  ·  S Jia, Z Yu, …, T Huang, JK Liu  ·  IEEE Transactions on Cybernetics 52 (6), 4772-4783, 2021
Super resolve dynamic scene from continuous spike streams  (2021)  ·  J Zhao, J Xie, …, Z Yu, T Huang  ·  Proceedings of the IEEE/CVF International Conference on Computer Vision …, 2021
Reconstructing clear image for high-speed motion scene with a retina-inspired spike camera  (2021)  ·  J Zhao, R Xiong, …, W Gao, T Huang  ·  IEEE Transactions on Computational Imaging 8, 12-27, 2021
Unraveling neural coding of dynamic natural visual scenes via convolutional recurrent neural networks  (2021)  ·  Y Zheng, S Jia, …, JK Liu, T Huang  ·  Patterns 2 (10), 2021
High-speed image reconstruction through short-term plasticity for spiking cameras  (2021)  ·  Y Zheng, L Zheng, …, Y Tian, T Huang  ·  Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern …, 2021
Pruning of deep spiking neural networks through gradient rewiring  (2021)  ·  Y Chen, Z Yu, …, T Huang, Y Tian  ·  arXiv preprint arXiv:2105.04916, 2021
A distributed algorithm for task offloading in vehicular networks with hybrid fog/cloud computing  (2021)  ·  Z Liu, P Dai, …, Z Yu, W Zhang  ·  IEEE Transactions on Systems, Man, and Cybernetics: Systems 52 (7), 4388-4401, 2021
Asynchronous deep reinforcement learning for data-driven task offloading in MEC-empowered vehicular networks  (2021)  ·  P Dai, K Hu, …, H Xing, Z Yu  ·  IEEE INFOCOM 2021-IEEE Conference on Computer Communications, 1-10, 2021
Optimal ANN-SNN conversion for fast and accurate inference in deep spiking neural networks  (2021)  ·  J Ding, Z Yu, Y Tian, T Huang  ·  arXiv preprint arXiv:2105.11654, 2021
Deep residual learning in spiking neural networks  (2021)  ·  W Fang, Z Yu, …, T Masquelier, Y Tian  ·  Advances in Neural Information Processing Systems 34, 21056-21069, 2021
Dissecting cascade computational components in spiking neural networks  (2021)  ·  S Jia, D Xing, Z Yu, JK Liu  ·  PLoS Computational Biology 17 (11), e1009640, 2021

2020

Spikingjelly  (2020)  ·  W Fang, Y Chen, …, H Zhou, Y Tian  ·  Multimedia Learn. Group, Inst. Digit. Media (NELVT), 2020
Intrinsic and synaptic properties shaping diverse behaviors of neural dynamics  (2020)  ·  L An, Y Tang, …, Z Yu, JK Liu  ·  Frontiers in Computational Neuroscience 14, 26, 2020
Probabilistic inference of binary Markov random fields in spiking neural networks through mean-field approximation  (2020)  ·  Y Zheng, S Jia, …, JK Liu, Y Tian  ·  Neural networks 126, 42-51, 2020
SDARE: A stacked denoising autoencoder method for game dynamics network structure reconstruction  (2020)  ·  K Huang, S Li, …, Z Wang, Z Yu  ·  Neural Networks 126, 143-152, 2020
Revealing fine structures of the retinal receptive field by deep-learning networks  (2020)  ·  Q Yan, Y Zheng, …, T Huang, JK Liu  ·  IEEE transactions on cybernetics 52 (1), 39-50, 2020
Toward the next generation of retinal neuroprosthesis: visual computation with spikes  (2020)  ·  Z Yu, JK Liu, …, Y Tian, T Huang  ·  Engineering 6 (4), 449-461, 2020
Reconstruction of natural visual scenes from neural spikes with deep neural networks  (2020)  ·  Y Zhang, S Jia, …, T Huang, JK Liu  ·  Neural Networks 125, 19-30, 2020
Multi-armed bandit learning for computation-intensive services in MEC-empowered vehicular networks  (2020)  ·  P Dai, Z Hang, …, Z Yu, VCS Lee  ·  IEEE Transactions on Vehicular Technology 69 (7), 7821-7834, 2020
A probabilistic approach for cooperative computation offloading in MEC-assisted vehicular networks  (2020)  ·  P Dai, K Hu, …, F Teng, Z Yu  ·  IEEE Transactions on Intelligent Transportation Systems 23 (2), 899-911, 2020
Network structure reconstruction with symmetry constraint  (2020)  ·  Z Hang, P Dai, S Jia, Z Yu  ·  Chaos, Solitons & Fractals 139, 110287, 2020

2019

Sampling-Tree model: efficient implementation of distributed bayesian inference in neural networks  (2019)  ·  Z Yu, F Chen, JK Liu  ·  IEEE Transactions on Cognitive and Developmental Systems 12 (3), 497-510, 2019
A learning algorithm for real-time service in vehicular networks with mobile-edge computing  (2019)  ·  P Dai, K Liu, …, Z Yu, VCS Lee  ·  ICC 2019-2019 IEEE International Conference On Communications (ICC), 1-6, 2019
A unified neural circuit of causal inference and multisensory integration  (2019)  ·  Y Fang, Z Yu, JK Liu, F Chen  ·  Neurocomputing 358, 355-368, 2019
Event-based vision enhanced: A joint detection framework in autonomous driving  (2019)  ·  J Li, S Dong, …, Y Tian, T Huang  ·  2019 ieee international conference on multimedia and expo (icme), 1396-1401, 2019

2018

Design and implementation of a noncontact sleep monitoring system using infrared cameras and motion sensor  (2018)  ·  F Deng, J Dong, …, J Liu, F Chen  ·  IEEE Transactions on Instrumentation and Measurement 67 (7), 1555-1563, 2018
Promote of cooperation in networked multiagent system based on fitness control  (2018)  ·  W Deng, K Huang, …, H Zhu, Z Yu  ·  Applied Mathematics and Computation 339, 805-811, 2018
Implementation of bayesian inference in distributed neural networks  (2018)  ·  Z Yu, T Huang, JK Liu  ·  2018 26th euromicro international conference on parallel, distributed and …, 2018
Reaction–diffusion equation based image restoration  (2018)  ·  X Zhao, K Huang, …, Q Gao, Z Yu  ·  Applied Mathematics and Computation 338, 588-606, 2018
Evaluating the effect on demodulation with a comprehensive model of distortions of fiber Bragg grating sensing signals  (2018)  ·  W Zhang, X Lei, …, B Shao, W Chen  ·  Journal of Lightwave Technology 36 (24), 5823-5832, 2018
Emergent inference of hidden Markov models in spiking neural networks through winner-take-all  (2018)  ·  Z Yu, S Guo, …, JK Liu, F Chen  ·  IEEE Transactions on Cybernetics 50 (3), 1347-1354, 2018
Cooperative temporal data dissemination in SDN-based heterogeneous vehicular networks  (2018)  ·  P Dai, K Liu, …, H Xing, VCS Lee  ·  IEEE Internet of Things Journal 6 (1), 72-83, 2018
Heterogeneous cooperative belief for social dilemma in multi-agent system  (2018)  ·  K Huang, X Chen, …, C Yang, W Gui  ·  Applied Mathematics and Computation 320, 572-579, 2018
Unification of MAP estimation and marginal inference in recurrent neural networks  (2018)  ·  Z Yu, F Chen, F Deng  ·  IEEE Transactions on Neural Networks and Learning Systems 29 (11), 5761-5766, 2018

2017

Revealing structure components of the retina by deep learning networks  (2017)  ·  Q Yan, Z Yu, F Chen, JK Liu  ·  bioRxiv, 216010, 2017
Neural network implementation of inference on binary Markov random fields with probability coding  (2017)  ·  Z Yu, F Chen, J Dong  ·  Applied Mathematics and Computation 301, 193-200, 2017
Phase unwrapping with graph cuts optimization and dual decomposition acceleration for 3D high‐resolution MRI data  (2017)  ·  J Dong, F Chen, …, Z Yu, Y Wang  ·  Magnetic resonance in medicine 77 (3), 1353-1358, 2017
Hierarchical Bayesian inference and learning in spiking neural networks  (2017)  ·  S Guo, Z Yu, …, X Hu, F Chen  ·  IEEE transactions on cybernetics 49 (1), 133-145, 2017

2016

CaMKII activation supports reward-based neural network optimization through Hamiltonian sampling  (2016)  ·  Z Yu, D Kappel, …, F Chen, W Maass  ·  arXiv preprint arXiv:1606.00157, 2016
Sampling-based causal inference in cue combination and its neural implementation  (2016)  ·  Z Yu, F Chen, J Dong, Q Dai  ·  Neurocomputing 175, 155-165, 2016

2015

Efficient approximate linear programming for factored MDPs  (2015)  ·  F Chen, Q Cheng, …, G Wang, W Xu  ·  International Journal of Approximate Reasoning 63, 101-121, 2015

For a list of our research initiatives, visit our projects page.