Few-Shot Lip-Password Based Speaker Verification

Lip-password has provided a promising solution for speaker verification (Liu and Cheung 2014). Despite the potential of this technology, there are few related studies, largely attributed to the lack of corresponding public datasets. Furthermore, previous works in this field generally demand a substantial amount of training samples and negative samples, impeding their applications from a practical perspective. Therefore, this paper collects a lip-password dataset and proposes a novel few-shot lip-password based speaker verification model, which can be effectively deployed in real-world scenarios because only a small number of data are required for training. Specifically, with an analysis of lip-password features, a down-sampling strategy is presented to generate more training samples. To compensate for the information loss caused by this strategy, a few-shot model, consisting of global and local models, is designed to simultaneously verify the global and local information of the lip-password. Speaker identity is verified only if both stages are passed. The efficacy of the proposed method is demonstrated using the newly collected dataset.

Download paper here

@inproceedings{HuZK23LipPassword,
  author={Hu, Zhikai and Cheung, Yiu-Ming and Li, Mengke and Lan, Weichao},
  booktitle={2023 IEEE International Conference on Image Processing (ICIP)}, 
  title={Few-Shot Lip-Password Based Speaker Verification}, 
  year={2023},
  volume={},
  number={},
  pages={1960-1964},
  keywords={Training;Image processing;Data models;Lip-password;speaker verification},
  doi={10.1109/ICIP49359.2023.10221963}}

Recommended citation: HZ. Hu, Y. -M. Cheung, M. Li and W. Lan, "Few-Shot Lip-Password Based Speaker Verification," <\i>2023 IEEE International Conference on Image Processing (ICIP)<\i>, Kuala Lumpur, Malaysia, 2023, pp. 1960-1964, doi: 10.1109/ICIP49359.2023.10221963. https://www.comp.hkbu.edu.hk/~ymc/papers/conference/ICIP23-publication-version.pdf