The technology of speech emotion recognition (SER) has been widely applied in the field of human-computer interaction within the Internet of Vehicles (IoV). The incorporation of emerging technologies such as artificial intelligence and big data has accelerated the advancement of SER technology. However, this reveals challenges such as limited computational resources, data processing inefficiency, and security and privacy concerns. In recent years, quantum machine learning has been applied to the field of intelligent transportation, which has demonstrated its various advantages, including high prediction accuracy, robust noise resistance, and strong security. This study first integrates quantum federated learning (QFL) into 5G IoV using a quantum minimal gated unit (QMGU) recurrent neural network for local training. Then, it proposes a novel quantum federated learning algorithm, QFSM, to further enhance computational efficiency and privacy protection. Experimental results demonstrate that compared to existing algorithms using quantum long short-term memory network or quantum gated recurrent unit models, the QFSM algorithm has a higher recognition accuracy and faster training convergence rate. It also performs better in terms of privacy protection and noise robustness, enhancing its applicability and practicality. © IEEE