why takes it so long before the TAP IP can be used when switching from BYOD mode to appliance mode?

Hi,
We have several Rally Bars with TAP IPs in our building. They work well (Microsoft Teams Room), only switching form BYOD mode to appliance mode takes a long time before the TAP IP is paired again with the Rally Bar.
It happens many times that people insert the USB cable accidentally , even when there is a Teams meeting and BYOD mode is not needed.
But then the TAP IP has lost its connection already with the Rally Bar, and after pulling out the USB cable from the laptop , it can take sometimes 5 minutes before the TAP IP is usable again (paired with the Rally Bar).
Can this time be shortened somehow ?
The TAP IPs are enrolled with the same MS365 account as the Rally Bar. But is takes sometimes too long before the TAP IP is usanle again.
Both the Rally Bar and TAP IP are running the latest firmware.