Issues with PSI.bot Service Sample Code: Delays, Recording Problems, and User Experience Concerns

@Itay_Nadir - To address the issues you're encountering with the "PSI.bot service" sample code for real-time audio and video recording, here are some recommendations and potential solutions:

1. Bot Joining the Call

• Improving Join Reliability and Speed:
  • Ensure your bot has the necessary permissions and is configured correctly.
  • Optimize the bot's initialization sequence to reduce the time it takes to join calls.
  • Use the Microsoft Real-time Media Platform for handling media streams efficiently.
  • Implement proper error handling and retries in the bot's join logic to improve reliability.
• Invisible Participant:
  • As of now, the bot cannot join as an invisible participant due to platform limitations. The bot will appear as a participant in the call.

2. Recording Issues

• Starting Recording Promptly:
  • Make sure the bot's media initialization is done promptly after joining the call.
  • Investigate the bot's logs to identify any delays or errors occurring during the recording start process.
  • Ensure that the bot's media capabilities are fully initialized before starting the recording.
• Saving Video Directly as MP4:
  • Use a library or framework that supports direct encoding of video streams into MP4 format.
  • The Real-time Media Platform's API can help with handling media streams more efficiently.
    
    
• Associating Audio with Video:
  • Use a media processing library that can synchronize audio and video streams.
  • Ensure the media streams are properly synchronized before saving them.

3. Application Management

Adding the Bot to Meetings Easily:

• Implement a service that can automatically add the bot to meetings based on certain criteria or triggers.
• Utilize Graph API to manage the bot's participation in meetings programmatically.

Stabilizing Bot Behavior and Improving User Experience

• Error Handling and Logging:
  • Implement comprehensive error handling and logging to identify and resolve issues quickly.
  • Monitor the bot's performance and behavior in real-time to detect and address problems promptly.
• Testing and Optimization:
  • Continuously test the bot in various scenarios to ensure stability and reliability.
  • Optimize the bot's code and configuration to handle edge cases and improve performance.

By following these recommendations and leveraging the capabilities of the Real-time Media Platform and Graph API, you can improve the performance, reliability, and user experience of your bot service.

Doc References:

• Calls and online meetings bots - Terminologies
• Real-time media calls and meetings with Microsoft Teams - Real-time media calls and meetings with Microsoft Teams
• Custom Together Mode scenes in Teams