Infosys Event AI: AWS-Powered Knowledge Accessibility

Unlocking Event Insights: How Infosys Leveraged AWS for Enhanced Accessibility

In today’s fast-paced world, capturing and efficiently utilizing knowledge from events and workshops is paramount for organizations across various sectors. Infosys Event AI is a solution designed to make event knowledge universally accessible, ensuring valuable insights are not lost and can be effectively used by individuals and organizations across diverse industries, both during and after the event.

The Challenge of Capturing and Accessing Event Knowledge

Traditional methods of capturing event knowledge often fall short, leading to significant challenges in accessing and utilizing valuable insights. These challenges include:

• Inadequate Capture Methods: Traditional note-taking is often incomplete and subjective, leading to the loss of critical information shared during events.
• Inefficient Review Process: Reviewing lengthy recordings to find specific information is time-consuming and inefficient, creating barriers to knowledge retention and sharing.
• Limited Access for Remote Participants: Individuals who miss events face significant obstacles accessing the knowledge shared, impacting sectors like education, media, and the public sector, where information recall is crucial.

To overcome these challenges, Infosys partnered with AWS to develop Infosys Event AI, a comprehensive solution designed to unlock the insights generated during events. This innovative platform leverages the power of AWS services to streamline live stream acquisition, process real-time transcriptions, index knowledge bases for efficient retrieval, generate automated session summaries, and provide an AI-powered chat assistant for interactive Q&A.

The Power of AWS Services

Infosys Event AI harnesses the power of several AWS services to deliver its core functionalities, including:

• AWS Elemental MediaLive: A video processing service that encodes live video streams, ensuring high-quality video delivery.
• AWS Elemental MediaConnect: A video transport service that builds live video workflows, enabling secure and reliable transport of video streams to the cloud.
• Amazon Bedrock: A fully managed service that offers a choice of industry-leading large language models (LLMs) to build generative AI applications, enhancing the platform’s ability to analyze and summarize event content.
• Amazon Nova Pro: A highly capable multimodal model that balances accuracy, speed, and cost, enabling multilingual translation of transcripts and providing global accessibility.

Core Functionalities of Infosys Event AI

Infosys Event AI delivers a range of core functionalities that enhance accessibility and streamline knowledge retrieval, including:

1. Seamless Live Stream Acquisition from On-Premises Sources: The platform enables seamless capture and transport of live video streams from on-premises sources to the cloud, ensuring high-quality video delivery.
2. Real-Time Transcription Processing for Speech-to-Text Conversion: The system leverages real-time transcription processing to convert speech to text, providing real-time accessibility for participants.
3. Post-Event Processing and Knowledge Base Indexing for Structured Information Retrieval: The platform automates post-event processing, indexing knowledge bases for seamless retrieval and ensuring that valuable insights are easily accessible.
4. Automated Generation of Session Summaries and Key Insights to Enhance Accessibility: The system automatically generates concise session summaries and key insights, helping users quickly understand the essence of the event without reviewing lengthy transcripts.
5. AI-Powered Chat-Based Assistant for Interactive Q&A and Efficient Knowledge Retrieval from the Event Session: The platform features an AI-powered chat assistant that enables interactive Q&A and efficient knowledge retrieval from the event session, providing users with immediate access to the information they need.

Seamless Live Stream Acquisition: A Detailed Look

The process of capturing and transporting live video streams from on-premises sources to the cloud is a crucial step in the Infosys Event AI workflow. This process ensures high-quality video delivery and enables real-time transcription and analysis.

The system utilizes the Secure Reliable Transport (SRT) protocol to securely and reliably transport the stream to the cloud through MediaConnect. The ingested stream is then received and processed by MediaLive, which encodes the video in real time and generates the necessary outputs.

The workflow follows these steps:

1. An IP-enabled camera or ground encoder converts non-IP streams into IP streams and transmits them through the SRT protocol to MediaConnect for live event ingestion.
2. MediaConnect securely transmits the stream to MediaLive for processing, ensuring high-quality video delivery.

Real-Time Transcription Processing: Unlocking Accessibility

Real-time transcription processing is a critical component of the Infosys Event AI solution, enabling real-time accessibility for participants. This process converts speech to text with minimal latency, providing a seamless and interactive experience.

To facilitate real-time accessibility, the system uses MediaLive to isolate audio from the live video stream. This audio-only stream is then forwarded to a real-time transcriber module, which is hosted on an Amazon Elastic Compute Cloud (Amazon EC2) instance. The real-time transcriber module uses the Amazon Transcribe stream API to generate transcriptions with minimal latency. These real-time transcriptions are subsequently delivered to an on-premises web client through secure WebSocket connections.

The workflow steps for this part of the solution follow these steps:

1. MediaLive extracts the audiofrom the live stream and creates an audio-only stream, which it then sends to the real-time transcriber module running on an EC2 instance. MediaLive also extracts the audio-only output and stores it in an Amazon Simple Storage Service (Amazon S3) bucket, facilitating a subsequent postprocessing workflow.
2. The real-time transcriber module receives the audio-only stream and employs the Amazon Transcribe stream API to produce real-time transcriptions with low latency, ensuring real-time accessibility.
3. The real-time transcriber module uses a secure WebSocket to transmit the transcribed text, providing a secure and reliable connection.
4. The on-premises web client receives the transcribed text through a secure WebSocket connection through Amazon CloudFront and displays it on the web client’s UI, providing users with immediate access to the transcribed text.

Post-Event Processing and Knowledge Base Indexing: Streamlining Information Retrieval

After the event concludes, recorded media and transcriptions are securely stored in Amazon S3 for further analysis. A serverless, event-driven workflow using Amazon EventBridge and AWS Lambda automates the post-event processing. Amazon Transcribe processes the recorded content to generate the final transcripts, which are then indexed and stored in an Amazon Bedrock knowledge base for seamless retrieval. Additionally, Amazon NovaPro enables multilingual translation of the transcripts, providing global accessibility when needed. With its quality and speed, Amazon Nova Pro is ideally suited for this global use case.

The workflow for this part of the process follows these steps:

1. After the event concludes, MediaLive sends a notification to EventBridge, triggering the post-event processing workflow.
2. A Lambda function, subscribed to the channel stopped event, triggers post-event transcription using Amazon Transcribe, ensuring that all recorded content is transcribed.
3. The transcribed content is processed and stored in an S3 bucket, providing a secure and reliable storage solution.
4. (Optional) Amazon Nova Pro translates transcripts into multiple languages for broader accessibility using Amazon Bedrock, enabling global access to event knowledge.
5. Amazon Transcribe generates a transcription complete event and sends it to EventBridge, triggering the synchronization process with Amazon Bedrock Knowledge Bases.
6. A Lambda function, subscribed to the transcription complete event, triggers the synchronization process with Amazon Bedrock Knowledge Bases, ensuring that the knowledge base is up-to-date.
7. The knowledge is then indexed and stored in Amazon Bedrock knowledge base for efficient retrieval, providing users with seamless access to the information they need.

Automated Generation of Session Summaries and Key Insights: Enhancing User Experience

To enhance user experience, the solution uses Amazon Bedrock to analyze the transcriptions to generate concise session summaries and key insights. These insights help users quickly understand the essence of the event without going through lengthy transcripts.

The workflow for this part of the solution follows these steps:

1. Users authenticate into the web client portal using Amazon Cognito. Once authenticated, the user selects an option in the portal UI to view the summaries and key insights.
2. The user request is delegated to the AI assistant module, where it fetches the complete transcript from the S3 bucket.
3. The transcript undergoes processing through Amazon Bedrock Pro, which is guided by Amazon Bedrock Guardrails, ensuring that the generated summaries and insights are accurate and reliable.

AI-Powered Chat-Based Assistant: Interactive Q&A and Knowledge Retrieval

A key feature of this architecture is an AI-powered chat assistant, which is used to interactively query the event knowledge base. The chat assistant is powered by Amazon Bedrock and retrieves information from the Amazon OpenSearch Serverless index, enabling seamless access to session insights.

The workflow for this part of the solution follows these steps:

1. Authenticated users engage with the chat assistant using natural language to request specific event messaging details from the client web portal.
2. The user prompt is directed to the AI assistant module for processing, ensuring that all requests are handled efficiently.
3. The AI assistant module queries Amazon Bedrock Knowledge Bases for relevant answers, providing users with accurate and reliable information.
4. The transcript is processed by Amazon Nova Pro, guided by Amazon Bedrock Guardrails, ensuring that the generated responses are appropriate and relevant.

By leveraging the power of AWS services, Infosys Event AI provides a comprehensive solution for capturing, processing, and accessing event knowledge. This innovative platform enhances accessibility, streamlines information retrieval, and empowers organizations to effectively utilize the insights generated during events. With its seamless live stream acquisition, real-time transcription processing, automated post-event processing, and AI-powered chat assistant, Infosys Event AI is transforming the way organizations capture and utilize event knowledge. This solution not only improves accessibility for all participants but also ensures that valuable insights are not lost, fostering a culture of knowledge sharing and continuous learning.

The combination of AWS Elemental MediaLive and MediaConnect ensures high-quality and reliable video delivery, while Amazon Bedrock’s large language models enhance the platform’s ability to analyze and summarize event content. Amazon Nova Pro’s multilingual translation capabilities further expand the reach of event knowledge, making it accessible to a global audience.

The AI-powered chat assistant, a standout feature of the solution, provides users with an interactive and efficient way to access information. By querying the event knowledge base using natural language, users can quickly find the answers they need without having to sift through lengthy transcripts or recordings. This feature is particularly valuable for those who missed the event or want to quickly review specific topics.

Infosys Event AI is a testament to the power of cloud computing and artificial intelligence in transforming the way organizations manage and utilize knowledge. By leveraging AWS services, Infosys has created a solution that is not only scalable and reliable but also highly innovative and user-friendly. This platform has the potential to revolutionize the way events are conducted and the way knowledge is shared, empowering organizations to make better decisions and achieve their goals. The focus on real-time transcription and post-event processing ensures that no valuable information is lost, while the AI-powered features enhance user engagement and knowledge retention. This holistic approach makes Infosys Event AI a valuable asset for any organization looking to maximize the impact of their events and workshops. Moreover, the platform’s adaptability ensures it can scale to accommodate events of any size, from small workshops to large-scale conferences. The use of serverless architecture further contributes to the solution’s cost-effectiveness and operational efficiency.

Beyond the technical aspects, Infosys Event AI also promotes inclusivity by providing real-time transcriptions, allowing individuals with hearing impairments to fully participate in events. The multilingual translation capabilities ensure that language barriers are minimized, enabling a more diverse and globally connected audience.

The integrated AI assistant not only provides quick answers to user queries but also learns from user interactions, continuously improving its accuracy and relevance over time. This adaptive learning capability ensures that the platform remains up-to-date with the latest event information and user needs.

The platform also incorporates robust security measures to protect sensitive event data and ensure the privacy of participants. These measures include secure data storage, access controls, and encryption protocols. By prioritizing security, Infosys Event AI provides a trusted and reliable environment for capturing and sharing event knowledge.

Infosys Event AI is more than just a technology solution; it’s a strategic enabler for organizations seeking to maximize the value of their events and foster a culture of continuous learning. By democratizing access to event knowledge and empowering users to quickly find the information they need, this platform helps organizations make better decisions, improve performance, and drive innovation. The long-term impact of Infosys Event AI extends beyond individual events, creating a lasting repository of knowledge that can be leveraged for future initiatives and strategic planning. By transforming the way events are conducted and knowledge is shared, Infosys Event AI is helping organizations unlock their full potential and thrive in today’s rapidly evolving world. The platform’s ability to integrate with existing systems and workflows further enhances its value, making it a seamless addition to any organization’s technology ecosystem. From enhancing employee training to facilitating executive decision-making, Infosys Event AI is a versatile tool that can be used to drive a wide range of business outcomes. In conclusion, Infosys Event AI represents a significant advancement in the field of event knowledge management, offering a comprehensive and innovative solution for organizations seeking to capture, process, and utilize event insights effectively. By leveraging the power of AWS services and incorporating cutting-edge AI technologies, Infosys has created a platform that is not only scalable and reliable but also highly user-friendly and adaptable to the evolving needs of modern organizations.