Company: Speechlabs AI

Role: Software Architect

Product: https://www.speechlab.ai/

Project Objectives: AI-Powered Audio and Video Localization Platform

Developed a cutting-edge service that leverages proprietary AI to automate the process of video and audio localization. The platform delivers transcription, translated text, and synthetic dubbing for audio and video content, enabling speech-to-speech translation for dubbing professionally produced media.

Technologies and Tools:

• Frontend: React.js, Next.js, TypeScript
• Backend: Node.js, Express.js, REST APIs
• Database: MongoDB
• Cloud Services: AWS (Cognito, S3, EventBridge, Lambda, ECS, App Runner, CloudWatch)
• Machine Learning: Speech Recognition, Machine Translation, Text-to-Speech, Natural Language Processing

Key Accomplishments:

1. Architected the system based on Amazon Web Services (AWS) and played a crucial role in designing the overall system architecture.
   • Utilized various AWS services, including Cognito for authentication, S3 for storage, EventBridge for event-driven architecture, Lambda for serverless computing, ECS and App Runner for containerized deployments, and CloudWatch for monitoring.
2. Developed core components of the API to access large language models, enabling seamless integration of advanced AI capabilities into the platform.
   • Optimized the API and interfaces for performance, robustness, and ease of use, ensuring a smooth user experience.
   • Implemented tools and processes to monitor model behavior and performance, facilitating continuous improvement and maintenance.
3. Designed and documented the API layer and structure using Swagger, providing clear and comprehensive documentation for developers.
   • Created NoSQL data models based on MongoDB to efficiently store and retrieve data for the platform.
4. Implemented a secure authentication and authorization mechanism using AWS Cognito and Node.js, ensuring user privacy and data protection.
   • Developed functionality for multipart file uploads with S3 in Node.js and React.js, enabling efficient and reliable file handling.
   • Built a mechanism to serve media files directly from S3 to the browser securely, optimizing content delivery.