Mesolitica Builds Malaysian Large Language Model for Generative AI Assistants on AWS

LAS VEGAS-December 2, 2024- Amazon Web Services (AWS), an Amazon.com company, today announced that Mesolitica, a Malaysian startup specializing in training large language models (LLMs), has built a Malaysian language generative artificial intelligence (generative AI) LLM on the world's leading cloud. The MaLLaM LLM can understand local nuances like slang, colloquialisms that merge different dialects, Bahasa Malayu, and 16 other regional languages for use in AI assistants across industries. Mesolitica has trained MaLLaM on 197 datasets totaling close to 200 billion tokens of publicly available Malay-specific content to provide culturally-relevant AI support for applications in customer service, content generation, and data analysis in localized languages.

Using custom ML chips, including AWS Trainium, and AWS Inferentia, Mesolitica saw compute cost savings of 87% while enjoying a 5.5-fold increase in throughput (transactions per second) while training MaLLaM, improving the model's responsiveness and efficiency when used for AI assistants. With AWS, Mesolitica can now deploy proofs of concept (PoCs) in as little as 24 hours, while the AWS Asia Pacific (Malaysia) Region provides a 20% reduction in latency, critical for achieving human-like conversations in AI voice assistants.

"Our biggest challenge was understanding the many local languages Malaysian patients use," said Dr. Kev Lim, CEO & Founder of health-tech startup Qmed Asia. "By leaning into Mesolitica, we can now better understand local speech patterns through MaLLam. This has enhanced the accuracy of our medical note-taking solution, strengthened patient communication, and ultimately, empowered us to deliver higher quality healthcare."

With AWS, Malaysian enterprises using MaLLaM can improve operations with generative AI in regional languages to help underserved audiences like farmers in rural areas make data-driven decisions using real-time weather forecasts, soil health analysis, and crop viability assessments. The Malaysian government is also exploring the integration of MaLLaM into its operations, which aligns with the country's broader goal of AI sovereignty and local data governance. AI assistants built on MaLLaM can provide quick, accurate responses to citizens' inquiries in multiple languages, including dialects from different Malaysian States such as Johor, Kedah, Sarawak, Selangor, and Terengganu, to ultimately improve citizen communication and data processing capabilities across the culturally diverse country. Malaysia's educational sector can benefit from MaLLaM through applications in language learning and research, particularly in enhancing the understanding of local languages and dialects.

"With AWS, we can deploy proofs-of-concept much faster, with the right cost-effective AI compute resources and machine learning capabilities," said Khalil Nooh, co-founder and CEO, Mesolitica. "This allows our customers to focus only on the ongoing operational costs, rather than upfront capital expenses, for their AI experiments. This is also in line with Malaysia's national priority to develop citizen-centric applications, making our MaLLaM generative AI assistant strategically important to the country's digital transformation ambitions."

Southeast Asia's population speaks about 2,300 languages. When LLMs that are pre-trained in English and western-centric data are tasked with non-English queries, they can produce inaccuracies and misinterpretations. LLMs that are trained on culturally diverse data like MaLLaM can address this gap, boost accuracy, and better cater to the region's diverse cultures, ways of working, and languages. As a cloud-native platform, Mesolitica needed compute-intensive resources to develop local LLMs and meet demand from private and public sector customers across the country.

Mesolitica has significantly enhanced its machine learning operations by leveraging AWS services. The company migrated its model training workloads to Amazon Elastic Cloud Compute (Amazon EC2) and deployed inference workloads using Amazon EC2 G5 instances, which provide cost-effective GPU acceleration for AI models. To enhance its infrastructure, Mesolitica implemented Amazon Elastic Kubernetes Service (Amazon EKS) to deploy and manage ML models and applications, and to orchestrate P4 Nvidia instances. Furthermore, the company utilizes Amazon SageMaker, a fully managed ML service, to efficiently manage and prepare large data sets essential for training LLMs.

Mesolitica is part of the AWS APJ Generative AI Spotlight program, a four-week accelerator program which aims to support early-stage startups in the region that are developing generative AI applications. The startup is also one of two Malaysian companies to receive AWS credits from the AWS Activate Program, a comprehensive initiative by AWS that provides access to a range of resources, including AWS credits, technical support, training, and tools tailored to help startups build, launch, and scale their applications on AWS. Mesolitica has joined the AWS Partner Network, a global program designed by AWS to assist businesses in leveraging AWS for growth and success.

"Malaysian startups can revolutionize industries through data-driven solutions and advanced technologies," said Pete Murray, country manager, AWS Malaysia. "For GenAI to be relevant, it must be accessible and culturally integrated. Mesolitica is creating Malaysia's first Large Language Model AI that's tailored to the country's diverse population. This has potential to support various sectors, from improving government services to financial inclusion. We're proud to host MaLLaM on AWS Malaysia region."

About Amazon Web Services
Since 2006, Amazon Web Services has been the world's most comprehensive and broadly adopted cloud. AWS has been continually expanding its services to support virtually any workload, and it now has more than 240 fully featured services for compute, storage, databases, networking, analytics, machine learning and artificial intelligence (AI), Internet of Things (IoT), mobile, security, hybrid, media, and application development, deployment, and management from 108 Availability Zones within 34 geographic regions, with announced plans for 18 more Availability Zones and six more AWS Regions in Mexico, New Zealand, the Kingdom of Saudi Arabia, Taiwan, Thailand, and the AWS European Sovereign Cloud. Millions of customers-including the fastest-growing startups, largest enterprises, and leading government agencies-trust AWS to power their infrastructure, become more agile, and lower costs. To learn more about AWS, visit aws.amazon.com.