Senior Researcher, Speech Synthesis and Multimodal LLM
Lightspeed- Location
- Singapore-CapitaSky
- Workplace
- —
- Employment
- —
- Salary
- —
Posted 2mo ago
Business Unit
LIGHTSPEED STUDIOS is made up of passionate players who advance the art & science of game development through great stories, great gameplay, and advanced technology. We are focused on bringing next generation experiences to gamers who want to enjoy them anywhere, anytime, across multiple genres and devices.
About the Hiring Team
Lightspeed Tech Center is a R&D department under Lightspeed Studios which develop PUBG Mobile and other high-quality games. Our Tech Center leads the research, exploration, and discovery of innovative technologies and provides technical services for all games during all phases of life cycle, including engine, audio, QA, AI, next generation game, technical cooperation, etc.
What the Role Entails
- Research and develop advanced speech synthesis and generation algorithms (e.g., TTS, voice conversion, sound/music generation) based on LLMs, multimodal/omnimodal LLMs.
- Develop and optimize speech and audio synthesis systems for online applications, improving effectiveness, efficiency, and scalability.
- Explore and advance full-duplex/streaming multimodal LLM capabilities in speech understanding, generation, and real-time spoken interaction.
- Collaborate cross-functionally with research and engineering teams from prototyping to production.
Who We Look For
- Ph.D. in Computer Science, Electrical Engineering, Signal Processing, or a closely related field.
- Strong foundation in speech/audio processing and modern generative models (e.g., diffusion, flow matching, autoregressive, codec-based approaches).
- Hands-on experience extending LLMs to speech/audio modalities (e.g., speech tokenizers, multimodal adapters, speech-text joint training). Experience with full-duplex or streaming spoken dialogue systems and real-time interaction modeling is a plus.
- Proficient in Python and deep learning frameworks (e.g., PyTorch); experience with distributed training is a plus.
- Track record of publications at top-tier venues (e.g., ICML, NeurIPS, ICLR, ACL, ICASSP, Interspeech).
Equal Employment Opportunity at Tencent
As an equal opportunity employer, we firmly believe that diverse voices fuel our innovation and allow us to better serve our users and the community. We foster an environment where every employee of Tencent feels supported and inspired to achieve individual and common goals.
Skills
- LLM
- Python
- Deep Learning
- PyTorch
More jobs at Lightspeed
All 17Game AI Product Management Intern
Lightspeed · New Zealand-Auckland · 14d ago
Senior Interactive Vision Model Researcher|高级研究员 - 可交互视觉模型
Lightspeed · Japan-Tokyo-Business Tower · 1mo ago
Senior Interactive Vision Model Researcher
Lightspeed · Singapore-CapitaSky · 1mo ago
Social Media Operation Intern
Lightspeed · Singapore-CapitaSky · 1mo ago
Senior Researcher, Speech Synthesis and Multimodal LLM|高级研究员 - 语音合成与多模态大模型
Lightspeed · S.Korea-Seoul · 1mo ago
Similar roles
Senior Software Engineer
Redwood Materials · remote · Nevada · USD 180,000–237,500/yr · today
Embedded Software Engineer – Power Electronics, Energy Storage
Redwood Materials · San Francisco, California, United States · USD 180,000–237,500/yr · today
Senior Full-Stack Engineer (Go Strength)
Sharesource Australia · Hanoi, Vietnam · today
Machine Learning Engineer
FPT Asia Pacific Pte · Singapore · today
Forward Deployed Engineer
DevRev · India · today
Software Engineer - ML/Computer Vision (Battery Sorting)
Redwood Materials · McCarran, NV · San Francisco, California, United States · USD 152,500–200,000/yr · today