Recruit Detail
Find out more about the work we do, the experience and skills we can bring to the table, and our terms and conditions.
Company Name
CyberAgent, Inc.
Job Type
[Media Division] (Research Scientist) Sports AI Tech Lab Internship for Doctoral Students
Work Detail
[Research Organization "Sports AI Tech Lab"] This research organization was newly established based on CyberAgent Group's expertise in technology and entertainment, as well as its deep involvement in the sports industry cultivated through products such as "ABEMA" and "WINTICKET," and the management of sports teams including "FC Machida Zelvia." It has begun building a sports AI video analysis platform, aiming to create superior viewing experiences, implement solutions in products, and strengthen teams and players by detecting player and competition data with high accuracy through AI analysis of match footage. The organization is also considering collaboration with universities and research institutions, deepening fundamental research in the field of sports AI. [Research Theme] This internship, aimed at doctoral students, will focus on research and development of natural language processing and speech processing technologies to improve viewing and spectating experiences in services such as ABEMA and WINTICKET, in conjunction with sports understanding technology. 1. 1. Sports Applications of Language Generation Technology - Development of a multimodal commentary and analysis generation model integrating video and play data - Generation of highlight summaries, titles, and descriptions for on-demand broadcasts and short videos - Data construction and training for the development of a Japanese streaming language model - Real-time translation and multilingual subtitle generation for multilingual distribution 2. Sports Applications of Audio Processing Technology - Commentary speech synthesis controllable by excitement and game development - Low-latency real-time speech synthesis - Textless speech synthesis from video and sports data 3. Sports Applications of Recommendation and User Adaptation Technology - Personalized optimized commentary generation considering behavioral history - Simplified and detailed techniques for commentary generation for beginners and advanced users 4. Sports Applications of Automatic Evaluation Technology - Development of a multimodal evaluation method considering video and numerical time series - Evaluation of naturalness, realism, and listenability in speech synthesis 5. Real-time prediction of match progression and player performance - Real-time prediction of wins and losses and plays, and quantification of uncertainty - Prediction of player and ball movements and the next play based on tracking data [Attractiveness of the Theme] You will gain experience connecting the research results of natural language processing and speech processing to real services such as ABEMA and WINTICKET, while collaborating with Sports AI Tech Lab's video analysis and sports data analysis technologies. In addition to the novelty of the research, a major feature is that you can engage in research and development that is conscious of the value in actual services.
Ideal Profile
[Required Skills] • Doctoral-level expertise and research experience in one of the following areas: natural language processing, speech processing, dialogue systems, information recommendation, or multimodal machine learning. • Implementation experience using machine learning models and large-scale language models with Python. [Preferred Skills] • Research and development experience in one of the following areas: LLM, multimodal language generation, automatic summarization, machine translation, speech synthesis, dialogue, recommendation, evaluation, etc. • Experience handling sports data, video data, audio data, sensor data, viewing logs, etc. • Experience developing real-time processing, streaming inference, and low-latency systems.
What we especially look for in a PhD or postdoctoral fellow
This internship is exclusively for students currently enrolled in doctoral programs at graduate school. We welcome candidates to propose themes that leverage their own expertise.
Work Location
40-1 Udagawa-cho, Shibuya-ku, Tokyo, Abema Towers Full remote work possible *Accommodation (including communication costs) will be provided for those living far away who wish to come to the office.
Phd. Stating Salary
Monthly salary (based on 8 hours of work per day, 5 days a week / excluding Saturdays, Sundays, and public holidays) *Full reimbursement of transportation expenses, company-provided PC, and reimbursement of international conference participation fees upon acceptance of a paper.