Job Search

Recruit Detail

Find out more about the work we do, the experience and skills we can bring to the table, and our terms and conditions.

Company Name

CyberAgent, Inc.

Job Type

[Media Division] (Research Scientist) Sports AI Tech Lab Internship for Doctoral Students

Work Detail

[Research Organization "Sports AI Tech Lab"] This research organization was newly established based on CyberAgent Group's expertise in technology and entertainment, as well as its deep involvement in the sports industry cultivated through products such as "ABEMA" and "WINTICKET," and the management of sports teams including "FC Machida Zelvia." It has begun building a sports AI video analysis platform, aiming to create superior viewing experiences, implement solutions in products, and strengthen teams and players by detecting player and competition data with high accuracy through AI analysis of match footage. The organization is also considering collaboration with universities and research institutions, deepening fundamental research in the field of sports AI. [Research Theme] This internship, aimed at doctoral students, will focus on research and development of natural language processing and speech processing technologies to improve viewing and spectating experiences in services such as ABEMA and WINTICKET, in conjunction with sports understanding technology. 1. 1. Sports Applications of Language Generation Technology - Development of a multimodal commentary and analysis generation model integrating video and play data - Generation of highlight summaries, titles, and descriptions for on-demand broadcasts and short videos - Data construction and training for the development of a Japanese streaming language model - Real-time translation and multilingual subtitle generation for multilingual distribution 2. Sports Applications of Audio Processing Technology - Commentary speech synthesis controllable by excitement and game development - Low-latency real-time speech synthesis - Textless speech synthesis from video and sports data 3. Sports Applications of Recommendation and User Adaptation Technology - Personalized optimized commentary generation considering behavioral history - Simplified and detailed techniques for commentary generation for beginners and advanced users 4. Sports Applications of Automatic Evaluation Technology - Development of a multimodal evaluation method considering video and numerical time series - Evaluation of naturalness, realism, and listenability in speech synthesis 5. Real-time prediction of match progression and player performance - Real-time prediction of wins and losses and plays, and quantification of uncertainty - Prediction of player and ball movements and the next play based on tracking data [Attractiveness of the Theme] You will gain experience connecting the research results of natural language processing and speech processing to real services such as ABEMA and WINTICKET, while collaborating with Sports AI Tech Lab's video analysis and sports data analysis technologies. In addition to the novelty of the research, a major feature is that you can engage in research and development that is conscious of the value in actual services.

Ideal Profile

[Required Skills] • Doctoral-level expertise and research experience in one of the following areas: natural language processing, speech processing, dialogue systems, information recommendation, or multimodal machine learning. • Implementation experience using machine learning models and large-scale language models with Python. [Preferred Skills] • Research and development experience in one of the following areas: LLM, multimodal language generation, automatic summarization, machine translation, speech synthesis, dialogue, recommendation, evaluation, etc. • Experience handling sports data, video data, audio data, sensor data, viewing logs, etc. • Experience developing real-time processing, streaming inference, and low-latency systems.

What we especially look for in a PhD or postdoctoral fellow

This internship is exclusively for students currently enrolled in doctoral programs at graduate school. We welcome candidates to propose themes that leverage their own expertise.

Work Location

40-1 Udagawa-cho, Shibuya-ku, Tokyo, Abema Towers Full remote work possible *Accommodation (including communication costs) will be provided for those living far away who wish to come to the office.

Phd. Stating Salary

Monthly salary (based on 8 hours of work per day, 5 days a week / excluding Saturdays, Sundays, and public holidays) *Full reimbursement of transportation expenses, company-provided PC, and reimbursement of international conference participation fees upon acceptance of a paper.

Similar Recruits

Honda Research Institute Japan Co., Ltd.

Job Type
Research Position - Research and Development of Multimodal Dialogue Technology in Human-Centered AI

Established in 2003 in Japan, the United States, and Europe, as a wholly owned subsidiary of Honda R&D Co., Ltd., HRI aims to be an organization that challenges new fields beyond automotive technology. Our guiding principle is "Innovate through Science." Towards the realization of a hybrid society where people, the global environment, and intelligent systems coexist in harmony, we focus on communication and sensing, such as Cooperative Intelligence and Cooperative Devices, through a multifaceted approach drawing from artificial intelligence, robotics, systems science, neuroscience, materials science, psychology, and social ethics. We are engaged in various research projects. * Research to realize multimodal communication between humans and machines through interaction that considers human mental states. * Development of a speech recognition system that promotes mutual understanding between people with hearing impairments and those with normal hearing. * Development of a system for estimating a person's internal state (e.g., level of understanding) using cameras, wearable sensors, etc. ■ Job Openings We are seeking advanced researchers/engineers specializing in multimodal dialogue technology in human-centered AI to drive the advancement of next-generation dialogue systems. [Job Details] * Advanced Multimodal Architecture Focus on strengthening internal inference (Chain-of-Thought) and reducing latency to design and verify novel research concepts for next-generation dialogue models. * Development of Contextual Understanding Models Analyze continuous audio, video, and text data to build algorithms that adapt to user behavior and environmental context. * Solving Real-World Problems Design a system to convert real-world interaction signals into high-quality training data, enabling continuous model improvement and bias reduction. * Promoting Global Collaboration Collaborate with overseas sister research institutes (Germany and the USA) to tackle research themes that lead to business opportunities. * Technical Leadership and Growth Responsible for creating new research themes, project management, nurturing young researchers, and presenting at international conferences. Expected to take on a team leader role in the future. [Job Characteristics] You will proactively handle the entire research lifecycle, from research conception to implementation, evaluation, and practical application. As a role connecting academic research and real-world applications, you will gain experience in elevating foundational models into systems that can be practically operated. With a high degree of autonomy, you can propose and promote your own research themes and actively present at top-level international conferences. • Multimodal Fusion/LLM Foundation models such as Vision-Language Model (VLM), cross-modal attention • Human-centered computer vision Speaker detection, gaze estimation, posture estimation, facial expression/attribute analysis • Speech/natural language processing Speaker recognition/speech recognition integrated with visual information, dialogue context understanding Based on Honda's philosophy of "Technology for people," we aim to create unique technologies for the world with speed and originality. Based on the latest trends in multimodal AI, we identify high-value research themes and create results through rapid prototyping, experimentation, and verification. Research results will be actively disseminated through international conferences and papers. You will promote work in collaboration with team members and several researchers from external research institutions. One of the attractions is the opportunity to work globally in collaboration with our overseas sister companies (Germany, USA). Research projects are driven under the Research Division Manager (Department: Research Division). Research projects are proposed by the individual, including content and budget, and are launched upon board approval. • A highly international workplace with approximately half of all employees being foreign nationals. Communication within the company is conducted daily in both Japanese and English. • The workplace is located within Honda Motor Co., Ltd.'s "Wako Campus," which has received numerous awards as a suburban office. • Researchers have a great deal of autonomy, and the external publication of research results is actively encouraged. There is a culture that respects the company's direction while also valuing the will of the researchers.

2026年卒 2027年卒