Connect with us

Hi, what are you looking for?

HEADLINES

Alibaba Cloud integrates Tongyi Qianwen into AI assistant to enhance productivity

The assistant excels at converting speech and videos to text in real-time, aiming to enhance both personal and workplace productivity.

Alibaba Cloud, the digital technology and intelligence backbone of Alibaba Group, announced today that its large language model (LLM), Tongyi Qianwen, has been integrated into its intelligent assistant named Tingwu. The assistant excels at converting speech and videos to text in real-time, aiming to enhance both personal and workplace productivity.

The recently launched LLM enables Tingwu to comprehend and analyze multimedia content with high levels of accuracy and efficiency, such as generating summary text from video and audio files, capturing key talking points for each speaker, and creating a timeline of multimedia files with a summary of each section.

The LLM-powered Tingwu, called “Tongyi Tingwu”, is now available for public beta testing. Tongyi Tingwu will also be integrated into DingTalk, Alibaba’s digital collaboration workplace and application development platform, supporting users’ AI demands at work. In addition to improving workplace efficiency, Tongyi Tingwu can also be used across various multimedia platforms, responding to the growing needs for faster and easier knowledge sharing in online education, training, interviews, live streaming, podcasts, and short-form videos.

“We live at a time when a growing amount of video and audio content is being consumed in various formats every day. In line with this, Tongyi Tingwu aims to use the large language model to facilitate faster and better comprehension and easier sharing of multimedia content,” said Jingren Zhou, CTO of Alibaba Cloud Intelligence. “As we gradually integrate the Tongyi Qianwen model into our products and services, we hope users can reap the benefits from these compelling AI innovations for their work, study, play and interaction with each other.”

Advertisement. Scroll to continue reading.

By leveraging proprietary audio and video models developed by Alibaba’s research institute DAMO – including the self-developed speech recognition model Paraformer and speaker verification model CAM++, along with the newly-released LLM Tongyi Qianwen – Tingwu can transcribe video and audio files with higher accuracy while enabling numerous AI-powered features. Additional AI features offered by Tongyi Tingwu will be available later this year. These features include automatically compiling text answers to address user queries across audio/video files, generating a summary based on PowerPoint slides extracted from videos, and providing real-time translation between English and Chinese for multimedia content with Tingwu as a Chrome plugin.

General public can access the upgraded AI-powered assistant online (tingwu.aliyun.com) starting from today to experience its capabilities through their Alibaba Cloud accounts and receive free transcription services as part of an open trial.

Alibaba Cloud unveiled Tongyi Qianwen on April 11, which is scheduled to be integrated across Alibaba’s various businesses to improve the user experience in the near future. The company’s customers and developers will have access to the model to create customized AI features in a cost-effective manner, too.

The cloud pioneer also launched the “Tongyi Qianwen Partnership Program,” aiming to co-create large language models tailored for different industries with partners across sectors, including petrochemicals, electricity, transportation, hospitality, enterprise services, telecommunications and finance.

Advertisement. Scroll to continue reading.
Advertisement
Advertisement
Advertisement

Like Us On Facebook

You May Also Like

HEADLINES

To meet surging AI demands, 43% of new data center facilities are expected to be dedicated to AI workloads. With AI model training and...

HEADLINES

Qwen2.5-Omni-7B delivers uncompromised performance and powerful multimodal capabilities. This unique combination makes it the perfect foundation for developing agile, cost-effective AI agents that deliver...

HEADLINES

As technology becomes increasingly integral to everyday life, digitally savvy kids can enhance their tech skills to further enrich their knowledge and creativity. This...

HEADLINES

Maya’s fraud detection approach, Transaction Sequence Embeddings, analyzes and uncovers subtle patterns between transactions —flagging those that resemble fraudulent behavior or deviate from a...

SOFTWARE

With these enhancements, Copilot is now more accessible than ever across Windows 11, macOS, mobile apps, and Telegram. Plus, with improved local interoperability, Copilot...

HEADLINES

Within just one month, Lenovo has opened four new Exclusive Stores, strengthening its nationwide presence and making its innovative AI-powered devices more accessible to...

White Papers

Coursera data shows that while the country has the highest share of women in GenAI enrollments in the region and ranks among the top...

HEADLINES

According to Ren-Ren Reyes, president and CEO of G-Xchange, Inc., “This MOA with NPC underscores our commitment to upholding the highest standards of data...

Advertisement