Optimizing AI Video summary feature to maximize business impact

Kaltura

Internship (B.A. Praciticum)

Team lead

UX/UI Design

Prototyping

Research

Optimizing AI Video summary feature to maximize business impact

Kaltura

Internship (B.A. Praciticum)

Team lead

UX/UI Design

Prototyping

Research

Optimizing AI Video summary feature to maximize business impact

Kaltura

Internship (B.A. Praciticum)

Team lead

UX/UI Design

Prototyping

Research

Optimizing AI Video summary feature to maximize business impact

Kaltura

Internship (B.A. Praciticum)

Team lead

UX/UI Design

Prototyping

Research

During my internship at @Kaltura,

a cloud-based video platform, I led a project which included research and design of a new sub-feature within the “Summary & Chapters” feature to boost engagement and AI-credit usage.
By identifying usability gaps via 8 guided remote usability tests and creating new AI tools and redesign of clearer drafts system, me and my team created an experience that is more aligned with the users needs and the company’s business KPIs.

During my internship at @Kaltura,

a cloud-based video platform, I led a project which included research and design of a new sub-feature within the “Summary & Chapters” feature to boost engagement and AI-credit usage.
By identifying usability gaps via 8 guided remote usability tests and creating new AI tools and redesign of clearer drafts system, me and my team created an experience that is more aligned with the users needs and the company’s business KPIs.

Research

Research

Research

To kick off the research, my focus was on understanding the product better.
The goal was to understand both the UX’s team workload, the business context and the company’s current agenda.


Some of my questions during the kick-off:

“What’s the biggest opportunity in Kaltura’s 2025-2026 roadmap?


“What are the current KPIs in the R&D department, and how do they align to the product’s top goals?”

“Who are your most profitable users, and which user segments are you prioritizing?”


General research

To kick off the research, my focus was on understanding the product better. The goal was to understand both the UX’s team workload, the business context and the company’s current agenda.


Some of my questions during the kick-off:

“What’s the biggest opportunity in Kaltura’s 2025 - 2026 roadmap?


“What are the current KPIs in the R&D department, and how do they align to the product’s top goals?”

“Who are your most profitable users, and which user segments are you prioritizing?”


Usability testing


Usability testing


We wanted to test the feature to see whether the current flow works well, the users are satisfied and what missing abilities can turn into profitable opportunities.
We ran a remote, unmoderated usability test on Dovetail: We built a test scenario, recruited 8 testers on Respondent, created tagging system, documented and analyzed the testers’ feedback.


About : “Summary & Chapters”


We focused on “Summary & Chapters” sub-feature in the Content lab feature, which allows Internal content creators and L&D managers to edit and post a large amount of videos for organizational/institutional training while integrating LMS and AI abilities.

Usability testing


We wanted to test the feature to see whether the current flow works well, the users are satisfied and what missing abilities can turn into profitable opportunities.
We ran a remote, unmoderated usability test on Dovetail: We built a test scenario, recruited 8 testers on Respondent, created tagging system, documented and analyzed the testers’ feedback.


About : “Summary & Chapters”


We focused on “Summary & Chapters” sub-feature in the Content lab feature, which allows Internal content creators and L&D managers to edit and post a large amount of videos for organizational/institutional training while integrating LMS and AI abilities.

Test scenario

Test scenario

Entry point to Summary&Chapters

Defining the newly generated summary

Edit the new summary in the drafts

Post the new draft

Delete the posted draft

Usability test conclusions



Usability test conclusions



Navigation UI & Accessibility flaws

Navigation UI & Accessibility flaws

Some functions weren’t visible enough during the flow and were overseen by the testers, and some elements that should’ve served as indicators - were missing.

Some functions weren’t visible enough during the flow and were overseen by the testers, and some elements that should’ve served as indicators - were missing.

Need for editing/customization flexibility

Need for editing/customization flexibility

Users would like flexible editing options, including AI driven editing and control over content structure.

Users would like flexible editing options, including AI driven editing and control over content structure.

Feature gaps

Feature gaps

The testers expressed interest in different features that didn't exist in the previous version.

The testers expressed interest in different features that didn't exist in the previous version.

Data documentation & Analysis

Data documentation & Analysis

Process

Design process : First drafts

The first design trials were attempts to solve the users’ pain points and to elevate their current experience. The focus was on fixing up button positions, layouts, microcopy and color hierarchy.

Process

Design process : First drafts

The first design trials were attempts to solve the users’ pain points and to elevate their current experience. The focus was on fixing up button positions, layouts, microcopy and color hierarchy.

Challenges : Pivot due to feedback

Challenges : Pivot due to feedback

While the design drafts had solved few key pain points directly, it wasn’t the right approach to the solution.

We oversaw the business aspect and company’s long term interest, instead of putting the focus on “manual” editing or visibility - the right solution should’ve involved maximizing the clients’ usage of AI features.

While the design drafts had solved few key pain points directly, it wasn’t the right approach to the solution.

We oversaw the business aspect and company’s long term interest, instead of putting the focus on “manual” editing or visibility - the right solution should’ve involved maximizing the clients’ usage of AI features.

Using of AI features for content tuning instead of manual features

Using of AI features for content tuning instead of manual features

Client spends more credits out of their limited plan

Client spends more credits out of their limited plan

Client decides to upgrade/buy larger plans

Client decides to upgrade/buy larger plans

Revenue growth from AI features

Revenue growth from AI features

KPI’s

Maximize engagement with AI features

Reducing summary creation time

Maximize value for customer

KPI’s

Maximize engagement with AI features

Reducing summary creation time

Maximize value for customer

Solution

Solution

Design process : Final design

Design process : Final design

After re-reading the feedback from the usability testing, discussion with the VP and brainstorming as a team, the chosen design included 4 AI features that allow people to fine-touch their content and the summary structure easily.

After re-reading the feedback from the usability testing, discussion with the VP and brainstorming as a team, the chosen design included 4 AI features that allow people to fine-touch their content and the summary structure easily.

The first summary generation, where the user chooses their preffered technical aspects of their summary & generate their original summary.

The first summary generation, where the user chooses their preffered technical aspects of their summary and generate their original summary.

The main screens allows users to navigate between the different AI features, view their new and older drafts and edit them, manually or with AI.

The main screens allows users to navigate between the different AI features, view their new and older drafts and edit them, manually or with AI.

Refine tone

Adjust the summary's tone using AI, by tailoring their preferance from the options or choose from the pre-made templates.

Adjust the summary's tone using AI, by tailoring their preferance from the options or choose from the pre-made templates.

Customize chapters

Shape the chapters stracture, by choosing the chapter and then choosing the preferred action you'd like to perform over it - merging with other chapters or dividing the chapter.

Shape the chapters stracture, by choosing the chapter and then choosing the preferred action you'd like to perform over it - merging with other chapters or dividing the chapter.

Dictionary

Understand the summary’s jargon by expanding the phrasing dictionary or apply templates across all or selected chapters.

Understand the summary’s jargon by expanding the phrasing dictionary or apply templates across all or selected chapters.

Fine-tune content

Tune the summary’s content across all or selected chapters with customized keywords or pre-made templates.

Tune the summary’s content across all or selected chapters with customized keywords or pre-made templates.

Ability to change

Hovering over a draft allows users to edit their draft, download it or delete it, giving them sense of control while keeping a minimalistic visability.

Draft indicator

Once a new summary generation is done, there's a clear indicator there's a new draft - gradient block that says "New" appears under the Drafts section.

Test before you invest

The new "Try it out" feature allows users to try out the feature's change before fully commiting to it. That gives the users the freedom to explore the feature without the fear of spending credits.

Undo & restore

Once trying out the change, the user gets the option to reset their attempt, save their new changes or go back to the previous version.

Key changes

Key changes

Ability to change

Hovering over a draft allows users to edit their draft, download it or delete it, giving them sense of control while keeping a minimalistic visability.

Test before you invest

The new "Try it out" feature allows users to try out the feature's change before fully commiting to it. That gives the users the freedom to explore the feature without the fear of spending credits.

Undo & restore

Once trying out the change, the user gets the option to reset their attempt, save their new changes or go back to the previous version.

Draft indicator

Once a new summary generation is done, there's a clear indicator there's a new draft - gradient block that says "New" appears under the Drafts section.

Kaltura

Key changes

Key changes