Samba: Measurement Operation

Redesigning a placement report for the Measurement Operations internal team to search for missing advertisement impressions. Internal team B2B.

2021 - 2022

Team

  • Kristine Huynh - Product Designer
  • Teresa Pesenti - Product Designer

Tools

  • Figma 
  • FigJam
  • Google Meets 
  • Google Sheets
  • Google Forms
  • Slack (communications)

Methods

  • Qualitative interviews
  • Quantitative survey 
  • Heuristic analysis
  • Ideation
  • UX / UI / IXD
  • Design prototyping
  • Concept testing

Overview

This project fine-tunes and updates ad team processes to expedite with the other companies’ ad teams. I interviewed and surveyed my company's team members to understand what processes would usually take a while to process. That would be email correspondence analyst reporting and the end-of-campaign report.

I visualize how the ad team processes their work using a site map.

Site Maps of Placement Report

Problems with validating reports

Initially, this S3 Placement Validation process was used to check how the team had to Master the Placement Reports manually.

Most users see this as an uploader.
Match Rate Metrics and Data Frames are difficult to read.
ID Combos in the Database defaults to highest to lowest.

Users' biases toward Google Excel  

The team uses Google Sheet Template is used to verify the impression found in the system. So, the 3P Placement Validation has become an uploader for the team to upload files not used for factual purposes to verify that the Master Placement Report corroborates what’s in the Samba ad impressions system.  

Example of Excel and Google Sheets templates for the final reports.

Problem: The Measurement Operation team seeks an efficient validation and uploader solution for auditing completed reports to enhance efficiency and accuracy.

Propased Soultion

How might we get the user to see the placement report S3 as a validation tool and not just an uploader?

This was the main problem I wanted to pursue in redesigning the Placement report uploader.

Current user flow for the uploading the placement reports.

Reviewing Opportunities Through User’s Interviews

After considering the users and prioritizing the Master Placement Report features, I wanted to find features essential to redesigning the current Master Placement Cement in the Data league that the Measurement Operations teams use.

These are the main features that were prioritized during the design process. The users proposed these since they are the primary users conducting the report analysis.

  • I want the product to feel similar to Google Sheets or Excel since those are the main applications users use daily.
User's issues with uploader.

Populating Data to Review  

The Master Placement Report and Site ID Key function similarly to the Google Sheets framework in terms of data combination. Pixels will be extracted from the company’s data sets.

Excavating Missing Ad Data Dashboard

The dashboard shows four different sections:

  • Updated metric (1)
  • Campaign health (2)
  • Missing impressions report (3)
  • Missing pixel errors (4)

Updated metric (1): This shows campaign report impressions, comparing the databases. A discrepancy section shows the differences between the two reports.

Campaign health (2): This chart shows the campaign's overall health based on duration.

Missing impressions report (3): The Excel sheet shows the numerical IDs not accounted for in the campaign report.

Missing pixel errors (4): The graph shows which affiliated sites that are part of the campaign are carrying the most egregious code implementation errors.

In retrospect

The Master Placement Report helps me understand the UX process from a business standpoint and how it affects the company's internal team. I created a project proposal to advocate the MPR product to the internal company stakeholders to see if it would progress.

In the future, I would expand the client-facing product because users dislike building the Master Placement Report manually. They also want to end the waiting period by receiving clients' emails to complete the Master Placement Report Excel file. The client-facing element would fast-track the campaign’s process and expedite the clients' tactical reports to gain more insight into their ad spending.

Other projects: