How to Evaluate a Marketing Agency Performance With a Clear Scorecard

What should a marketing agency scorecard measure?

A marketing agency scorecard should measure four areas: business outcomes, data you can confirm, work quality and decision quality. Task counts, hours logged and report length belong in a status update, not in the scorecard.

The weights below are the ones DesignFXPro suggests to clients who ask how to judge us. Outcomes carry the most weight because revenue-linked KPIs are what the business pays for. The other three areas explain whether the outcome is real and whether it will last.

A weighted score of 4.0 or above means keep going, 3.0 to 3.9 means agree a recovery plan, and under 3.0 for two reviews in a row means reconsider the relationship.

Those score bands are a working rule we use, not an industry standard. Adjust them to your own risk tolerance, but agree on them with the agency before the first review.

How do you set a baseline before judging an agency?

Set the baseline by recording where results stood before the agency started, using the same date range, attribution settings and definitions you will use later. Without a baseline, any month can be called an improvement.

• The outcome that matters, such as qualified leads, booked calls, orders or revenue.
• The target and the review period, such as a 90-day or six-month window.
• The starting numbers, pulled from the source platforms, with the date you pulled them.
• Factors outside the agency's control: sales follow-up speed, stock, pricing, seasonality and how quickly your team grants website access.

Seasonality is easy to misread. Google's own guide to debugging search traffic drops recommends the Last 16 months view in Search Console to check whether a drop happens every year. Use the same view to compare an agency's SEO results against the same season last year.

Which KPIs should you use for each marketing channel?

Use one primary KPI per channel, tied to the outcome that channel is meant to drive, plus a few supporting signals that explain it. Judging SEO and paid ads by the same number punishes the slower channel unfairly.

Attribution settings change what the numbers say. In Google Analytics, changing the reporting attribution model applies to historical and future data, so a model change can make past months look different. Agree on one model and record it in the scorecard.

Phone and in-store sales can be counted too. The Google Analytics Measurement Protocol lets your systems send offline conversions to Analytics, which closes the gap when leads close by phone.

How do you run a monthly agency performance review step by step?

Run the monthly review in a fixed order: check the data, score the outcome, then judge the work and the next decision. Following the same order every month keeps the conversation on evidence.

1. Open the source platforms yourself and confirm the headline numbers in the agency's report.
2. Compare the primary KPI for each channel against the baseline and the target for the review period.
3. Note any outside factors that changed this month, such as a price change, a stock gap or slow sales follow-up.
4. Ask the agency to explain what drove the result, including anything that went down.
5. Score each of the four areas from 1 to 5 and calculate the weighted total.
6. Review the next recommendation: what will change, who owns it and what the team expects to learn.
7. Record the score, decisions and owners in one shared document so the next review starts from the same page.

A useful monthly report covers progress against goal and baseline, spend and results by channel, lead or sales quality, meaningful changes, work completed and the next priority. Anything else is supporting detail.

How does DesignFXPro report so clients can score us?

DesignFXPro reports on revenue-linked KPIs from one tracking setup across channels, and clients keep ownership of their accounts so they can check every figure. We review results weekly in the Optimize stage of our Discover, Strategize, Execute and Optimize process.

Our Strategize stage writes the KPIs, channels and milestones into a roadmap before work starts, which gives clients a ready-made baseline for the scorecard. Our homepage reports 300+ projects delivered and a 98% client retention rate.

One public example is the Kazandji Law SEO case study, where monthly organic sessions grew from 4,820 to 18,640 in six months, a 287% increase, and monthly qualified leads rose about 3.4x. Results vary by market, competition and budget. See how we plan KPIs in our digital marketing strategy service.

Common mistakes when evaluating a marketing agency

The most common mistake is judging an agency on the report it sends instead of on the data in your own accounts. A polished report can hide a flat outcome.

• Scoring on vanity metrics such as impressions, likes or clicks with no link to leads or revenue.
• Letting targets change without a written reason.
• Not owning the Google Ads, Analytics, Search Console or CRM accounts.
• Judging SEO after one month with the same yardstick as paid ads.
• Ignoring lead quality and counting every form fill as equal.
• Blaming the agency for problems outside its control, such as slow sales follow-up.
• Renewing without comparing the latest scorecard to the original goals.

If you are choosing between provider types, our comparison of a digital marketing agency vs a freelancer covers who suits which kind of scorecard.

When should you reconsider your marketing agency?

Reconsider your marketing agency when the scorecard stays low for two or more reviews and the agency cannot explain why or show a credible recovery plan. One weak month is normal; a pattern is a signal.

• Reports avoid lead quality or revenue and focus on reach.
• You still do not have access to key accounts or source data.
• Recommendations repeat each month without new evidence.
• Communication slows down when results fall.
• Work drifts away from the agreed strategy or scope.

Give the agency one documented chance first. Share the low scores, the evidence behind them and a time-bound recovery plan with named owners and review dates, then score the next review against that plan.

Before you leave, export reports and files and confirm admin access to every account. Our guide to offshore marketing outsourcing risks includes a clean exit checklist.