How to Evaluate Any SEO Agency in Two Weeks Before Signing a 6-Month Contract — OnyxRank

A logistics software company signed a $4,500 per month SEO retainer in January. By June, they had spent $27,000 and ranked for 140 new keywords. None of those keywords were searched by anyone who bought their product. When they audited the work, they found the agency had been targeting informational queries with zero commercial intent. The strategy was technically competent. It was commercially useless.

The problem was not that they hired a bad agency. The problem is they signed a 6-month contract before they had any meaningful information about how the agency made decisions. Proposal decks and client logos don't answer that question. A two-week structured evaluation does.

This is a working protocol for CMOs, business owners, and growth leads who want to see how an agency actually thinks before committing budget.

Why Two Weeks Is Enough

Most buyers evaluate SEO agencies by studying their proposals, reviewing their portfolios, and checking testimonials. All of that information is curated for you by the agency. It tells you what they want you to believe, not how they perform under real conditions.

Two weeks of structured engagement surfaces the things proposals hide: how specifically they think about your business, how thorough their audit process is, whether their content strategy reflects 2026 search behavior or 2020 assumptions, and whether their accountability structures are real or decorative.

The protocol below doesn't require signing anything. It's the evaluation that happens before the contract conversation.

Days 1 to 3: The Strategy Audit Call

Before sharing access to any system, run a 60-minute strategy call. The goal isn't to quiz the agency. It's to observe how they process information about your business.

**What to do.** Describe your business in 10 minutes: revenue model, customer profile, top three competitors, and your biggest growth constraint. Then stop talking and let the agency respond.

**What to look for.** Do they ask follow-up questions about your customer's buying journey before opening a keyword tool? Or do they pivot immediately to search volumes? Strong agencies need to understand search intent from a business perspective before they can meaningfully evaluate which keywords matter.

**The test question.** Ask: "Where do you think my biggest SEO opportunity is right now?"

Generic answers are disqualifying. "Your technical SEO needs work" or "you need more content" applies to every website on the internet. Specific answers, even if hypothetical at this stage, demonstrate that the agency is processing your actual competitive situation.

**Green flag.** They identify a specific category of searches your customers would run, explain why you're not appearing for them, and describe a general approach to close that gap.

**Red flag.** They describe their "proven process" before they understand your business. Proven processes are templates. Templates treat your business like everyone else's.

Days 4 to 7: The Preliminary Audit Test

Ask the agency to run a preliminary technical and content audit on your site. Any agency worth hiring should do this at low cost or no cost as part of their evaluation process. If they won't, that's information.

**What to do.** Provide read-only access to Google Search Console and your analytics platform. Let them run their standard audit workflow.

**What to evaluate.** Focus on what they flag and, equally important, what they miss.

A strong audit will identify crawlability and indexation issues specific to your site's architecture, not generic. It will surface content pages that are cannibalizing each other's rankings. It will show content gaps relative to your specific competitors rather than keyword categories. It will note which of your existing pages qualify for AI overview inclusion and which ones don't and why. It will identify Core Web Vitals problems by page type, segmented for the traffic patterns that actually matter for your domain.

A weak audit surfaces the same 15 issues every automated SEO tool flags by default: missing meta descriptions, slow image loading, duplicated H1 tags. These are not wrong observations. They are surface-level observations that a competent in-house team would have caught already.

**The follow-up question.** Ask how they would prioritize fixes given your specific business goals. Agencies with real strategic judgment can rank issues by revenue impact. Agencies without it hand you a severity-sorted list from their audit tool. [OnyxRank's free audit](/free-audit) shows what a revenue-prioritized analysis looks like, delivered within 48 hours.

Days 8 to 10: The Content IQ Test

Request a sample content strategy for one of your priority topic clusters. Not a finished piece. A strategy document showing how they would approach a 5 to 10 page cluster in your space.

**What you're testing.** Can they think in content architecture, or do they think in individual posts?

The best AI SEO agencies in 2026 approach content at the cluster level: a pillar page that establishes topical authority, supporting subtopic pages that cover search intent variants, and structured FAQ content that qualifies for AI overview inclusion. If the strategy they present is "write one blog post per week about related topics," they don't understand how organic search compounds authority over time.

**Three specific things to evaluate:**

Do they mention AI overviews or GEO optimization? Generative engine optimization, the practice of structuring content to earn citations in AI-generated search results, is no longer optional for competitive domains. Agencies that don't raise it unprompted are operating on a 2022 playbook in a 2026 environment. Ask them directly and observe how they respond.

Do they address E-E-A-T for your domain type? A healthcare SaaS, a direct-to-consumer supplement brand, and a B2B cybersecurity company need fundamentally different authority-building approaches. If the content strategy treats every domain the same, the agency doesn't understand how Google's quality guidelines apply by industry and business model.

Do they distinguish between traffic volume and search intent? A keyword with 10,000 monthly searches from people in research mode is worth less to most businesses than a 200-search keyword from someone ready to evaluate vendors. Agencies that design content for conversion paths rather than impression counts are thinking about your business, not their deliverable count.

Days 11 to 14: The Accountability Structure Review

Two questions to ask before any contract conversation:

**Who is actually working on your account?**

Many agencies pitch with a senior strategist, assign a junior coordinator after the contract is signed, and give that coordinator 30 to 40 active accounts. Ask for the name, background, and current caseload of the person who will own your account day to day. If they won't answer that question before signing, they won't be transparent after.

**What does reporting look like, and how fast does data move?**

The gap between "we send monthly reports" and "you have a live dashboard" is enormous in practical terms. Monthly reporting means you discover a traffic problem 4 weeks after it started. Real-time reporting means you know within 48 hours and can respond before the issue compounds.

Ask to see a sample dashboard or a recent client report from a comparable account. Look specifically for revenue attribution. Does the reporting connect organic traffic to pipeline or revenue events? Or does it stop at sessions and keyword rankings? Agencies that can't attribute revenue during the sales process usually can't do it during the engagement either, because they haven't built the infrastructure for it.

The Comparison Every Buyer Needs

|---|---|---|

After running this two-week evaluation with multiple agencies, a consistent pattern emerges among the ones worth the retainer.

**They separate strategy from execution.** The account strategist sets the direction. The production system handles scale. Agencies where strategy and execution are handled by the same person at the same time can't grow accounts without diluting strategic quality. The best ones have built systems that let the human judgment layer stay focused on decisions, not deliverables.

**They treat AI search as primary.** Agencies still treating Google AI Overviews as a new or experimental feature are a full cycle behind. The best agencies have already embedded structured content formats, FAQ architecture, entity coverage, and citation tracking into their default workflow, not as an add-on.

**They tell you when something isn't working.** An agency that proactively flags underperformance and proposes a pivot is worth more than one that continues billing while results stagnate. Ask directly: "What do you do when a content cluster doesn't rank after 90 days?" A specific answer is a good sign. Silence is not.

How to Use This Framework

After two weeks of this protocol, you'll have answers to three questions that proposals can't give you: Does this agency understand my business? Does their audit quality match their pitch? Is their accountability structure real or cosmetic?

If all three check out, you have enough information to sign with confidence and set clear deliverable expectations from month one.

If any of the three fails, you've saved yourself a six-month retainer and the compounding cost of time lost.

OnyxRank is designed to pass every stage of this evaluation. Our preliminary audits go deeper than most agencies' full onboarding reports. Our reporting is live from day one through a client dashboard, not a monthly document. Every account is managed by a strategist with a defined caseload, not a coordinator handling 40 clients simultaneously.

[Review our engagement model and pricing tiers](/pricing) to understand exactly what each level includes, or [start with a free audit](/free-audit) as the first concrete stage of this evaluation. What we surface in 48 hours will tell you more than any proposal.

Frequently Asked Questions

**How long should SEO agency onboarding take before results start moving?**

A well-run agency completes technical onboarding in the first two weeks: site access, baseline audit, tracking setup. Strategy alignment occupies weeks 3 and 4. Content production and link building should be active by month 2. If an agency says it takes 3 months to onboard before any work begins, the process is too heavy and something is being used as cover for slow starts.

**What should I ask to evaluate an agency's AI overview expertise?**

Ask: "How do you optimize content to appear in Google AI Overviews and ChatGPT citations?" A strong answer describes direct-answer content structure, FAQ schema, entity coverage in topic clusters, and a monitoring process for citation rate. A weak answer describes standard SEO with "AI" added to the framing.

**Is a lower-priced SEO agency worth considering?**

Budget is a real constraint. Agencies under $1,500 per month for full-service SEO typically operate at a scale that limits meaningful strategic attention per account. If budget is constrained, a focused engagement on a single channel (technical SEO or content strategy, not both) at a credible agency consistently outperforms a full-service retainer at an underpowered one. See [OnyxRank's pricing tiers](/pricing) for how scope adjusts by investment level.

**What is the biggest mistake companies make when evaluating SEO agencies?**

Hiring based on proposal quality instead of judgment quality. Proposals are sales documents optimized for persuasion. Audits, strategy calls, and sample work reveal how the agency actually thinks. Weight the latter categories more heavily than the former.

**How do I know if my current SEO agency is underperforming?**

If your agency cannot connect organic traffic to revenue, cannot explain the cause of your last significant ranking change, and does not proactively surface issues before you notice them, those are structural accountability failures rather than isolated incidents. The evaluation protocol above applies equally to assessing a current agency as it does to evaluating a new one.

---

Two weeks of structured evaluation costs almost nothing. Six months with the wrong agency costs more than the retainer because it costs the compounding time you could have been building real organic growth.

The protocol here isn't designed to make agencies fail. It's designed to find the ones that are genuinely ready to answer hard questions before the contract begins. Those agencies exist. OnyxRank is one of them.

[See how we approach each stage of this evaluation at our pricing page](/pricing), or [request your free audit](/free-audit) and use the results as the first data point in your evaluation.