Different evidence supports different claims
Documentation-based analysis
Uses current product information and published terms. It can identify capabilities and buying questions. It does not establish how a product performs in hands-on use.
Hands-on evaluation
Records the task, the environment and the result observed by a named evaluator. The article should explain the test scope and the limits of the findings.
The criteria behind a scored review
Fit for the stated use case
The reader, workflow and outcome the product needs to serve.
Workflow and usability
The steps, permissions and friction involved in completing the work.
Features and integrations
The capabilities and data handoffs relevant to the category.
Pricing and value
The billing basis, extra charges and cost of meeting the requirement.
Support and onboarding
The migration process, support routes and implementation responsibilities.
When a number is useful
Each criterion is scored from 1 to 5. A 1 means it misses core requirements for the use case. A 3 means it meets the requirements with material tradeoffs. A 5 means it performs strongly with clear supporting evidence.
Multiply the criterion score by its weight, add the results and round to one decimal place. If a criterion has not been assessed, withhold the overall score.
Editorial score
When a documented evaluation is complete, display one decimal place, “out of 5,” the assessment date and a link to the criteria. A missing evaluation is not a zero.
Customer ratings from another source stay separate from an editorial score. They need a source, review count and checked date of their own.
The publishing process
Define the reader and the task
Make the use case specific enough to compare options fairly.
Gather and date the evidence
Record what was observed, what came from documentation and what remains unconfirmed.
Explain the recommendation
Describe fit, strengths, limits and the next questions a buyer should ask.
Check and maintain the page
Review factual accuracy and disclosures. Recheck high-intent buying and pricing pages at least quarterly, and sooner after a relevant product change.
Commercial relationships have their own label
Affiliate links and paid placements must be identified where readers encounter them. Payment does not change an editorial score. A sponsored position must not look like an editorial award.
Read how Engage And Manage is funded or see the criteria in action in our HR software comparison.