I used this approach to assess multiple products including a mobile camera and a wireless network configuration tool. The outputs of this process influenced the product by identifying areas for improvement and to make the necessary changes prior to release to customers.
As designers and not direct users of their enterprise software, we had a hard time understanding the common workflows. We used this approach to facilitate conversations with the client to identify the key worklows. Once we understood them we collabortively evalutated each workflow and measured the experiences and prioritized by the most severe.
This technique guided the design team first learn the product and its value, to get in the mindset of the users. Then it was used to helpo the product team and ux team identify areas that where our users could benefit most.
Starting a new project is one step. However, you'll need to think through two things - first, what best practices (heuristics) you'll be using and second, What scale you will measure the insights by. Both are important to sucessfuly completing a project.
You'll also need to install the chrome extension from the Google Webstore, which can be downloaded from the project settings screen or the webstore direct. The extension works with the chrome browser to capture screens where you will add your measurement. This product works only with Google Chrome (mobile or desktop).
No more saving screen captures, adding annotations, reviewing it, more editing and making it look pretty... We estimate a time savings of 50% or more.
Customize your evaluation criteria including the "rules of thumb" or the scale of measure to fit your needs - mobile, desktop or in-person experiences.
Connect with other experts from our community. Not only that though, find people with the expertise you seek e.g. by industry or digital channel to jump-start value from our community.
If you're looking for better examples of "rules of thumb" to measure User Experience by, we may have what you're looking for. You can share your lists, and others can share theirs.
It's flexible and can be task-based to organize your report and target high-priority areas (which we recommend). Or you can use it to do side-by-side comparisons with competitors, or whatever...you decide.
Having experts perform a product evaluation in an Iterative design approach can improve quality and reduce risks. Utilizing this approach (along with other methods) can provide added levels of insurance against costly issues after the fact. It can cost >30x to fix an issue after it goes live.
In product design we should be applying multiple methods of evaluation and not just one. There is no substitute for putting your product in front of your customers, but having experts evaluate & provide actionable recommendations adds additional value. But don’t stop there, use other techniques layered onto your design to ensure greater success.
Often times small teams use this methodology of a "heuristics evaluation" to jump-start learning about an online product or service, and/or create a baseline. Evaluate what works and what is not working at the start of an engagement and team-storm it.
You can use this approach to measure the current state of a product or service that is "in-process". It’s important to know where you’re at to truly measure change. This is best done by small group of people that were NOT part of the design of what is being evaluated. This could be done in advance of upcoming user research or a review with an internal group. This approach takes less time to setup and execute.
For existing products and services, a team can use this method to investigate and plan our future releases. For example, identify the low-hanging fruit which are easier to fix, and move them into the release. Or, work with development to plan out more complex challenges that were discovered using an XLS.
A common challenge raised against using heuristics is that it takes multiple resources to perform the evaluation which drives up costs and it’s not in the budget or timeline. With this tool however, we've reduced the time and effort by 50% or more.
Another challenge brought against using heuristics is quality where issues get missed or are overlooked. This just reaffirms our position to use multiple experts (we suggest 3) and to hire experienced people. We've added to our product the ability to find experts by level of experience, domain, and/or channel e.g. mobile, desktop etc… Often small teams cannot afford really experienced people, now you can hire them for a few hours and it won’t break the budget.
Using "rules of thumb" or best practices (also called Heuristics) mimic how human's make decisions already. "Rules of thumb" are things we know to work from our experiences. For example we could have "rules" to guide us in designing a Landing page from what we know works with calls to action or clear messaging, as examples. Then we would measure a Landing page by those rules.
From our own life experience, "when we hire experience, every dollar is well spent". Having an impartial team of experts who have experience in whatever domain you're evaluating (a digital channel, industry verticals...) will move faster and deliver quality insights. We're working on helping teams find people based on their experience within our online community.
This approach is not new, we just made it faster. This tool allows product evaluations to be done by multiple people and in less time with simple features that allow you to get back to the process of creating quality services.
For clients this method helps reduce the subjective opinions from the design process since you're using tried and true "rules of thumb" that everyone has agreed on and measure against. Remove the opinions from your design process and incorporate more objective “rules of thumb”. We’re provided a basic set, but you can customize or add your own.
It is highly recommended that evaluations target specific activities that are important to your users. If your evaluation is too broad it can become less meaningful. Our tool has simple features that allow you to organize your findings based on tasks.
|Active Projects||3 Active Project|
|Reports||$8 / report|
|Google Chrome Extension|
|View Executive Summary|
|View Example Report|
|Customize “Rules of thumb” and Scales of measure|
|Invite contributors to your project|
|Export/Download project report(s): Omnigraffle, PDF, XLS||Pay as you go
Purchase report(s) individually $8.00 / per report
|Get Started FREE|