I have literally nothing of value to add to this conversation (which won’t stop me), but, the current testing that we provide I feel is very high quality and requires reading and understanding the underlying course material AND some experience in the areas / screens being tested. The team that works in this area spends a lot of time making sure the testing is relevant and accurate by working with the subject matter experts to make sure it is (support, consulting, development, etc). I know that sounds like a plug, and it is, but, I really mean it. They do a great job. The tests are based off of the related Embedded Education course of the same name and sometimes application help which requires you to go to the screen in question, click on a field, then go Help > Application Help to bring you to the topic.
Support has to take delta tests every release, and it takes much more time now for me to go through the test than it did in much much earlier very olden times. That’s not a negative as it forces us to slow down, really digest the material, poke around in the application to eliminate answers it couldn’t be, validate the answer we are selecting, etc.
In much much earlier very olden times, our tests were a bit more_fun_ which wasn’t completely amazingly 100% great if one wanted to validate that they had a deep understanding of the material–which is the ultimate goal right? A deeper understanding of XYZ thing so you can do XYZ thing A couple of my favorites from those much much earlier very olden times:
From a BAQ Report test:
From a security test:
I’d much rather have tests that push us to dig into the application and reread the material than simpler/more superficial one that can be completed by keyword searching the guide/eliminating the fun answers It makes for more knowledgeable support resources, consultants, and customers which is a very good thing
That said, there is a greater than 0% chance that the test says that XYZ answer is incorrect but it is actually correct. If you are really sure that is happening, just let Support know and we’ll get it squared away if it is really the case.