-
The link from VS to MTM should be less unexpected
-
-
Figure: This will open a data entry form. Right? Wrong. I get
a real shock when I click this button and it opens up a big
new black application
-
-
Figure: This is the icon and text I would like to see on that
button
-
(if these issues may not be serious enough to list here?but
anyway)
Why is the branding (the black look) so different from VS ?
Where is the green icon?
-
-
Figure: I think it would be better to put the green icon that
is associated with VSTT here
-
- Figure: This is the icon that I would like to see above
Black is the new theme right?
-
-
Figure: Is the branding for VSTT black? But then it switches
to blue!
-
- Figure: This is the icon that I would like to see above
-
- Figure: Which app do I have open?
-
- Figure: This is the icon that I would like to see above
-
- Figure: The splash screen is missing the green icon
-
- Figure: This is the icon that I would like to see above
-
Surely the whole of VS, should be using the *same* framework for
a dialog
-
-
Figure: Not resizable - really annoying. I expect to double
click and it resizes to the top and bottom of the screen
-
- Figure: Resizable - This is good
-
Test and Lab Manager - Prompt to create a bug on failure
The test recoding features of the Test and Lab manager are
fantastic; however, the ability to create a bug is rather
hidden.
-
- Figure 1 - How do I create a bug?
-
-
Figure 2 - The performance graph icon is the button you use to
create a bug
-
- Figure 3 - Creating a bug from Team Web Access
The icon should be consistent with Team Web Access.
Also, when a test step fails, and the user presses "Save and
Close" they should be prompted:
"One of your test steps have failed and you have not filed a
bug. Do you want to create one now?"
[Yes] [No]
-
TFS 2010 Test - MTM UICrazy Hyperlink (little one)
A quiz for you? What do you think clicking this hyperlink will
do?
-
-
Figure: Have a guess on what clicking this hyperlink will do?
-
- Figure: Copy to the clipboard. Of Course!
Seriously it should be a grey text box that is enabled for
copying the text
-
We need more CodedUI tests in every VS solution we review. Today
they are still not mainstream.
I am not sure exactly what I don't like, but when brand new
users think it has started when it has not.... and when new
users don't know what to do when they are 'done' recording...
and then after users click 'Generate' they are unsure what has
happened, then I know there is a problem.
Here are some things I
*might*
do.
-
-
Figure: Add "Finish" flag icon on right button 'Generate Code'
-
-
Figure: Add a "Cancel" button next to 'Add and Generate'
-
-
Figure: A red icon, tells users it is recording (note that it
is currently stopped). We need animation added so it is
clearer.
-
-
Figure: I think the Performance Wizard has a better 'feel'
with ideas to copy, plus we should be giving users a
consistent experience
-
-
Figure: Adding the spinning icon to the 'Coded UI Test
Builder' is important (as it gives the feeling of the
recording)
-
-
Figure: Good example - Adding a CodedUI wizard for the first
time - like the Performance Wizard, would be a great
improvement
-
-
Figure: Bad example - more info for the first time user + it
is inconsistent with the Performance Wizard
The wizard should use the example of the calculator e.g the user
could follow it to record Calc (2+2=4) successfully.
Last Resort: If you don't agree with any of the above, can we at
least have a hyperlink to a tutorial (in the above dialog)
-
Microsoft Test should support Chrome
Suggestion - not very important – but thought I would
mention it.
-
-
Figure: Good example – Visual Studio Test supports
Firefox 4 (as does Telerik Test)
-
-
Figure: Bad example – Visual Studio Test does not
support Chrome (but Telerik Test does)
Note:
Informal conversations with Microsoft tell me that they wont be
doing this anytime soon.
They are looking out for partners that can plug this gap by
writing a Chrome plugin.
-
TFS 2010 Suggestion - "Ordered Tests" should be renamed
When I ask a class what they think "Ordered Tests", they never
guess it
-
-
Figure: Rename to something else E.g. "Set of Tests" or "Group
of Tests" or "Test Set" or "Test Group"
-
When you are demoing web tests and waiting at the end?I like to
fill the 'white space' with something intelligent every now and
then.
Here is the explanation that should be sitting under a
'More >'
button.p>
When you go from one page to another ?the parameters need to be
passed. Here VS is looking for them by comparing the requests.
More Information
Many dynamic parameters would cause your Web performance test
playback to fail, since it would be different every time that
the test is run.
E.g. a session ID (which changes by default every 20 minutes).
VS looks for dynamic parameter values set:
- in cookie values.
-
in hidden fields on HTML pages, such as ASP.NET view state
(Pretty clever eh?),and
- as query string or form post parameters.
-
-
Figure: Give me more information to read - since I am always
looking at this dialog box
-
Help me know how many Tests will be run (little one)
-
- Figure:Add "3"
-
- Figure:Add "55"
-
Web Tests vs Coded UI tests
The UI for Web Tests vs Coded UI tests is very different. The
user experience makes you feel it comes from 2 different
companies.
-
-
Figure: I want to select this text and create a validation in
the browser
When recording a web test, I would love a visual aid when in the
browser (like the bulls eye in coded UI tests) to do things
like:
- select the text
- to check an image is on the page
- to check it loads within a certain time
-
-
Figure: Do we want to bring the 'bulls eye' to Web Tests so
users get a more consistent experience?
-
-
- Figure: Today we click, Build | Build Solution
-
-
Figure: Move these 3 to the top - and make consistent with the
Build menu e.g. Test | Test Solution
-
-
-
Figure: Telerik Test allow you to insert a 'Manual Step'
Let me tell you why this is so cool by telling you what I told
them. I said to add some tooltip text, that talks about what a
great feature this is eg.
Manual Steps are very useful to enable Developers and Testers
to work together during a sprint.
The goal of a successful sprint (if you are doing Scrum) is to
have the sprint fully tested by the end of the sprint.
Normally this is hard, but not with 'Manual Steps'.
Insert a 'Manual Step' to enable you to have a tests for
incomplete User Stories.
Say you have the major items complete, such as the first and
last part of the User story is working (but something is
missing in the middle - eg. the status field needs to be
manually set) then insert a 'Manual Test' with text such as:
'Now manually update the status field. Joe will be making this
automatic later.'
Anyone else agree?
-
Why can't it be a nice normal extension? Or at least have
version numbers.
-
-
Figure: Weird - I am missing a green tick? Mmmm...I thought I
had this installed
-
-
Figure: So I hit the download button?oh?I do have it
installed? What did I do wrong?
-
-
Figure: I thought I had finished the old way! ...anyway lets
uninstall it
-
-
Figure: Which is the latest file? It is
*not*
the largest (as I can see by date)? and there is no version
number in the file? Grrrr! So I will install the latest date
-
-
Figure: now I have it installed? But after all that - no green
tick
And no version number to see if it is newer.
-
I believe any of my changes should be more visible.
To that end:
- Bold my settings
- When I close and reopen - keep my node open (expanded)
-
-
Figure: If I close and reopen this .webtest VS will not open
where I was
-
(Happy to be corrected - there might be a much better way to
debug)
-
-
Figure: I am trying to understand the differences between
'WebTest1' and 'WebTest2'... so add menu item 'Open Results in
Excel'
-
-
Figure: After clicking a menu item like 'Open Results in
Excel' I would like to see this
-
(Happy to be corrected - there might be a much better way to
debug)
-
-
Figure: I am trying to understand the differences between
'WebTest1' and 'WebTest2'... so add menu item 'Compare Results
in Excel'
Then pop a dialog to ask 'Select Test to compare' and open
Excel.
-
-
Figure: After clicking a menu item like 'Compare Results in
Excel' I would like to see this (with Red on the errors) and
the normal background colours to show the differences (added,
deleted and different rows)