vaadin / testbench Goto Github PK

Originally by Jani Laakso

---

Originally by Jani Laakso

---

---

Imported from https://dev.vaadin.com/ issue #860

Originally by Jani Laakso

---

This side-effect must be removed because it changes AUT Server / Client state.

---

Imported from https://dev.vaadin.com/ issue #866

Originally by @jojule

---

Just assume that the user has installed JRE himself (do not bundle)

---

Imported from https://dev.vaadin.com/ issue #1297

Originally by Jani Laakso

---

ATF Server is developed separately from Toolkit. We should package it as it's own WAR. This enables branding for our customers also.

Issue: how to move ATF.js from Toolkit into ATF Server package?

---

Imported from https://dev.vaadin.com/ issue #888

Originally by Jani Laakso

---

While doing recordings it's required that user may minimize or even hide ATF Control Panel.

In it's minimized form it should consume as little space as possible but still

• on recording, provide feedback on any recorded user event, so user sees that recording works appropriately
• on playback, provide e.g. 3 lines of textarea for displaying playback messages

---

Imported from https://dev.vaadin.com/ issue #858

Originally by @emarc

---

Sprint 1 (#1250) Simplicity over features!

Mockup should be done by 10.1 afternoon, specific tasks after that. done

Some notes:

• Server: results (and possibly test cases) should be sorted latest first done
• ~~ Player/Recorder: simplify, remove unnecessary buttons~~ done
• ~~ Player: stop() should produce "Click play to continue" or blinking play-button ~~
• ~~Server: test case "URL" -> "URL (run test)" ~~
• ~~ Server: Record TestCase (-> enter url -> (default: restart app) -> record ), + Create empty TestCase ~~ done
• ~~ Server: login screen, any user/pwd accepted for first user, any user kan create new users (optional: "keep me logged in...") ~~ done
• ~~ Server: help -link (to manual.pdf in war) ~~
• ~~ Server: results-table should have failed/passed icons ~~ done (style instead)
• ~~ Server: results table could have NEW indicator: user.lastlogin < result.date ~~ done

Originally by @jojule

---

---

Imported from https://dev.vaadin.com/ issue #1313

Originally by @jojule

---

Just leave out the JRE (use the one bundled with the server)

---

Imported from https://dev.vaadin.com/ issue #1296

Originally by @mstahv

---

Compatibility matrix is in Google Docs use this invitation to edit/see.

For TK4 no matrix exists, but status with compons is pretty much the same. (Drag'n'Drop's and scrolling bugs)

TODO

• ~~ make~~ fill component matrix to make sure testing then all throughout
• ~~ tune ~~ either TT or components to make all possible components work with TT
• document those that still does not (like rich text editor)

Originally by @samie

---

Based on principle "Simplicity over features":

Simplify the main veiw and leave out the result details panel as described in
http://toolkit.intra.itmill.com/trac/itmilltoolkit/attachment/ticket/1258/Screenshot%20-%2010.1.2008%20%2C%2015_03_05.jpg

All information relevant to tester should be mainly visible in results-list.
Additional information (i.e. details) could open in separate popup or in html-format
into separate window.

Currently details-panel is visually confusing and selection in results-list does not bring any new information to user (extra click only).

---

Imported from https://dev.vaadin.com/ issue #1291

Originally by @jojule

---

---

Imported from https://dev.vaadin.com/ issue #1300

Originally by @jojule

---

---

Imported from https://dev.vaadin.com/ issue #1310

Originally by @jojule

---

Nyt assertit hiiren tehdään hiiren keskimmäisellä näppäimellä. Pientä käytettävyysongelmaa eri pikakomennoissa. Pitäisi tarkistaa tarkemmin mitkä olisivat parhaimmat pikanäppäimet. Safarissa ei toimi middle-button (alt+left button toimii siellä).

---

Imported from https://dev.vaadin.com/ issue #1308

Originally by Jani Laakso

---

"Recorded testcases" table is not automatically updated. Same seems to be with "Results" table. Usually reload helps.

---

Imported from https://dev.vaadin.com/ issue #867

Originally by @mstahv

---

select type nodes need special handling in digest builder

---

Imported from https://dev.vaadin.com/ issue #1280

Originally by Jani Laakso

---

Check that current packaging is fine with first customer case (-removed- -removed-).

Add basic documentation for

• howto deploy ATF Server WAR, configure Toolkit applications (web.xml)
• howto setup AUT host environments
• test recording
• test playback (manually)
• scheduling automated test playbacks
• browsing test results and their contents (raports)

---

Imported from https://dev.vaadin.com/ issue #862

Originally by @jojule

---

---

Imported from https://dev.vaadin.com/ issue #1305

Originally by @jojule

---

---

Imported from https://dev.vaadin.com/ issue #1314

Originally by @jojule

---

---

Imported from https://dev.vaadin.com/ issue #1298

Originally by @jojule

---

---

Imported from https://dev.vaadin.com/ issue #1295

Originally by @jojule

---

---

Imported from https://dev.vaadin.com/ issue #1319

Originally by Jani Laakso

---

For first customer deliverable (-removed- -removed-), ensure that "typical" use cases may be tested succesfully.

Please write new tickets for the UI components that do not work. We'll gather these are limitations within product documentation..

Also, ATF should work in a robust way. Browsers do not hang or get into situation where they need to be killed, ATF Server always receives test results.

---

Imported from https://dev.vaadin.com/ issue #864

Originally by @jojule

---

If you move mouse, it changes

---

Imported from https://dev.vaadin.com/ issue #1304

Originally by @jojule

---

---

Imported from https://dev.vaadin.com/ issue #1306

Originally by @jojule

---

Playbackissa lopputuloksena: INTERNAL_SERVER_ERROR. TT-server build rikki - classpathista puuttuu joku HTML tms.

=> Ask jani about the issue

---

Imported from https://dev.vaadin.com/ issue #1318

Originally by Jani Laakso

---

---

Imported from https://dev.vaadin.com/ issue #1257

Originally by @jojule

---

---

Imported from https://dev.vaadin.com/ issue #1312

Originally by Jukka Viitala

---

Deleting test case which belongs to test suite should delete it from test suite also, or warn user before deletion. Delete might also be disabled until no test suite contains the test case.

---

Imported from https://dev.vaadin.com/ issue #878

Originally by Jani Laakso

---

---

Imported from https://dev.vaadin.com/ issue #1256

Originally by @mstahv

---

only implemented in TK5
TK4 has different mechanism for pid generation, but might still be a useful feature

---

Imported from https://dev.vaadin.com/ issue #1289

Originally by Jani Laakso

---

Asserting does not work (tested with feature browser)

• With Label component
• With caption and content of DateField (when style is 'default' or 'text').

Originally by Jani Laakso

---

Before first deployment for customer (-removed-) we should consider making ATF Server somehow more personal for our customer

• add customer logo

---

Imported from https://dev.vaadin.com/ issue #859

Originally by @jojule

---

See details in:

http://spreadsheets.google.com/ccc?key=pUJJjy8ZqiLmCmg02fT52fQ&[email protected]&t=6782663811160574378&guest

---

Imported from https://dev.vaadin.com/ issue #1315

Originally by Jani Laakso

---

---

Imported from https://dev.vaadin.com/ issue #927

Originally by Jukka Viitala

---

All timestamp fields in database record date correctly, but the time portion is allways zeros. Only this makes times go ok in hsqldb: TIMESTAMP DEFAULT CURRENT_TIMESTAMP

---

Imported from https://dev.vaadin.com/ issue #877

Originally by @mstahv

---

• add message and add comment combined
• ATF-> TT logo,
• logosta linkki TT serveriin , serverin avaus nappi veks
• clear test case nappi pois
• test report nappi pois
• alavetovalikko pois
• minimize nappi toimimaan
• pause pauses both record and playback, combine with record and playback
• [x ] make pause work with playback mode
• possibly add step for playback mode

Originally by Jani Laakso

---

---

Imported from https://dev.vaadin.com/ issue #868

Originally by @jojule

---

---

Imported from https://dev.vaadin.com/ issue #1307

Originally by @jojule

---

---

Imported from https://dev.vaadin.com/ issue #1316

Originally by @samie

---

Cannot run ATF test cases from server. No JS errors, but test case is not started. Recording works fine.

Environment:
Apache Tomcat 5.5.25 on http://localhost:8080/
ATF Server 0.9.2
Firefox 2.0.0.8

Full environment is zipped on CD.

---

Imported from https://dev.vaadin.com/ issue #1057

Originally by @jojule

---

---

Imported from https://dev.vaadin.com/ issue #1299

Originally by @jojule

---

---

Imported from https://dev.vaadin.com/ issue #1301

Originally by @jojule

---

---

Imported from https://dev.vaadin.com/ issue #1320

Originally by @mstahv

---

TODO:

• Testing Tools JavaScript API
• remove
  • stepFast (function removed)

---

Imported from https://dev.vaadin.com/ issue #1292

Originally by Jani Laakso

---

Think of use case, come up with required data to show and implement one (or two) raport views.

---

Imported from https://dev.vaadin.com/ issue #861

Originally by @jojule

---

---

Imported from https://dev.vaadin.com/ issue #1303

Originally by Jani Laakso

---

ATF Server task scheduler GUI

Note

• AUT Server means Application Under Test Server, e.g. -removed- or -removed-
• AUT Client means Applicaiton Under Test Client, e.g. Windows test host X

Task scheduler allows tester to run testcases/suites automatically against specific AUT Server and AUT Client. Tasks may be reoccurring meaning they are executed once per day or they can be executed only once on a specific date and time.

Proposed components

Table "Tasks"

• list of all scheduled tasks
• columns are
• name (String)
• description (String)
• enabled (boolean)
• once execution time (Date)
• reoccurring execution time (hour:minute)
• AUT Server (URL)
• AUT Client (IP)

Table "Selected task"

• list of selected task's testcases and testsuites
• columns are
• execution order (integer, starts from 1)
• testcase/suite

Table "Available testcases/suites" columns are

• list of all testcases/suites that can be added to "Selected task" table
• columns are
• testcase/suite

Proposed layout and controls

Add new tab called "Task scheduler" to main page's first tabsheet.

For "Task scheduler" add following components

Add "Tasks" table

• "Tasks" columns should be editable using Calendar and Label components

Add "Selected task" table

• "Move selected testcase/suite up (execute earlier)" button
• "Move selected testcase/suite down (execute later)" button

Add "Available testcases/suites" table

• "Add selected testcase/suite to "Selected task" table" button
• "Remove selected testcase/suite from "Selected task" table" button

---

Imported from https://dev.vaadin.com/ issue #869

Originally by Jani Laakso

---

ATF Server

• scheduler view
• job thread
• shell integration (like in SPCAM project)
• scripts for Windows platform

• start firefox
• kill all firefoxes

---

Imported from https://dev.vaadin.com/ issue #863

Originally by @jojule

---

---

Imported from https://dev.vaadin.com/ issue #1317