rlgomes / dtf Goto Github PK

Thinking of making the generated documentation look nicer and one idea is to generate github wiki notation directly so it can look very similar to the rest of the wiki documentation, but better yet would be to generate the documentation into some form of docbook xml and then process with xslt that into the wiki format so other xslt's can be created for generating into other formats in the future.

the idea is that while the component is running you'd be able to just do ctrl-d (probably not that shortcut ;) ) and you'd go into debug mode and be able to trace what is going on without having to attach to the DebugServer using telnet. It should be pretty straightforward with jline withough having to create much code or maintain anything complicated.

Need to create a good tutorial on using the formatter with the Firefox selenium plugin while developing a real world testing scenario.

Currently the open source version has a few known bugs in the parallel execution of the testscript tag. I will be applying a patch from the Yahoo branch soon but just wanted to track this here. With that patch I will also make a concurrency attribute available on the testsuite tag which will give DTF script writers the feature that allows them to specify the level of concurrency within a testsuite.

The idea is that you're using propreties sometimes you would like to create a stream of data that is structured in an XML/JSON format and this could be done using the existing streaming feature in DTF but the missing piece is how do we generate the structured data. For generating structured data I'm creating a separate library called pangu that will allow me to do this and then I'll implement this feature using that library.

The issue came up when writing a tutorial on how to test the Yahoo Web Search APis and when I tried to apply the simple expression:

//Result/ClickUrl/text()

to the XML:

<Title>Secure source code hosting and collaborative development - GitHub</Title>

<Result>
    <Title>GitHub - Wikipedia, the free encyclopedia</Title>
    <Summary>GitHub is a web-based hosting service for projects that use the
        Git revision control system. It is written using Ruby on Rails by
        GitHub, Inc. ...</Summary>
    <Url>http://en.wikipedia.org/wiki/GitHub</Url>
    <ClickUrl>http://en.wikipedia.org/wiki/GitHub</ClickUrl>
    <DisplayUrl>en.wikipedia.org/wiki/GitHub</DisplayUrl>
    <ModificationDate>1276930800</ModificationDate>
    <MimeType>text/html</MimeType>
    <Cache>
        <Url>http://uk.wrs.yahoo.com/_ylt=A0PDB2JEVDFM5QsAD1fdmMwF;_ylu=X3oDMTBwZG5hOWwzBGNvbG8DdwRwb3MDMgRzZWMDc3IEdnRpZAM-/SIG=15qtt8cfi/EXP=1278387652/**http%3A//66.218.69.11/search/cache%3Fei=UTF-8%26appid=dtftest%26query=github%26results=3%26u=en.wikipedia.org/wiki/GitHub%26w=github%26d=LtB21bZfVEFB%26icp=1%26.intl=us</Url>
        <Size>62894</Size>
    </Cache>
</Result>

<Result>
    <Title>Help.GitHub - Welcome</Title>
    <Summary>Here we have compiled many guides to help you set up and use
        git and GitHub. ... GitHub Support – Resolve issues with GitHub or
        get help with basic git issues. ...</Summary>
    <Url>http://help.github.com/</Url>
    <ClickUrl>http://help.github.com/</ClickUrl>
    <DisplayUrl>help.github.com/</DisplayUrl>
    <ModificationDate>1277708400</ModificationDate>
    <MimeType>text/html</MimeType>
    <Cache>
        <Url>http://uk.wrs.yahoo.com/_ylt=A0PDB2JEVDFM5QsAElfdmMwF;_ylu=X3oDMTBwZ2dpZ2ZkBGNvbG8DdwRwb3MDMwRzZWMDc3IEdnRpZAM-/SIG=15et22pr6/EXP=1278387652/**http%3A//66.218.69.11/search/cache%3Fei=UTF-8%26appid=dtftest%26query=github%26results=3%26u=help.github.com/%26w=github%26d=QEZwlrZfVErp%26icp=1%26.intl=us</Url>
        <Size>14876</Size>
    </Cache>
</Result>

I found that transformer doesn't handle the namespaces correctly and had to work around it with the following UGLY expression:

//[local-name()='Result']/[local-name()='ClickUrl']/text()

There must be a way to handle the namespaces correctly or allow the end user to identify namespace mappings like so //ns:Result/ns:ClickUrl,[ns=>xxxx].

When this is fixed I should update the tutorial at http://github.com/rlgomes/dtf/wikis/searching-for-a-simple-term

Preferably using hudson (https://hudson.dev.java.net/) and running the hudson host off of amazon ec2. I'm thinking of setting up the ec2 instance and having checkin hooks start up the ec2 instance and then pause it once down to reduce the cost of having the instance available.

This already exists in a prototype branch in the Yahoo internal version but I will be seeking approval to bring this into the open source version soon. I may also open a discussion about this feature in the community if others show interest before applying the existing patch and instead make the feature community driven.

already opened issue with github to see if I can get this fixed quickly http://support.github.com/discussions/repos/4167-wiki-format-broken but I think I'm going to have to actually fix this myself by pulling the gist code directly into the wiki format (horrible solution to what was a very nice use of the gists to keep 1 copy of my code snipplets).

If we put some of the generated documentation into the xsd elements with a simple

xs:annotation
xs:documentationblah blah blah/xs:documentation
/xs:annotation

then eclipse will present that documentation during auto completion while editing XML.

simple addition that needs to be made for my own tracking of results and state of the trunk

I have had this idea for quite a while and never had enough time. Basically the idea is to have support for the selenium testing framework within DTF by being able to replay the same pre-recorded tests from something like the Firefox plugin within DTF from multiple nodes at the same time.

The ability to take N behaviors pre-recorded with the Firefox plugin and then create a real world scenario of users hitting your system would be something that you could only achieve with the power of selenium to mimic user behavior on a browser and the being able to distribute that behavior from hundreds to thousands of simulated users at the same time.

some links:

• http://seleniumhq.org/

This needs to get fixed so we don't have reports such as the following:

http://rlgomes.github.com/dtf/results/html/alltests-fails.html

Hey would it make sense to support this? How hard would it be for me to add this to the framework? I want to try and get this in there and see if I can use it for work.

Rick

Its basically due to the fact that in the evaluate method the getOp1() is called and then the same method is called from the explanation() method which results in moving ranges forward by more than it should.

Already have a fix in the works but wanted to track this in an open issue for good practice.

Currently on some systems you need to set the property javax.net.ssl.trustStore to the right keystore manually in order for things to work. On some systems the default locations are not respected and the user needs to specify that property somehow. There should be at least documentation explaining on how to do this correctly.