14 Replies Last post: Aug 26, 2008 2:02 AM by rektide  
Tariq Beginner 2 posts since
Dec 19, 2007
Currently Being Moderated

Dec 19, 2007 12:16 PM

Selenium Grid with Selenese testsuite.html

Hi,

 

I have been using slenium RC for couple of weeks and now came across Selenium Grid. I have set up the grid successfully and the demo is working fine. I could not find documentation regarding linking grid with our already created testsuite.html. Can some one help me in this.

 

thanks

 

-tj

Philippe Hanrigou Pro 182 posts since
Oct 26, 2007
Currently Being Moderated
1. Feb 8, 2008 3:39 PM in response to: Tariq
Re: Selenium Grid with Selenese testsuite.html

Hi Tariq,

 

I have been using slenium RC for couple of weeks and now came across Selenium Grid. I have set up the grid successfully and the demo is working fine. I could not find documentation regarding linking grid with our already created testsuite.html. Can some one help me in this.

 

In theory you could build on Selenium Remote Control htmlSuite support to achieve this (http://selenium-rc.openqa.org/selenese.html). In practice I have not implemented a distributed test runner for html suites as these suites can become hard and cumbersome to maintain. I prefer writing the Selenium Test in Java/Ruby/Python... This said I will had support for html testsuites at one point, but probably not for the next release.

 

Cheers,

Philippe Hanrigou

http://ph7spot.com

David Beginner 10 posts since
Apr 12, 2007
Currently Being Moderated
2. Feb 14, 2008 1:44 PM in response to: Philippe Hanrigou
Re: Selenium Grid with Selenese testsuite.html

Hi Philippe,

 

Just wondering if you have any more of an idea as to when you may implement support for Selenese.  We have many html suites and they have worked well for us.  We have automated our process using ant and luntbuild (and a few bat scripts) and have a framework that works well for us so we don't really want to change things now. 

 

Selenium Grid really seems like the next logical step (as our suites take several hours to run in sequence).  As I mentioned I don't really want to have to change our entire automated framework in order to be able to plug into Grid, I would really like to just be able point our test suites to the grid. 

 

Just checking in to see if there are any plans to implement this anytime soon as it would be extremely helpful, I have gone through the grid demo and am extremely anxious to implement it in our real world environment.  Thanks for your time.

 

Dave

Philippe Hanrigou Pro 182 posts since
Oct 26, 2007
Currently Being Moderated
3. Feb 21, 2008 10:36 AM in response to: David
Re: Selenium Grid with Selenese testsuite.html

Hi Dave,

 

Just wondering if you have any more of an idea as to when you may implement support for Selenese. We have many html suites and they have worked well for us. We > have automated our process using ant and luntbuild (and a few bat scripts) and have a framework that works well for us so we don't really want to change things now.

 

Yes I have this on my radar and will implement it at one point. Realistically though this probably will not happen before 2 or 3 months unless somebody contributes a solution. I want to make sure that I provide more advanced grid management capabilities first (starting, stopping and restarting the remote controls through the console for instance). I expect the type of users that will want to run a HTML test suite on Selenium Grid to also be the type of users that do not want to mess up too much with the infrastructure and write their own automation

 

Selenium Grid really seems like the next logical step (as our suites take several hours to run in sequence). As I mentioned I don't really want to have to change our

entire automated framework in order to be able to plug into Grid, I would really like to just be able point our test suites to the grid.

 

This a very common and valid scenario. My plan is definitely to support this. Writing a HTML test runner is pretty trivial, but you also need to provide helpful report and insight on what is going on and why a test fails, which is less trivial. I would advise you to wait a couple on months / or convince somebody to contribute a solution if you cannot wait that long...

 

Just checking in to see if there are any plans to implement this anytime soon as it would be extremely helpful, I have gone through the grid demo and am extremely > anxious to implement it in our real world environment. Thanks for your time.

 

Thank you for your interest in Selenium Grid. Just give me a little bit of time

 

Philippe Hanrigou

http://ph7spot.com

David Beginner 10 posts since
Apr 12, 2007
Currently Being Moderated
4. Feb 22, 2008 8:25 AM in response to: Philippe Hanrigou
Re: Selenium Grid with Selenese testsuite.html

Philippe,

 

Thanks for the response. . .I am very happy to hear that this is still on the radar . . . 2 - 3 months would be fantastic!!  Even if it extends beyond that I am just happy that it is still planned work. 

 

I have looked into TestNG and may eventually try to move over to that framework, however, that is something I just don't have the time for right now (or in the foreseeable future) so knowing that I will most likely be able to use grid with my current test suites in the future is great!!! 

 

Thanks again for your response and your work on Grid, as I mentioned before I am very interested and excited to get this up and running in our environment.

Fredrik Wendt Beginner 5 posts since
Feb 19, 2008
Currently Being Moderated
5. Apr 23, 2008 4:58 AM in response to: Philippe Hanrigou
Re: Selenium Grid with Selenese testsuite.html

 

Hi Philippe.

 

 

I'm in the situation where the client needs this yesterday. The setup here looks like:

 

 

- maven web app with the main application

- a second web app with Selenium Core + HTML tests recorded with Selenium IDE

 

 

This is deployed on all developers machines (under the same domain - no XSS issue here essentially) and they are supposed to make sure all browser pass all tests before commiting. This is almost in place for JSUnit tests were the developer points his/her browser to a TestConductor (Grid Hub), submits aURL to where the testWebApp is deployt at the development machine and then waits a minute or two. During this time the TestConductor directs TestTargets (RC-similar) to run tests om the developer's machine and results are posted back to (and summarized) on the TestConductor.

 

 

I was hoping it'd be a nobrainer to have the same thing set up and working for Selenium. Apparently, there's a piece missing - then one you're working on (hopefully :). I'd like to know if there's work in progress, if it's thought thru but not in code yet, or if there are design issue not resolved yet.

 

 

Converting the HTML tests to something else is not an option since there's a non-programmer test QA department that needs to contribute and maintain tests.

 

 

/ Fredrik

 

 

Philippe Hanrigou Pro 182 posts since
Oct 26, 2007
Currently Being Moderated
6. May 1, 2008 12:13 AM in response to: Fredrik Wendt
Re: Selenium Grid with Selenese testsuite.html

Hi Fredrik,

 

was hoping it'd be a nobrainer to have the same thing set up and working for Selenium. Apparently, there's a piece missing - then one you're working on (hopefully . I'd like to know if there's work in progress, if it's thought thru but not in code yet, or if there are design issue not resolved yet.

 

I am sorry, I am currently focusing on providing convenient and robust support for running multiple IE and Safari browsers on a single machine without requiring virtualization. So I am afraid the HTML test suite parallel runner will have to wait a little bit more unless somebody else steps in.

 

Writing such a parallel runner would actually be quite simple and require very little Selenium knowledge:

 

  • You could leverage TestNG to get parallel runs as demonstrated in Selenium Grid java examples

  • You need to parse the test suite HTML (basically a 3-column-table with string values) and pass the Selenese command and parameters (as is) to the Selenium Java client driver.

 

Of course,as usual, the tricky part is providing meaningful and helpful test reports so that test failures can be easily investigated.

 

If anyone has the bandwidth to work on this, please contact me (http://ph7spot.com/about/contact_me), I will try to get you started.

 

Sorry I could not be of more help for the moment,

Cheers,

Philippe Hanrigou

http://ph7spot.com

slevy Beginner 3 posts since
May 5, 2008
Currently Being Moderated
7. May 6, 2008 5:24 PM in response to: Philippe Hanrigou
Re: Selenium Grid with Selenese testsuite.html

Just want to voice support for a parrallel test runner for HTML suites.  that would helpful to me indeed.  thanks!

rektide Beginner 6 posts since
Feb 18, 2008
Currently Being Moderated
8. Jul 7, 2008 1:26 AM in response to: Tariq
Re: Selenium Grid with Selenese testsuite.html

Work has been holding our Testers feet over an open fire for too too long and I finally got motivated this weekend to write a test driver for those poor people.  The idea is to let them use Selenium IDE to generate Selenese test scripts, then to feed these into a test runner that runs executes test suites in parallel.  I have most of the motor written up, the only thing missing is actually feeding the selenese to a hub.  I thought it would be a relatively straightforward mapping of cmd='s value into java Selenium member calls, but it turns theres a huge number of commands and the mapping is not even 1:1 between the Selenium java class and Selenium IDE.  This was an unexpected snag and I am unsure how best to proceed.

 

My current thought is to try to adapt the HTMLLauncher to do the actual test execution, but I have not started integrating it and have no idea about feasibility/what kind of impedence mismatch to expect.  At first blush it looks very simple; create a HTMLLauncher and do runHTMLSuite on it, but again I have not tried it yet.

 

The other missing component is providing useful information on test failure.  I figured I'd cross that road as I started digging into HTMLLauncher.

Volker Beginner 2 posts since
Jul 16, 2008
Currently Being Moderated
9. Jul 16, 2008 3:00 PM in response to: rektide
Re: Selenium Grid with Selenese testsuite.html

Hi,

 

I'm a total newbie with Selenium, especially Grid, so I might just be shooting in the dark here, but I'm in a similar situation in terms of what I'd like to achieve. From a quick look at HTMLauncher, it appears as if it requires the suite files to be hosted within the same server that runs the tests, but how should that work with Selenium Grid where I talk to the hub not an actual RC? My initial thought for a simple solution was to parse the Selenese files myself and pass the commands into an HttpCommandProcessor. 

 

I've mocked up a quick and dirty Groovy script for that purpose, and it seems to work fine. The only problem I have is that it chokes on the "store" command (I'm using Grid 1.0.1). The very same Selenese script runs fine in IDE 1.0b2. Am I using two different versions of core here, or am I missing something fundamental about how Selenese is interpreted? I was hoping that I can just blindly pass all the commands into a CommandProcessor and not worry about any semantics. I would greatly appreciate any feedback from someone with a better understanding of the internals of Selenium.

 

Regards,

Volker

slevy Beginner 3 posts since
May 5, 2008
Currently Being Moderated
10. Jul 16, 2008 4:37 PM in response to: Volker
Re: Selenium Grid with Selenese testsuite.html

If someone can point to me to which documentation will help me contribute to solving this problem, I'll set up a flashcard set on YoYobrain.com and make it public - we are using Selenium Core extensively, with Selenese suites.

 

Would be huge if we could quickly get those up on a grid its a sticking point for us right now.  I just need a little guidance on where to focus my study/learning to get up to speed...and we have had success dumping technical knowledge into flashcards our site to help us learn it...

 

Thanks.... Scott

Philippe Hanrigou Pro 182 posts since
Oct 26, 2007
Currently Being Moderated
11. Jul 17, 2008 1:34 AM in response to: Volker
Re: Selenium Grid with Selenese testsuite.html

Hi Volker,

 

I've mocked up a quick and dirty Groovy script for that purpose, and it seems to work fine. The only problem I have is that it chokes on the "store" command (I'm using Grid 1.0.1).

 

The problem is that most Selenium client drivers do not implement the store command: it does not make sense when you are writing tests in a real programming language, which does support variables natively.

 

Good Luck,

- Philippe hanrigou

  http://ph7spot.com

 

 

Volker Beginner 2 posts since
Jul 16, 2008
Currently Being Moderated
12. Jul 17, 2008 3:22 AM in response to: Philippe Hanrigou
Re: Selenium Grid with Selenese testsuite.html

Hi Philippe,

 

I agree with you. Things like that can easily be done in a proper programming language. But I'm not sure if the lacking support for store is a problem of the client driver. I thought the client drivers just translate into some kind of HTTP protocol, and pass that on to an RC or Grid hub. I rummaged through the core  code a bit and found that at the end of selenium-testrunner.js some methods are added to the core Selenium class. Amongst those are doPause and doStore. I think the reason why store works in IDE and not in Grid is that if I go through the client driver Selenium core ends up using selenium-remoterunner.js instead, which does not add those methods.

I will try and handle some commands in a different way. As far as I understand I can probably translate store to storeExpression, and pause (I know we should avoid using that in the first place) into a client-side Thread.sleep(). 

 

Many Thanks,

Volker

Daiji Beginner 14 posts since
Aug 23, 2008
Currently Being Moderated
13. Aug 25, 2008 10:06 PM in response to: Volker
Re: Selenium Grid with Selenese testsuite.html

All, please note http://jira.openqa.org/browse/SRC-517 which I submitted which includes two initial implementations for things that could probably be used to run HTML tests against the Grid.

rektide Beginner 6 posts since
Feb 18, 2008
Currently Being Moderated
14. Aug 26, 2008 2:02 AM in response to: Daiji
Re: Selenium Grid with Selenese testsuite.html

Wow!  I will enjoy looking over what you did tomorrow.  Thank you for this great gift; it's exactly what Selenium needs.

More Like This

  • Retrieving data ...