Testing on physical iDevices states:

Calabash cannot automatically start your app on device yet.

When will it? The automation tech seems to be closed on lesspainful.com. Is something like fruitstrap a viable alternative?

As mentioned on frank-discuss

the ideal situation for something like LessPainful would be similar
to Selenium and SauceLabs - an open source product where a company can build
a business offering cloud-based services on top while also contributing to
the base open source project.

Keeping the physical device automation closed to sell device cloud subscriptions is not so great from an iOS developer's point of view. I think the SauceLabs model, which has no such restrictions, is better.

For example they opened sourced iOS support which gives customers confidence in purchasing their subscription because there's no lock in.

When running calabash-ios setup the setup opens Xcode's *.xcodeproj project file. Since more and more devs using CocoaPods these days, they're also using *.xcworkspace. So when the setup program instructs to verify that the -cal target is building, it will fail since the linker is unable to link the static pods library. You'll see a -lPods error message.

So I purpose to look for a *.xcworkspace file and if it exists open it by the end of the setup procedure.

Can you please put a step by step guide to test on physical device. This will prove to be very useful. I am currently struggling with Frank for executing my tests on a physical device.

Great looking project.

I'm curious about the "Given" steps that are common to cucumber? I don't see any examples in the docs.

Are there ways to interact with the application. I would like to have a step to clear all data and create some core data objects.

Would this require interacting with the UI in some way?

This is a feature that I like in KIF, since it runs in the app directly using objective-c, you can interact directly with the data layer.

Hi Guys,

Great product, amazing work, well done.

I was wondering whether you could tell me whether there is any "assertion" syntax for the following:

Then I should see the text "hello world" in input field "textfield1"

Currently I have only managed to get working syntax for:

Then I should see the text "hello world"

The problem is that I would like to validate the text of a specific object, but at the moment the working example only validates text on the screen in general.

Regards

PJ

maybe i have done something wrong, but the calabash-cucumber gem does not install the required gems - in particular cucumber is not installed.

i had calabash-cucumber installed (and running) on ruby 1.9.3p125 and i updated to p194

rvm 1.14.1
MacOS 10.7.4
ruby 1.9.3p194

$ gem install calabash-cucumber
Successfully installed calabash-cucumber-0.9.74
1 gem installed
Installing ri documentation for calabash-cucumber-0.9.74...
Installing RDoc documentation for calabash-cucumber-0.9.74...

I've implement simple guard gem for calabash-ios. If you want, you can add a link to it in your wiki page.
https://github.com/AlexDenisov/guard-calabash-ios

https://groups.google.com/d/topic/calabash-ios/is9Humnl5ys/discussion

...
I did notice that setting webView.scalesPageToFit = YES will cause the
links not to be clicked, even if they are visible - but this is not
the cause of the issue in my original project.

Is there support for querying the 'selected' state of a tab bar button?

WARNING: Using 'Given/When/Then' in step definitions is deprecated, use 'step' to call other steps instead:/usr/local/rvm/gems/ree-1.8.7-2012.02@gemset/gems/calabash-cucumber-0.9.51/lib/calabash-cucumber/calabash_steps.rb:78

This is not a bug, but little annoying :)

launch.rb contains the following as an example of setting APP_BUNDLE_PATH:

#APP_BUNDLE_PATH = "~/Library/Developer/Xcode/DerivedData/??/Build/Products/Calabash-iphonesimulator/??.app""

When using this line with an actual path, it appears that the ~ character at the start is not allowed. Running cucumber results in

  Try setting APP_BUNDLE_PATH in features/support/launch.rb to one of:

   (RuntimeError)
  /Users/me/.rvm/gems/ruby-1.9.2-p180/gems/calabash-cucumber-0.9.49/lib/calabash-cucumber/launch/simulator_helper.rb:108:in `app_bundle_or_raise'
  /Users/me/.rvm/gems/ruby-1.9.2-p180/gems/calabash-cucumber-0.9.49/lib/calabash-cucumber/launch/simulator_helper.rb:17:in `relaunch'

When using \Users instead of ~ everything works OK.

I've gotten very use to downloading third party iOS libraries and testing frameworks with CocoaPods. After hearing your endorsement of CocoaPods on iDeveloper/Live podcast I was disappointed not finding it available from that distribution mechanism.

Swipe playback is relative to the default orientation, not the current orientation. If you rotate the simulator left and then swipe left, you get a vertical swipe. This also affects the "swipe the cell" steps; the swipe is vertical when the simulator is in landscape.

I thought at first to work around this by swiping up when when i wanted to swipe left. Recordings for swiping up and down are not included, although they are implied by the details in the predefined steps document, and expected by the swipe step definitions.

Hi. I ran into a problem when i ran the 'calabash-ios setup' command. It looks like it is failing trying to create the cal target. Does anyone know how I resolve fix this exception?

Thanks!

Duplicating target: APPNAME to new target: APPNAME-cal
2012-06-22 16:52:18.462 CalabashSetup[98908:f07] -[**NSCFString containsObject:]: unrecognized selector sent to instance 0x1001dc1e0
2012-06-22 16:52:18.464 CalabashSetup[98908:f07] *** Terminating app due to uncaught exception 'NSInvalidArgumentException', reason: '-[__NSCFString containsObject:]: unrecognized selector sent to instance 0x1001dc1e0'
* First throw call stack:
(
0 CoreFoundation 0x00007fff8e8fefc6 __exceptionPreprocess + 198
1 libobjc.A.dylib 0x00007fff87cbcd5e objc_exception_throw + 43
2 CoreFoundation 0x00007fff8e98b2ae -[NSObject doesNotRecognizeSelector:] + 190
3 CoreFoundation 0x00007fff8e8ebe73 __forwarding + 371
4 CoreFoundation 0x00007fff8e8ebc88 _CF_forwarding_prep_0 + 232
5 CalabashSetup 0x0000000100006413 CalabashSetup + 25619
6 CalabashSetup 0x00000001000068ab CalabashSetup + 26795
7 CalabashSetup 0x0000000100006b4c CalabashSetup + 27468
8 CalabashSetup 0x00000001000021ed CalabashSetup + 8685
9 CalabashSetup 0x0000000100002a43 CalabashSetup + 10819
10 CalabashSetup 0x0000000100001da3 CalabashSetup + 7587
11 CalabashSetup 0x0000000100001624 CalabashSetup + 5668
12 ??? 0x0000000000000003 0x0 + 3
)
terminate called throwing an exception

Hi Karl,

I'm playing around with this open-source app: https://github.com/newsyc/newsyc/

and when I run "Then I touch search" (in the Search tab) or "Then I touch done" (in the Profile tab when logging in), nothing happens.

Could you look into it please?

Also, would it be possible to implement a step definition for tapping the "Next" button on the keyboard when you have multiple input fields?

Thanks!

I'm having trouble with the "I touch 'x'" steps when using a UIAlertView when the simulator is rotated to landscape. If I have a UIAlertView with two button and trigger a touch of the right-hand button, nothing happens. If I trigger a touch of the left-hand button, the right-hand button is pressed. Touch events work fine on the rest of my app UI.

I have a exist project now want Calabash support for automation testing.

As the manual steps:

• calabash-ios setup
• calabash-ios gen

Then run DEVICE=iphone OS=ios5 cucumber, will get the below issue.

I checked the folder, but project-xxx/Build folder not generated by run with project-cal schema.

Unable to auto detect APP_BUNDLE_PATH.
  Have you built your app for simulator?.
  Searched dir: /Users/lanvige/Library/Developer/Xcode/DerivedData/Ap-aetngbdirwmkvefasukkrhbhwscp/Build/Products
  Please build your app from Xcode
  You should build the -cal target.

  Alternatively, specify APP_BUNDLE_PATH in features/support/launch.rb
  This should point to the location of your built app linked with calabash.
   (RuntimeError)
  /Users/lanvige/.rvm/gems/ruby-1.9.3-p194@rails/gems/calabash-cucumber-0.9.104/lib/calabash-cucumber/launch/simulator_helper.rb:135:in `app_bundle_or_raise'
  /Users/lanvige/repos/apollo/features/support/launch.rb:49:in `relaunch'
  /Users/lanvige/repos/apollo/features/support/launch.rb:69:in `Before'

Log shows as below:

2012-09-19 21:15:35.662 Ap-cal[5455:c07] Creating the server: <LPHTTPServer: 0x69675d0>
2012-09-19 21:15:35.664 Ap-cal[5455:c07] simroot: /Applications/Xcode.app/Contents/Developer/Platforms/iPhoneSimulator.platform/Developer/SDKs/iPhoneSimulator5.1.sdk
2012-09-19 21:15:35.666 Ap-cal[5455:c07] Started LPHTTP server on port 37265
2012-09-19 21:15:36.366 Ap-cal[5455:1f03] Bonjour Service Published: domain(local.) type(_http._tcp.) name(Calabash Server)

**Terminating in response to SpringBoard's termination**

but if add no-launch para, the script will be pass.

$ DEVICE=iphone OS=ios5 NO_LAUNCH=1 cucumber

I found the same problem post 5 months ago.
https://groups.google.com/forum/#!topic/calabash-ios/B3OUOYf7lFY

I'm using XCode 4.4.1 & ML & calabash-cucumber 0.9.104 with calabash.framework-0.9.103

I try to create a new project and then run these two commands and the calabash script works fine.

My new project.pbxproj file at here: https://gist.github.com/3749695

Thanks for help.

Update::

I found a folder named Build under DerivedData I can find the project-cal app at below path: ~/Library/Developer/Xcode/DerivedData/Build/Products/Debug-iphonesimulator/Ap-cal.app

Then I change the APP_BUNDLE_PATH to point here, the scripts run passed.

So, does I missed somethings?

update 2::

Seems XCode 4.4.1 changed the App Build Path. I create a new project and the .app file is also in same folder, but not the default find path.

Trying out Calabash for the first time on one of our company's more ahem_interesting_cough apps. The automagic setup for Calabash in that project seems to work well, but for one tiny issue;

The target that got copies had its own linker flags already (specifically -ObjC and -fobjc-arc , but the automatic setup replaces these completely with the -force-load and lstdc++ instead of appending them. This broke my app on launch immediately, but adding the original linker flags solved the problem.

Is this intentional? If not, it's an issue to be fixed :)

I have a modal view coming up as soon as someone wants to delete an element from the items in a table view. I had a "Delete" button in the table-toolbar and in the modal dialog. Only the first found button was triggered. So if a modal view is active, only this modal views elements should be considered relevant.

I have a problem similar to this (closed) issue 13.

I have some views that I have only been able to find by setting their accessibilityLabel to a string that is not appropriate for Localization.

iOS 5 introduced the accessibilityIdentifier so I think that it makes sense for calabash support finding views by this property.

https://groups.google.com/d/topic/calabash-ios/ICA4f24eSsY/discussion

We really need to be able to query and touch elements which are inside an iFrame.

Currently a css or xpath node query returns nil

Situation is, i have a uiview at the bottom of the screen and it disappears when i tap on screen in middle. While writing the assertion for see/don't see of this uiview on screen. I am always able to find it. Need help on this.

Hi;

I have a problem with following custom step

Then /^I should see "([^\"]*)" (un)?checked$/ do |label, un|
sel= query("button marked:'#{label}'", :isSelected)[0]

screenshot_and_raise "Expected button cannot be found check name" if sel==nil
if un.nil?
screenshot_and_raise "Expected check button checked" if sel == '0'
else
screenshot_and_raise "Expected check button unchecked" if sel == '1'
end
end

My feature is

...
Then I should see "Snapshot" checked
...

sel is return nil always. label is coming to step right and i checked
query("button marked:'Snapshot'", :isSelected)[0] on terminal query window and it return "1"

I put the custom file under features/step_definitions/
My calabash-ios version is 0.9.100

I stucked here for a while, any help, idea will be much appreciated.

Thanks

Additionally, we can have an assertion for this too. Very useful for testing the applications who switches the orientation frequently.

Several people have reported problems with automated simulator launch on 4.3, e.g.,

https://groups.google.com/d/topic/calabash-ios/ntaqUlz8HDY/discussion

irb_ios5.sh provides a raw form of viewing on terminal screen. Is any symbiotic like viewing of DOM is possible? My team is struggling a lot to find right objects from the console window.

Hi,

When I write my tests, I use accessibility labels all the time. That's really nice, and one reason I like Calabash so much. But, when I localize my application, I also localize the accessibility labels. What is the recommended way of writing language independent tests, while still retaining the high-level test writing using accessibility labels?

Cheers

Nik

I tried updating to 0.9.53 today using:

$ gem update calabash-cucumber; calabash-ios download

and got:

Updating installed gems
Updating calabash-cucumber
Fetching: calabash-cucumber-0.9.53.gem (100%)
Fetching: gherkin-2.10.0.gem (100%)
Building native extensions.  This could take a while...
Successfully installed calabash-cucumber-0.9.53
Successfully installed gherkin-2.10.0
Gems updated: calabash-cucumber, gherkin

----------Info----------
Found calabash.framework in /Users/moody/git/RiseUp/RiseUp.
Shall I delete it and download the latest matching version?
Please answer yes (y) or no (n)
y

----------Info----------
Did not find calabash.framework. I'll download it...'
http://cloud.github.com/downloads/calabash/calabash-ios/calabash.framework-0.9.51.zip
Got bad response code 403.
Aborting...

calabash-cucumber is no longer working after I upgrade to 0.9.50, with these error when executing cucumber:

can't convert nil into String (TypeError)
~/.rbenv/versions/1.9.3-p125/lib/ruby/gems/1.9.1/gems/calabash-cucumber-0.9.50/lib/calabash-cucumber/launch/simulator_helper.rb:101:in `expand_path'
~/.rbenv/versions/1.9.3-p125/lib/ruby/gems/1.9.1/gems/calabash-cucumber-0.9.50/lib/calabash-cucumber/launch/simulator_helper.rb:101:in `app_bundle_or_raise'
$PROJECT_DIR/features/support/launch.rb:49:in `relaunch'
$PROJECT_DIR/features/support/launch.rb:64:in `Before'

Querying the app through irb_ios5.sh works fine.

After updating to version 0.9.40 and using sudo xcode-select -switch /Applications/Xcode.app/Contents/Developer, it still appears automatically launch the Simulator. Performing OS=ios5 cucumber in the project directory (the one containing the .xcproj file), yields the following output:

Midna:NWCalabashApplication brunoscheele$ OS=ios5 cucumber
/Users/brunoscheele/Projects/iOS/NWCalabashApplication/features/support/hooks.rb:1: warning: already initialized constant CALABASH_COUNT
Feature: Keyboard dismisses on 'Done'
    The keyboard should dismiss when the 'Done' button is pressed.

  Scenario: Example steps       # features/keyboardDismissal.feature:5
  can't convert nil into String (TypeError)
  /Users/brunoscheele/.rvm/gems/ruby-1.9.2-p290/gems/calabash-cucumber-0.9.40/lib/calabash-cucumber/launch/simulator_helper.rb:76:in `join'
  /Users/brunoscheele/.rvm/gems/ruby-1.9.2-p290/gems/calabash-cucumber-0.9.40/lib/calabash-cucumber/launch/simulator_helper.rb:76:in `app_bundle_or_raise'
  /Users/brunoscheele/.rvm/gems/ruby-1.9.2-p290/gems/calabash-cucumber-0.9.40/lib/calabash-cucumber/launch/simulator_helper.rb:15:in `relaunch'
  /Users/brunoscheele/Projects/iOS/NWCalabashApplication/features/support/launch.rb:36:in `relaunch'
  /Users/brunoscheele/Projects/iOS/NWCalabashApplication/features/support/launch.rb:48:in `Before'
    Given the app is running    # calabash-cucumber-0.9.40/lib/calabash-cucumber/calabash_steps.rb:4
    Then I touch "First number" # calabash-cucumber-0.9.40/lib/calabash-cucumber/calabash_steps.rb:15
    Then take picture           # calabash-cucumber-0.9.40/lib/calabash-cucumber/calabash_steps.rb:174

Failing Scenarios:
cucumber features/keyboardDismissal.feature:5 # Scenario: Example steps

1 scenario (1 failed)
3 steps (3 skipped)
0m0.003s

Using the NO_LAUNCH=1 option works fine though.

I wish to touch a cell at index path (2,0). How do I do this? I also want to query it to see if there was a cell at this position

When we make a recording, we can apply it to a start-target. But it'd be cool also to be able to set an end target, and interpolate the movement in between.

I have a navigationItemView displayed over the presentation that has multiple slides in it and each slide has text 'slide x of y'. Now I want to write script that checks the first slide has label 'slide 1 of x' and second has 'slide 2 of x'.

after updating to 0.9.94, i have a step that has been passing (for months) fail with an error

> Calabash::Cucumber::VERSION
=> "0.9.94"
> query("view {text LIKE '*Support Request*'}")
Encoding::InvalidByteSequenceError: "\xC2" on US-ASCII
    from /Users/moody/.rvm/gems/ruby-1.9.3-p194@calabash/gems/json-1.7.4/lib/json/common.rb:155:in `encode'
    from /Users/moody/.rvm/gems/ruby-1.9.3-p194@calabash/gems/json-1.7.4/lib/json/common.rb:155:in `initialize'
    from /Users/moody/.rvm/gems/ruby-1.9.3-p194@calabash/gems/json-1.7.4/lib/json/common.rb:155:in `new'
    from /Users/moody/.rvm/gems/ruby-1.9.3-p194@calabash/gems/json-1.7.4/lib/json/common.rb:155:in `parse'
    from /Users/moody/.rvm/gems/ruby-1.9.3-p194@calabash/gems/calabash-cucumber-0.9.94/lib/calabash-cucumber/core.rb:298:in `map'
    from /Users/moody/.rvm/gems/ruby-1.9.3-p194@calabash/gems/calabash-cucumber-0.9.94/lib/calabash-cucumber/core.rb:18:in `query'

Additional information:

if the there are no matches, then the error does not occur:

> query("view {text LIKE 'some text that does not exist*'}")
=> []

any thoughts?

I am just wondering , how can i get the css value from the ui web view innorder to make a comparison with another value.
Here i am trying to verify/compare an error messsage.

Then /^i should see "([^"]*)"$/ do |arg1|

.......

end

Hi Karl (I'm guessing) :P

I'm running into other issues. The port doesn't seem to get connected.
For a basic concept I built the sample app and saw the intended message "Started HTTP server on port 37265".
Next I went to through the setup both "calabash-ios setup" and manual, but I could never get the server port working. The Xcode console would never show anything and running "cucumber" would show:
Ping http://localhost:37265/...
Ping http://localhost:37265/...
Ping http://localhost:37265/...
Ping http://localhost:37265/...

<Errno::ECONNREFUSED: Connection refused - connect(2)>

Ping http://localhost:37265/...

<Errno::ECONNREFUSED: Connection refused - connect(2)>

Please let me know if there is any information I can provide.
Many Thanks!

I get an error after I follow all the installation steps given at : https://github.com/calabash/calabash-ios/blob/master/README.md

Here is the error:

" target specifies product type 'com.apple.product-type.framework.static', but there's no such product type for the 'iphonesimulator' platform "

I need some help to resolve it. This Calabash tool really looks interesting and I want to start writing tests for a hybrid iOS app using Calabash.

I think a cucumber tool would be very appreciated by the rubymotion community.

When using scenario outlin we are running into an error in hooks.rb:

NoMethodError: undefined method raw_steps' for #<Cucumber::Ast::OutlineTable::ExampleRow:0x1025b0290> ./features/support/hooks.rb:39:inAfterStep'

AfterStep do |scenario|
#Håndtering af den situation hvor Feature/Scenario/steps er mulitline
CALABASH_COUNT[:step_index] = CALABASH_COUNT[:step_index] + 1
raw = scenario.raw_steps[CALABASH_COUNT[:step_index]]
CALABASH_COUNT[:step_line] = raw.line unless raw.nil?
end

Could you please look into this?

We have an iOS app that has in-app purchase functionality in it. To test that, we use sandbox alerts that provides 'Buy', 'Cancel' buttons etc., but these alerts or buttons are not visible in query "view". How do we test it in this case using calabash.

I was showing my progress with calabash-ios to some of my colleagues and together. One of the issues we encountered was the need for some per-project configuration for calabash-ios.

Some things we would like to use this configuration for:

• Setting default values for environment variables which we always use (less typing is MOAR AWESOME!).
• Setting the directory structure for calabash-ios, to avoid cluttering up our trunk. We would like to have a Calabash/ folder in our trunk for example, where calabash-ios searches and puts all its stuff.

A way I would imagine this to work would be to have a variable that can be set in the -cal target that points to the custom Calabash/ directory. That directory would contain a configuration file which handles the rest of the options.

(Only tested on iOS)

It's quite common to hide UIViews away outside the boundaries of the screen with an animation or so. Queries for these now invisible views, and touches, should not go through.

I suppose this also goes for view with alpha=0.

I suppose this also goes for views with other views on top

Should be able to test this with converting a point or rect from the coordinate system of scrollviews etc by using something like:

(CGRect)convertRect:(CGRect)rect toView:(UIView *)view work

Cheers

Nik

I'm not able to use an UISearchBar as an input field for:

Then I fill "Search Bar" with "foo"

or

Then I enter "foo" into the "Search Bar" input field

by the way: where can I see the predefined steps? I can't find calabash-cucumber\lib\calabash-cucumber\calabash_steps.rb on my mac, and the content of $PROJECT_DIR/features/step_definitions/calabash_steps.rb is just the following:

require 'calabash-cucumber/calabash_steps'%

Hello,

When the "Then I touch search" command is executed on an iPad (both Simulator and actual device), it dismisses the keyboard (it touches the bottom right button on the keyboard) instead of touching the "Search" button.

I also tried using 'Then I touch the "search" button' since that it was it is labeled in the Accessibility inspector, but that didn't work.

I was able to record and playback touching the Search button on the keyboard, but since it uses screen coordinates, I would have to do 4 different recordings based on all 4 orientations.

Support for the "Search" button on the keyboard, or hints for doing it on my own would be greatly appreciated. Thanks!

The output of 'calabash-ios setup' states at the end:

After validating, you can generate a features folder:
Go to your project (the dir containing the .xcodeproj file).
Then run calabash-ios gen
(if you don't already have a features folder).

This is not entirely complete, since calabash gen also copies the 'Explore interactively' shell scripts to your project directory, even though this is only stated at one point in the README.md. I was wondering if you changed anything in the setup script, because I couldn't find these files. Turns out they are copied by 'gen' instead.

https://groups.google.com/d/topic/calabash-ios/beQ7zYmmkCQ/discussion

I don't know why, but all the linked images of the README file are absent, I think it's really difficult for new users to follow the instructions without the images.