I am trying to automate android application with Appium. I have to perform click operation on tooltip but appium does not identify the tooltip. I have attached screenshot below in which i have to perform click event on "Margaritaville-Grand Turk" but i am not able to perform this operation. How way we can perform action on tooltip.
Asked
Active
Viewed 1,606 times
0
Rohit Doraya
- 119
- 1
- 1
- 16
1 Answers
1
I'm new to Appium, and mobile automation, but I could guess that tooltip is could not be found in activity structure (you could check with Appium inspector, or UIAutomatorViewer), same problem with toast notifications and AutocompleteTextView. I solve this with OCR image recognition engine.
Here you can find my implementation in Ruby: gist
I use 2 OCR libs, because of limitation for both:
- 'rtesseract' can't find text coordinates
- 'tesseract' have problems with text recognition
Idea is simple:
- get required screen state(i.e. tooltip is shown)
- make screenshot or few
- process these screenshots, and look for required text
- get text coordinates, and click on it.
Hope it helps
brbrr
- 149
- 1
- 1
- 16
-
Thanks, I have performed tap action through X-Y Coordinate. – Rohit Doraya May 13 '15 at 12:55
-
@RohitDoraya You can accept my answer, if you think it fits. – brbrr May 14 '15 at 14:20