Image comparisons in windows with no "sub-objects"

Friday, October 5, 2012
Avatar
We're using LabView for a lot of our major development.  Unfortunately, that tends to result in only one object that Rapise can easily identify... the window itself.  I tried OCR with Tesseract, but that engine doesn't seem to be able to glean much from the screen, so I'm moving to option 2: image capture and compare.  From what I understand, though, when taking images to compare on unrecognized objects, Rapise will take an image of the object below the pointer when an action is taken.  That would mean taking an image of the entire window, since it is the only visible object.  So if I were looking for a particular button to match a pattern I define, I have to compare the entire window(?)

Does that make sense the way I described it?

What I'd like to do is compare a defined area in the recording to the same area in playback, without having separate, visible "objects".  Perform action, take a copy of (39, 239, 114, 269) and compare to the recorded image of that same area.  If it's the same, then A.  Else B.

Thanks!
3 Replies
Sunday, October 7, 2012
Avatar
re: ymgagnon Friday, October 5, 2012

Hi Yves

Unfortunately Rapise only has limited image recognition capabilities, so you are correct, you'd need to take a image area screenshot and then compare the images using an image comparison tool. You could capture the image using an external tool during the run.

However before going down this road, have you tied using the Spy tool in Rapise, if you switch the Spy mode to "Accessible", do you see any objects beyond the main window?

Regards

Adam

Wednesday, October 10, 2012
Avatar
re: inflectra.david Sunday, October 7, 2012
With the Spy Tool set to Accessible mode, I can only see "The whole window", and separate objects for the title bar, the window controls, and the menus (not the initial text labels for the menus, mind you... just the list once the menu is opened.)  Everything else remains shrouded in mystery!  (I had to get theatrical.)

We're working on some potential other options, around building a custom interface allowing "Get" and "Set" functions, so that screen location to verify visual updates will be our only stumbling block.  Looks like Rapise is not unique in its inability to handle LabView, though.  I have not yet found a tool that does handle these objects... though there are rumours that a company once built an add-on for a different tool... and that company since went out of business and no longer has the add-on available.  :|
Wednesday, October 17, 2012
Avatar
re: ymgagnon Wednesday, October 10, 2012

Hi Yves

If you know of that tool or add-on, let us know, maybe we can make contact with them, or at least dig up some of the code...?

Regards

Adam

Spira Helps You Deliver Quality Software, Faster and With Lower Risk

And if you have any questions, please email or call us at +1 (202) 558-6885

 

Statistics
  • Started: Friday, October 5, 2012
  • Last Reply: Wednesday, October 17, 2012
  • Replies: 3
  • Views: 2817