[RWP] AHK

Mon Jun 3 22:09:51 EDT 2013

JAWS creates a list of graphics by itself.  But, not all images turn up as 
Graphics.  In fact, what I have commonly seen is that the technique used by 
pluggin developers to create their graphical controls, is the very technique 
that prevents JAWS from seing that pixel pattern as a graphic.
At one time, such things were less common, and the jaws created list was 
pretty comprehensive.
And, if the graphic is connected with a toolTip, then you can have jaws 
label the graphics automatically using the toolTip text.

So, Since totally invisible graphical controls are so common now, I created 
HotSpotCclicker's toolTip scanner.  Start that procedure and go to lunch, 
because it takes a while.  But, it slowly marches the mouse across the 
screen, systematically looking for toolTips.  When you come back from lunch, 
there is a list of ToolTips, and the locations at which they reside, so you 
can go there, click around, and see what happens.  If you fine some you 
think are useful, you can make real hotSpots out of them.  But,  that's 
jaws, supplemented by HSC.

I could be wrong, it happened once before, but I still have doubts that AHK 
can create that list of image locations.  I think it's  a pretty complicated 
problem, that of analyzing a screen, and figuring out, from all the clutter 
on there,  which are actually controls, and which is just eye candy.

One thing I have in my particular wet dream basket, a utility that sighted 
people can use as they analyze an application, where they can mark the 
location of a control, and the utility will essentially make a limited 
hotSpot out of it, similar to what the knockoff script is creating now, 
except that it would have more contextual information about the control, 
where it is, how you get there, and more, including a description of the 
meaning of the control, typed in by the sighted assistant, maybe even an 
audio clip of them talking about it. Also, part of it is sequential 
information, so you can keep track of what the assistant did, and in which 
order, as they explored the app.
So, in a nutshell, a sighted person would be able to work remotely, and 
would create a virtual tour of controls, which would be sent to you, so you 
could decide what part of it you want to institutionalize.
I am actually working with a sighted colleague right now to see what we can 
come up with there.
As I recently told another party though,  it's definitely vaporWear at this 
point, so don't inhale.

----- Original Message ----- 
From: "Indigo" <33indigo at charter.net>
To: "Reapers Without Peepers" <rwp at reaaccess.com>
Sent: Monday, June 03, 2013 9:04 AM
Subject: Re: [RWP] AHK

> Does jaws or jaws OCR do that, create a list of graphics and label them 
> something like unknown graphic number 19372; along with either their pixel 
> shape or their x y coordinates?
> I thought I heard something like that, but I know about as much about Jaws 
> as I do about antarctica.
> If it does, could one somehow submit that jaws data to AHK?
> Thanks,
> Indi
>
> On 6/2/2013 9:22 PM, Jim Snowbarger wrote:
>> Well, if you know of  anyone who knows how to make AHK find graphics
>> when it doesn't already know about them, I would sure like to know about
>> it.
>> I am definitely not an AHK expert, but I haven't seen anything so far
>> that makes me think it can do that.  I know there is some feature that
>> lets you search for an image, but you have to have a copy of that image
>> ahead of time so it can search for it.  I don't understand how to get
>> that copy yet. fBut, that process requires somebody to already know what
>> area of the screen to get it from.
>> So yeah, if you can connect me with information about how to get AHK to
>> just create a list of graphics, I would be interested.
>> Too bad you're not a JAWS user.  <grin>
>>
>>
>>
>> ----- Original Message ----- From: "Indigo" <33indigo at charter.net>
>> To: "Reapers Without Peepers" <rwp at reaaccess.com>
>> Sent: Sunday, June 02, 2013 8:26 AM
>> Subject: Re: [RWP] AHK
>>
>>
>>> Well, Jim; you show humility about yur programming skills ; but you're
>>> sure making fast progress with AHK.
>>> Of course we're all hoping that claim that AHK can automatically
>>> locate, number and list the bit map graphics,  and  return to them
>>> when you punch up their number is true.
>>> I think jaws does that, but we're not all jaws users, and maybe AHK
>>> can seek out those graphics even after the screens have shifted or
>>> changed colors, as I've heard from ross it can
>>> If we get a script that locates graphics; we can try some of them to
>>> determine their action, even without sighted help, then label them
>>> according to their purpose.
>>> What I'd hope for is a kind of universal kiddie script template for us
>>> real non programmers; that finds the graphics, tags them with numbers,
>>> lets me return to them; plus a selection of actions; like to type in
>>> names; click automatically when I select them; or let me click manually.
>>> An auto spotting script, with user choices and nameing fields would be
>>> such a blessing.
>>> Thanks,
>>> Indi
>>>
>>>
>>>
>>>
>>>
>>>
>>> On 6/1/2013 10:14 PM, Jim Snowbarger wrote:
>>>> It is V3.  The file also contains a version number at the top.
>>>> No, you can rename the .ahk file to be whatever you want.
>>>> The data file it generates will be located in folder c:\ahk.
>>>> It creates a file with a .INI extension, named after the main
>>>> application.
>>>> I might be wishing that it was named after the title of the window you
>>>> are working in.
>>>> But, your data will probably turn up in c:\ahk\reaper.ini.
>>>> Its convenient to put the .ahk file there too, but it doesn't matter, 
>>>> it
>>>> can be anywhere you want.
>>>>
>>>>
>>>>
>>>> ----- Original Message ----- From: "Indigo" <33indigo at charter.net>
>>>> To: "Reapers Without Peepers" <rwp at reaaccess.com>
>>>> Sent: Saturday, June 01, 2013 8:59 PM
>>>> Subject: Re: [RWP] AHK
>>>>
>>>>
>>>>> I've been  adding a v1 v2 v3 to each of their titles, or I would have
>>>>> got confused.
>>>>> I hope that doesn't harm their running, Jim.
>>>>> I called this one HotSpotKnockOff_v3.
>>>>> Which post  was it meant to replace as the correct one?
>>>>> Thanks,
>>>>> Indi
>>>>>
>>>>> On 6/1/2013 9:46 PM, Jim Snowbarger wrote:
>>>>>> Sorry, I think I may have distributed the wrong file.  Here is a
>>>>>> corrected
>>>>>> link.
>>>>>>
>>>>>> https://dl.dropboxusercontent.com/u/3677477/HotSpotKnockoff.ahk
>>>>>>
>>>>>>
>>>>>>
>>>>>> _______________________________________________
>>>>>> RWP mailing list
>>>>>> RWP at reaaccess.com
>>>>>> http://reaaccess.com/mailman/listinfo/rwp_reaaccess.com
>>>>>>
>>>>>
>>>>> _______________________________________________
>>>>> RWP mailing list
>>>>> RWP at reaaccess.com
>>>>> http://reaaccess.com/mailman/listinfo/rwp_reaaccess.com
>>>>>
>>>>
>>>>
>>>>
>>>> _______________________________________________
>>>> RWP mailing list
>>>> RWP at reaaccess.com
>>>> http://reaaccess.com/mailman/listinfo/rwp_reaaccess.com
>>>
>>> _______________________________________________
>>> RWP mailing list
>>> RWP at reaaccess.com
>>> http://reaaccess.com/mailman/listinfo/rwp_reaaccess.com
>>>
>>
>>
>>
>> _______________________________________________
>> RWP mailing list
>> RWP at reaaccess.com
>> http://reaaccess.com/mailman/listinfo/rwp_reaaccess.com
>
> _______________________________________________
> RWP mailing list
> RWP at reaaccess.com
> http://reaaccess.com/mailman/listinfo/rwp_reaaccess.com
> 