[RWP] AHK

Indigo 33indigo at charter.net
Tue Jun 4 01:04:41 EDT 2013 

I can't make NVDA do the same thing, but, with Wineyes, when I run the 
imitation mouse over the screen if there's a toolTip it'll speak.
Somewhere, I forget where, you can set the delay for toolTips to speak 
when you hover the mouse over them.
You can set it for almost no delay and creep around the screen with the 
next and previous item, or whatever wineyes calls it; also creeping the 
mouse pointer by delta groups of pixels.
That's screen scraping; a good term for it.
It's more interesting exploration than running wineyes graphics namer, 
which is boring as hell and usually finds nothing anyway.
Like in this Poise VST I'm looking at, the very friendly author just 
didn't use any tooltips for his dozens of unknown graphics.
Wineyes says graphic as I move across them, though; and when I left 
click on them they display dialogs or menus to do things.
The dialogs and menus are standard Microsoft, so speak nicely.
I think all that program needs is to have its graphics labeled.
With one of your knockOffHotSpots maybe I can provide shortcuts for 
them, so no need to go to the numPad to screenscrape for  them.
Thanks,
Indi



On 6/3/2013 10:09 PM, Jim Snowbarger wrote:
> JAWS creates a list of graphics by itself.  But, not all images turn up
> as Graphics.  In fact, what I have commonly seen is that the technique
> used by pluggin developers to create their graphical controls, is the
> very technique that prevents JAWS from seing that pixel pattern as a
> graphic.
> At one time, such things were less common, and the jaws created list was
> pretty comprehensive.
> And, if the graphic is connected with a toolTip, then you can have jaws
> label the graphics automatically using the toolTip text.
>
> So, Since totally invisible graphical controls are so common now, I
> created HotSpotCclicker's toolTip scanner.  Start that procedure and go
> to lunch, because it takes a while.  But, it slowly marches the mouse
> across the screen, systematically looking for toolTips.  When you come
> back from lunch, there is a list of ToolTips, and the locations at which
> they reside, so you can go there, click around, and see what happens.
> If you fine some you think are useful, you can make real hotSpots out of
> them.  But,  that's jaws, supplemented by HSC.
>
> I could be wrong, it happened once before, but I still have doubts that
> AHK can create that list of image locations.  I think it's  a pretty
> complicated problem, that of analyzing a screen, and figuring out, from
> all the clutter on there,  which are actually controls, and which is
> just eye candy.
>
> One thing I have in my particular wet dream basket, a utility that
> sighted people can use as they analyze an application, where they can
> mark the location of a control, and the utility will essentially make a
> limited hotSpot out of it, similar to what the knockoff script is
> creating now, except that it would have more contextual information
> about the control, where it is, how you get there, and more, including a
> description of the meaning of the control, typed in by the sighted
> assistant, maybe even an audio clip of them talking about it. Also, part
> of it is sequential information, so you can keep track of what the
> assistant did, and in which order, as they explored the app.
> So, in a nutshell, a sighted person would be able to work remotely, and
> would create a virtual tour of controls, which would be sent to you, so
> you could decide what part of it you want to institutionalize.
> I am actually working with a sighted colleague right now to see what we
> can come up with there.
> As I recently told another party though,  it's definitely vaporWear at
> this point, so don't inhale.
>
>
>
>
>
>
> ----- Original Message ----- From: "Indigo" <33indigo at charter.net>
> To: "Reapers Without Peepers" <rwp at reaaccess.com>
> Sent: Monday, June 03, 2013 9:04 AM
> Subject: Re: [RWP] AHK
>
>
>> Does jaws or jaws OCR do that, create a list of graphics and label
>> them something like unknown graphic number 19372; along with either
>> their pixel shape or their x y coordinates?
>> I thought I heard something like that, but I know about as much about
>> Jaws as I do about antarctica.
>> If it does, could one somehow submit that jaws data to AHK?
>> Thanks,
>> Indi
>>
>> On 6/2/2013 9:22 PM, Jim Snowbarger wrote:
>>> Well, if you know of  anyone who knows how to make AHK find graphics
>>> when it doesn't already know about them, I would sure like to know about
>>> it.
>>> I am definitely not an AHK expert, but I haven't seen anything so far
>>> that makes me think it can do that.  I know there is some feature that
>>> lets you search for an image, but you have to have a copy of that image
>>> ahead of time so it can search for it.  I don't understand how to get
>>> that copy yet. fBut, that process requires somebody to already know what
>>> area of the screen to get it from.
>>> So yeah, if you can connect me with information about how to get AHK to
>>> just create a list of graphics, I would be interested.
>>> Too bad you're not a JAWS user.  <grin>
>>>
>>>
>>>
>>> ----- Original Message ----- From: "Indigo" <33indigo at charter.net>
>>> To: "Reapers Without Peepers" <rwp at reaaccess.com>
>>> Sent: Sunday, June 02, 2013 8:26 AM
>>> Subject: Re: [RWP] AHK
>>>
>>>
>>>> Well, Jim; you show humility about yur programming skills ; but you're
>>>> sure making fast progress with AHK.
>>>> Of course we're all hoping that claim that AHK can automatically
>>>> locate, number and list the bit map graphics,  and  return to them
>>>> when you punch up their number is true.
>>>> I think jaws does that, but we're not all jaws users, and maybe AHK
>>>> can seek out those graphics even after the screens have shifted or
>>>> changed colors, as I've heard from ross it can
>>>> If we get a script that locates graphics; we can try some of them to
>>>> determine their action, even without sighted help, then label them
>>>> according to their purpose.
>>>> What I'd hope for is a kind of universal kiddie script template for us
>>>> real non programmers; that finds the graphics, tags them with numbers,
>>>> lets me return to them; plus a selection of actions; like to type in
>>>> names; click automatically when I select them; or let me click
>>>> manually.
>>>> An auto spotting script, with user choices and nameing fields would be
>>>> such a blessing.
>>>> Thanks,
>>>> Indi
>>>>
>>>>
>>>>
>>>>
>>>>
>>>>
>>>> On 6/1/2013 10:14 PM, Jim Snowbarger wrote:
>>>>> It is V3.  The file also contains a version number at the top.
>>>>> No, you can rename the .ahk file to be whatever you want.
>>>>> The data file it generates will be located in folder c:\ahk.
>>>>> It creates a file with a .INI extension, named after the main
>>>>> application.
>>>>> I might be wishing that it was named after the title of the window you
>>>>> are working in.
>>>>> But, your data will probably turn up in c:\ahk\reaper.ini.
>>>>> Its convenient to put the .ahk file there too, but it doesn't
>>>>> matter, it
>>>>> can be anywhere you want.
>>>>>
>>>>>
>>>>>
>>>>> ----- Original Message ----- From: "Indigo" <33indigo at charter.net>
>>>>> To: "Reapers Without Peepers" <rwp at reaaccess.com>
>>>>> Sent: Saturday, June 01, 2013 8:59 PM
>>>>> Subject: Re: [RWP] AHK
>>>>>
>>>>>
>>>>>> I've been  adding a v1 v2 v3 to each of their titles, or I would have
>>>>>> got confused.
>>>>>> I hope that doesn't harm their running, Jim.
>>>>>> I called this one HotSpotKnockOff_v3.
>>>>>> Which post  was it meant to replace as the correct one?
>>>>>> Thanks,
>>>>>> Indi
>>>>>>
>>>>>> On 6/1/2013 9:46 PM, Jim Snowbarger wrote:
>>>>>>> Sorry, I think I may have distributed the wrong file.  Here is a
>>>>>>> corrected
>>>>>>> link.
>>>>>>>
>>>>>>> https://dl.dropboxusercontent.com/u/3677477/HotSpotKnockoff.ahk
>>>>>>>
>>>>>>>
>>>>>>>
>>>>>>> _______________________________________________
>>>>>>> RWP mailing list
>>>>>>> RWP at reaaccess.com
>>>>>>> http://reaaccess.com/mailman/listinfo/rwp_reaaccess.com
>>>>>>>
>>>>>>
>>>>>> _______________________________________________
>>>>>> RWP mailing list
>>>>>> RWP at reaaccess.com
>>>>>> http://reaaccess.com/mailman/listinfo/rwp_reaaccess.com
>>>>>>
>>>>>
>>>>>
>>>>>
>>>>> _______________________________________________
>>>>> RWP mailing list
>>>>> RWP at reaaccess.com
>>>>> http://reaaccess.com/mailman/listinfo/rwp_reaaccess.com
>>>>
>>>> _______________________________________________
>>>> RWP mailing list
>>>> RWP at reaaccess.com
>>>> http://reaaccess.com/mailman/listinfo/rwp_reaaccess.com
>>>>
>>>
>>>
>>>
>>> _______________________________________________
>>> RWP mailing list
>>> RWP at reaaccess.com
>>> http://reaaccess.com/mailman/listinfo/rwp_reaaccess.com
>>
>> _______________________________________________
>> RWP mailing list
>> RWP at reaaccess.com
>> http://reaaccess.com/mailman/listinfo/rwp_reaaccess.com
>>
>
>
>
> _______________________________________________
> RWP mailing list
> RWP at reaaccess.com
> http://reaaccess.com/mailman/listinfo/rwp_reaaccess.com

More information about the Rwp mailing list