Suggestion
-
Peter Szinek
- State changed from new to open
- Assigned user set to Peter Szinek
OK - let me know where the site is located and I'll look into it!
-
crisb
The site is located here: http://de.yahoo.com/
Actually it works the same as http://yahoo.com/, but since the german site doesn't offer an api, it would be really cool if you could take a look at it.
-
crisb
exactly :-)
-
antel
Scrubyt doesn't support javascript, the drop down menu with urls start only by an javascript input, it ask the server and return html, test it with firebug and webdeveloper inspecting objects with javascript enabled/disabled, at now it will work only with firewatir.
-
crisb
I know, that's why I didn't got it working. But I thought that Firewatir is included in the new scrubyt and therefore it would be able to scrape the suggestions.
Or am I wrong? :-)
-
antel
If you activate the firewatir agent, it will work!
-
Peter Szinek
Yeah, it should (at least that's the idea :-)) however, currently it's throwing
textfield name and //input["@id=p"] is read only. (Watir::Exception::ObjectReadOnlyException)WTF?! how can it be read only??!? Need to dig around a bit more and/or ask the Watir guys.
-
Peter Szinek
Ok, I found the problem... will need to push out one more release ;-)
-
crisb
Fantastic. Looking forward to it.
-
Peter Szinek
- Milestone set to 0.4.1
-
Peter Szinek
OK, done - now I just need to find some time to crank the release out - should happen today, or in the worst case tomorrow!
-
crisb
can you drop me a line as soon as you release it?
-
Peter Szinek
Sure, will do!
-
Peter Szinek
- State changed from open to resolved
Done, phew was not easy...
(maybe to wait 5 seconds is too much - try it out and play around with it).
Let me know if it doesn't work (well, for some time it won't - the gem needs to be mirrored @ rubyforge)
-
crisb
cool, thanks.
but could it be possible that the gem still isn't mirrored at rubyforge?
-
Peter Szinek
hmmm.... wtf it seems it's not yet there. it should be 0.4.1 but for me it installs just 0.4.06... checking it out.
-
crisb
i now installed it manually and tried to get it working with de.yahoo.com. but i don't even get the script to fill out the textfield.
yahoo_data = Scrubyt::Extractor.define :agent => :firefox do fetch 'http://de.yahoo.com/' fill_textfield_and_wait 'p', 'ruby', 5 end
-
Peter Szinek
Running out for lunch now, but will check it out after I am back!
-
Peter Szinek
Does it work for you with yahoo.com (without the de?)
-
crisb
I checked it with yahoo.com He doesn't seem to fill in the textfield their too.
Please Sign in or create a free account to add a new ticket.
With your very own profile, you can contribute to projects, track your activity, watch tickets, receive and update tickets through your email and much more.