SpiderBasic

Posted: **Mon Sep 11, 2017 12:05 pm**

how to read HTML from url for processing as strings for parsing and extract info?

Posted: **Mon Sep 11, 2017 12:34 pm**

Rjevsky wrote:how to read HTML from url for processing as strings for parsing and extract info?

do you mean the URL-Parameters? Then you can use ProgramParameter()

-> http://www.spiderbasic.com/documentatio ... meter.html

Greetings ... Peter

Posted: **Mon Sep 11, 2017 1:24 pm**

Forgive me for my bad English. I want to get HTML pages.

For example from http://anyurl.com
I want to receive:

Code: Select all

 <!DOCTYPE html>
<html>
<head>
<title>...</title>
</head>
<body>
....
</body>
</html>

Posted: **Mon Sep 11, 2017 4:36 pm**

Rjevsky wrote:I want to get HTML pages.

this is not that easy because of the Same-Origin-Policy

Here's a little trick using whateverorigin:

Code: Select all

Procedure ScrapPageCallback(Result.s)
  Debug Result
EndProcedure

Procedure ScrapPage(Url.s, Callback)
  ! $.getJSON('http://www.whateverorigin.org/get?url=' + encodeURIComponent(v_url) + '&callback=?', function(data){
  !   v_callback(data.contents);
  ! });
EndProcedure

ScrapPage("http://www.spiderbasic.com", @ScrapPageCallback())

Note, that is only a temporary solution. The better way is to run a little php-snippet on your own server:
http://forums.spiderbasic.com/viewtopic ... 1848#p1848

Greetings ... Peter

Posted: **Mon Sep 11, 2017 5:20 pm**

Peter wrote:The better way is to run a little php-snippet on your own server

Thanks for the help. Can I make it even easier: to display the page from my web server? (I need it for the android application)

Posted: **Mon Sep 11, 2017 10:57 pm**

Rjevsky wrote:Can I make it even easier: to display the page from my web server?

WebGadget() ?

SpiderBasic

How to read html url as string

How to read html url as string

Re: How to read html url as string

Re: How to read html url as string

Re: How to read html url as string

Re: How to read html url as string

Re: How to read html url as string