Universal

`universal`

Fetch any URL directly.

Parameter

Type

Required

Description

url

string (URI)

Yes

The URL to fetch.

country

string

See common parameters.

parse

boolean

See common parameters.

city

string

City-level geotargeting.

state

string

State/region-level geotargeting.

curl -X POST 'https://scraping.production.goproxies.com/api/v1/scrapes' \
  -H 'X-Api-Key: <your-api-key>' \
  -H 'Content-Type: application/json' \
  -d '{
    "universal": {
      "url": "https://www.day.lt",
      "parse": true
    }
  }'

const response = await fetch("https://scraping.production.goproxies.com/api/v1/scrapes", {
  method: "POST",
  headers: {
    "X-Api-Key": "<your-api-key>",
    "Content-Type": "application/json",
  },
  body: JSON.stringify({
    universal: {
      url: "https://www.day.lt",
      parse: true,
    },
  }),
});

const data = await response.json();
console.log(data);

import requests

url = "https://scraping.production.goproxies.com/api/v1/scrapes"
headers = {
    "X-Api-Key": "<your-api-key>",
    "Content-Type": "application/json",
}
payload = {
    "universal": {
        "url": "https://www.day.lt",
        "parse": True,
    }
}

response = requests.post(url, headers=headers, json=payload)
print(response.json())

Last updated 4 days ago

Was this helpful?